Using claims in the media to teach essential concepts for evidence-based healthcare

publishedVersio

Key Concepts for making informed Choices

Teach people to think critically about claims and comparisons — they will make better decisions

Lessons from working across fields to develop a framework for informed choices

In late 2018, Iain Chalmers, Andy Oxman and others from the Informed Health Choices team convened a cross-field forum to develop a generic framework of key concepts for thinking critically about claims, research and choices about interventions, with the aim of supporting ‘informed choices’. We define an informed choice as one that is based on critical understanding of the relevant available evidence. This paper describes the process of that cross-field engagement, and reflects on how consensus was reached on the generic framework. Working in an alliance of 24 researchers from across fields to develop the Key Concepts for Informed Choices framework, we learned three lessons about cross-field working: (1) there was much agreement, despite diversity of views and experiences; (2) the applications of our work were broader than we could have imagined; and (3) we identified a wide range of problems that we have in common when making informed choices. Here we describe our experience of working together to develop the framework, and draw out lessons for others who may be involved in similar cross-field initiatives

A cross-sectional survey of the prevalence of environmental tobacco smoke preventive care provision by child health services in Australia

Background: Despite the need for a reduction in levels of childhood exposure to environmental tobacco smoke (ETS) being a recognised public health goal, the delivery of ETS preventive care in child health service settings remains a largely unstudied area. The purpose of this study was to determine the prevalence of ETS preventive care in child health services; differences in the provision of care by type of service; the prevalence of strategies to support such care; and the association between care support strategies and care provision. Method: One-hundred and fifty-one (83%) child health service managers within New South Wales, Australia completed a questionnaire in 2002 regarding the: assessment of parental smoking and child ETS exposure; the provision of parental smoking cessation and ETS-exposure reduction advice; and strategies used to support the provision of such care. Child health services were categorised based on their size and case-mix, and a chi-square analysis was performed to compare the prevalence of ETS risk assessment and ETS prevention advice between service types. Logistic regression analysis was used to examine associations between the existence of care support strategies and the provision of ETS risk assessment and ETS exposure prevention advice. Results: A significant proportion of services reported that they did not assess parental smoking status (26%), and reported that they did not assess the ETS exposure (78%) of any child. Forty four percent of services reported that they did not provide smoking cessation advice and 20% reported they did not provide ETS exposure prevention advice. Community based child and family health services reported a greater prevalence of ETS preventive care compared to other hospital based units. Less than half of the services reported having strategies to support the provision of ETS preventive care. The existence of such support strategies was associated with greater odds of care provision. Conclusions: The existence of major gaps in recommended ETS preventive care provision suggests a need for additional initiatives to increase such care delivery. The low prevalence of strategies that support such care delivery suggests a potential avenue to achieve this outcome

Promotoras as Mental Health Practitioners in Primary Care: A Multi-Method Study of an Intervention to Address Contextual Sources of Depression

We assessed the role of promotoras—briefly trained community health workers—in depression care at community health centers. The intervention focused on four contextual sources of depression in underserved, low-income communities: underemployment, inadequate housing, food insecurity, and violence. A multi-method design included quantitative and ethnographic techniques to study predictors of depression and the intervention’s impact. After a structured training program, primary care practitioners (PCPs) and promotoras collaboratively followed a clinical algorithm in which PCPs prescribed medications and/or arranged consultations by mental health professionals and promotoras addressed the contextual sources of depression. Based on an intake interview with 464 randomly recruited patients, 120 patients with depression were randomized to enhanced care plus the promotora contextual intervention, or to enhanced care alone. All four contextual problems emerged as strong predictors of depression (chi square, p < .05); logistic regression revealed housing and food insecurity as the most important predictors (odds ratios both 2.40, p < .05). Unexpected challenges arose in the intervention’s implementation, involving infrastructure at the health centers, boundaries of the promotoras’ roles, and “turf” issues with medical assistants. In the quantitative assessment, the intervention did not lead to statistically significant improvements in depression (odds ratio 4.33, confidence interval overlapping 1). Ethnographic research demonstrated a predominantly positive response to the intervention among stakeholders, including patients, promotoras, PCPs, non-professional staff workers, administrators, and community advisory board members. Due to continuing unmet mental health needs, we favor further assessment of innovative roles for community health workers

Quality of information in news media reports about the effects of health interventions: Systematic review and meta-analyses

Background: Many studies have assessed the quality of news reports about the effects of health interventions, but there has been no systematic review of such studies or meta-analysis of their results. We aimed to fill this gap (PROSPERO ID: CRD42018095032). Methods: We included studies that used at least one explicit, prespecified and generic criterion to assess the quality of news reports in print, broadcast, or online news media, and specified the sampling frame, and the selection criteria and technique. We assessed criteria individually for inclusion in the meta-analyses, excluding inappropriate criteria and criteria with inadequately reported results. We mapped and grouped criteria to facilitate evidence synthesis. Where possible, we extracted the proportion of news reports meeting the included criterion. We performed meta-analyses using a random effects model to estimate such proportions for individual criteria and some criteria groups, and to characterise heterogeneity across studies. Results: We included 44 primary studies in the qualitative summary, and 18 studies and 108 quality criteria in the meta-analyses. Many news reports gave an unbalanced and oversimplified picture of the potential consequences of interventions. A limited number mention or adequately address conflicts of interest (22%; 95% CI 7%-49%) (low certainty), alternative interventions (36%; 95% CI 26%-47%) (moderate certainty), potential harms (40%; 95% CI 23%-61%) (low certainty), or costs (18%; 95% CI 12%-28%) (moderate certainty), or quantify effects (53%; 95% CI 36%-69%) (low certainty) or report absolute effects (17%; 95% CI 4%-49%) (low certainty). Discussion: There is room for improving health news, but it is logically more important to improve the public’s ability to critically appraise health information and make judgements for themselves

Using claims in the media to teach essential concepts for evidence-based healthcare

Healthcare students and professionals, as well as patients and everyone else, are exposed to countless health claims—particularly claims about the effects of interventions—spreading further and faster than ever, via the Internet. Many of the claims are unreliable, such as those that conflate correlation and causation. Meanwhile, many people are unable to critically assess their reliability. For example, here in Norway, a survey conducted in 2019 among a representative sample of the population—including healthcare professionals—indicated that a majority of Norwegians are unable to apply several fundamental concepts for assessing health claims and making informed health choices, such as the importance of similar comparison groups for finding intervention effects (149 of 771 participants were able). The combination of unreliable claims and inability to critically assess those claims can lead to uninformed choices (including shared decisions) and be a barrier to evidence-based healthcare (EBHC). Logically, this is a major explanatory factor in the known, worldwide overuse of ineffective and harmful medical services4 and underuse of effective services

Protocol for assessing stakeholder engagement in the development and evaluation of the Informed Health Choices resources teaching secondary school students to think critically about health claims and choices.

BackgroundAs part of a five year plan (2019-2023), the Informed Health Choices Project, is developing and evaluating resources for helping secondary school students learn to think critically about health claims and choices. We will bring together key stakeholders; such as secondary school teachers and students, our main target for the IHC secondary school resources, school administrators, policy makers, curriculum development specialists and parents, to enable us gain insight about the context.ObjectivesTo ensure that stakeholders are effectively and appropriately engaged in the design, evaluation and dissemination of the learning resources.To evaluate the extent to which stakeholders were successfully engaged.MethodsUsing a multi-stage stratified sampling method, we will identify a representative sample of secondary schools with varied characteristics that might modify the effects of the learning resources such as, the school location (rural, semi-urban or urban), ownership (private, public) and ICT facilities (under resourced, highly resourced). A sample of schools will be randomly selected from the schools in each stratum. We will aim to recruit a diverse sample of students and secondary school teachers from those schools. Other stakeholders will be purposively selected to ensure a diverse range of experience and expertise.ResultsTogether with the teacher and student networks and the advisory panels, we will establish measurable success criteria that reflect the objectives of engaging stakeholders at the start of the project and evaluate the extent to which those criteria were met at the end of the project.ConclusionWe aim for an increase in research uptake, improve quality and appropriateness of research results, accountability and social justice

Informed Health Choices media intervention for improving people’s ability to critically appraise the trustworthiness of claims about treatment effects: a mixed-methods process evaluation of a randomised trial in Uganda

We developed the Informed Health Choices podcast to improve people’s ability to assess claims about the effects of treatments. We evaluated the effects of the podcast in a randomised trial.We conducted this process evaluation to assess the fidelity of the intervention, identify factors that affected the implementation and impact of the intervention and could affect scaling up, and identify potential adverse and beneficial effects.The study was conducted in central Uganda in rural, periurban and urban settings.We collected data on parents who were in the intervention arm of the Informed Health Choices study that evaluated an intervention to improve parents’ ability to assess treatment effects.We conducted 84 semistructured interviews during the intervention, 19 in-depth interviews shortly after, two focus group discussions with parents, one focus group discussion with research assistants and two in-depth interviews with the principal investigators. We used framework analysis to manage qualitative data, assessed the certainty of the findings using the GRADE-CERQual (Grading of Recommendations, Assessment, Development and Evaluations-Confidence in the Evidence from Reviews of Qualitative Research) approach, and organised findings in a logic model.Proportion of participants listening to all episodes; factors influencing the implementation of the podcast; ways to scale up and any adverse and beneficial effects.All participants who completed the study listened to the podcast as intended, perhaps because of the explanatory design and recruitment of parents with a positive attitude. This was also likely facilitated by the podcast being delivered by research assistants, and providing the participants with MP3 players. The podcast was reportedly clear, understandable, credible and entertaining, which motivated them to listen and eased implementation. No additional adverse effects were reported.Participants experienced the podcast positively and were motivated to engage with it. These findings help to explain the short-term effectiveness of the intervention, but not the decrease in effectiveness over the following year