The harvest plot: A method for synthesising evidence about the differential effects of interventions

<p>Abstract</p> <p>Background</p> <p>One attraction of meta-analysis is the forest plot, a compact overview of the essential data included in a systematic review and the overall 'result'. However, meta-analysis is not always suitable for synthesising evidence about the effects of interventions which may influence the wider determinants of health. As part of a systematic review of the effects of population-level tobacco control interventions on social inequalities in smoking, we designed a novel approach to synthesis intended to bring aspects of the graphical directness of a forest plot to bear on the problem of synthesising evidence from a complex and diverse group of studies.</p> <p>Methods</p> <p>We coded the included studies (n = 85) on two methodological dimensions (suitability of study design and quality of execution) and extracted data on effects stratified by up to six different dimensions of inequality (income, occupation, education, gender, race or ethnicity, and age), distinguishing between 'hard' (behavioural) and 'intermediate' (process or attitudinal) outcomes. Adopting a hypothesis-testing approach, we then assessed which of three competing hypotheses (positive social gradient, negative social gradient, or no gradient) was best supported by each study for each dimension of inequality.</p> <p>Results</p> <p>We plotted the results on a matrix ('harvest plot') for each category of intervention, weighting studies by the methodological criteria and distributing them between the competing hypotheses. These matrices formed part of the analytical process and helped to encapsulate the output, for example by drawing attention to the finding that increasing the price of tobacco products may be more effective in discouraging smoking among people with lower incomes and in lower occupational groups.</p> <p>Conclusion</p> <p>The harvest plot is a novel and useful method for synthesising evidence about the differential effects of population-level interventions. It contributes to the challenge of making best use of all available evidence by incorporating all relevant data. The visual display assists both the process of synthesis and the assimilation of the findings. The method is suitable for adaptation to a variety of questions in evidence synthesis and may be particularly useful for systematic reviews addressing the broader type of research question which may be most relevant to policymakers.</p

Should a colon cancer screening decision aid include the option of no testing? A comparative trial of two decision aids

<p>Abstract</p> <p>Background</p> <p>An important question in the development of decision aids about colon cancer (CRC) screening is whether to include an explicit discussion of the option of not being screened. We examined the effect of including or not including an explicit discussion of the option of deciding not to be screened in a CRC screening decision aid on subjective measures of decision aid content; interest in screening; and knowledge.</p> <p>Methods</p> <p>Adults ages 50–85 were assigned to view one of two versions of the decision aid. The two versions differed only in the inclusion of video segments of two men, one of whom decided against being screened. Participants completed questionnaires before and after viewing the decision aid to compare subjective measures of content, screening interest and intent, and knowledge between groups. Likert response categories (5-point) were used for subjective measures of content (eg. clarity, balance in favor/against screening, and overall rating), and screening interest. Knowledge was measured with a three item index and individual questions. Higher scores indicated favorable responses for subjective measures, greater interest, and better knowledge. For the subjective balance, lower numbers were associated with the impression of the decision aid favoring CRC screening.</p> <p>Results</p> <p>57 viewed the "with" version which included the two segments and 49 viewed the "without" version. After viewing, participants found the "without" version to have better subjective clarity about benefits of screening ("with" 3.4, "without" 4.1, <it>p </it>< 0.01), and to have greater clarity about downsides of screening ("with" 3.2, "without" 3.6, <it>p </it>= 0.03). The "with" version was considered to be less strongly balanced in favor of screening. ("with" 1.8, "without" 1.6, <it>p </it>= 0.05); but the "without" version received a better overall rating ("with" 3.5, "without" 3.8, <it>p </it>= 0.03). Groups did not differ in screening interest after viewing a decision aid or knowledge.</p> <p>Conclusion</p> <p>A decision aid with the explicit discussion of the option of deciding not to be screened appears to increase the impression that the program was not as strongly in favor of screening, but decreases the impression of clarity and resulted in a lower overall rating. We did not observe clinically important or statistically significant differences in interest in screening or knowledge.</p

Building blocks for meta-synthesis: data integration tables for summarising, mapping, and synthesising evidence on interventions for communicating with health consumers

<p>Abstract</p> <p>Background</p> <p>Systematic reviews have developed into a powerful method for summarising and synthesising evidence. The rise in systematic reviews creates a methodological opportunity and associated challenges and this is seen in the development of overviews, or reviews of systematic reviews. One of these challenges is how to summarise evidence from systematic reviews of complex interventions for inclusion in an overview. Interventions for communicating with and involving consumers in their care are frequently complex. In this article we outline a method for preparing data integration tables to enable review-level synthesis of the evidence on interventions for communication and participation in health.</p> <p>Methods and Results</p> <p>Systematic reviews published by the Cochrane Consumers and Communication Review Group were utilised as the basis from which to develop linked steps for data extraction, evidence assessment and synthesis. The resulting output is called a data integration table. Four steps were undertaken in designing the data integration tables: first, relevant information for a comprehensive picture of the characteristics of the review was identified from each review, extracted and summarised. Second, results for the outcomes of the review were assessed and translated to standardised evidence statements. Third, outcomes and evidence statements were mapped into an outcome taxonomy that we developed, using language specific to the field of interventions for communication and participation. Fourth, the implications of the review were assessed after the mapping step clarified the level of evidence available for each intervention.</p> <p>Conclusion</p> <p>The data integration tables represent building blocks for constructing overviews of review-level evidence and for the conduct of meta-synthesis. Individually, each table aims to improve the consistency of reporting on the features and effects of interventions for communication and participation; provides a broad assessment of the strength of evidence derived from different methods of analysis; indicates a degree of certainty with results; and reports outcomes and gaps in the evidence in a consistent and coherent way. In addition, individual tables can serve as a valuable tool for accurate dissemination of large amounts of complex information on communication and participation to professionals as well as to members of the public.</p

Toward optimal implementation of cancer prevention and control programs in public health: A study protocol on mis-implementation

Abstract Background Much of the cancer burden in the USA is preventable, through application of existing knowledge. State-level funders and public health practitioners are in ideal positions to affect programs and policies related to cancer control. Mis-implementation refers to ending effective programs and policies prematurely or continuing ineffective ones. Greater attention to mis-implementation should lead to use of effective interventions and more efficient expenditure of resources, which in the long term, will lead to more positive cancer outcomes. Methods This is a three-phase study that takes a comprehensive approach, leading to the elucidation of tactics for addressing mis-implementation. Phase 1: We assess the extent to which mis-implementation is occurring among state cancer control programs in public health. This initial phase will involve a survey of 800 practitioners representing all states. The programs represented will span the full continuum of cancer control, from primary prevention to survivorship. Phase 2: Using data from phase 1 to identify organizations in which mis-implementation is particularly high or low, the team will conduct eight comparative case studies to get a richer understanding of mis-implementation and to understand contextual differences. These case studies will highlight lessons learned about mis-implementation and identify hypothesized drivers. Phase 3: Agent-based modeling will be used to identify dynamic interactions between individual capacity, organizational capacity, use of evidence, funding, and external factors driving mis-implementation. The team will then translate and disseminate findings from phases 1 to 3 to practitioners and practice-related stakeholders to support the reduction of mis-implementation. Discussion This study is innovative and significant because it will (1) be the first to refine and further develop reliable and valid measures of mis-implementation of public health programs; (2) bring together a strong, transdisciplinary team with significant expertise in practice-based research; (3) use agent-based modeling to address cancer control implementation; and (4) use a participatory, evidence-based, stakeholder-driven approach that will identify key leverage points for addressing mis-implementation among state public health programs. This research is expected to provide replicable computational simulation models that can identify leverage points and public health system dynamics to reduce mis-implementation in cancer control and may be of interest to other health areas

Improving the use of research evidence in guideline development: 9. Grading evidence and recommendations

BACKGROUND: The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the ninth of a series of 16 reviews that have been prepared as background for advice from the WHO Advisory Committee on Health Research to WHO on how to achieve this. OBJECTIVES: We reviewed the literature on grading evidence and recommendations in guidelines. METHODS: We searched PubMed and three databases of methodological studies for existing systematic reviews and relevant methodological research. We did not conduct a full systematic review ourselves. Our conclusions are based on the available evidence, consideration of what WHO and other organisations are doing and logical arguments. KEY QUESTIONS AND ANSWERS: Should WHO grade the quality of evidence and the strength of recommendations? • Users of recommendations need to know how much confidence they can place in the underlying evidence and the recommendations. The degree of confidence depends on a number of factors and requires complex judgments. These judgments should be made explicitly in WHO recommendations. A systematic and explicit approach to making judgments about the quality of evidence and the strength of recommendations can help to prevent errors, facilitate critical appraisal of these judgments, and can help to improve communication of this information. What criteria should be used to grade evidence and recommendations? • Both the quality of evidence and the strength of recommendations should be graded. The criteria used to grade the strength of recommendations should include the quality of the underlying evidence, but should not be limited to that. • The approach to grading should be one that has wide international support and is suitable for a wide range of different types of recommendations. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach, which is currently suggested in the Guidelines for WHO Guidelines, is being used by an increasing number of other organizations internationally. It should be used more consistently by WHO. Further developments of this approach should ensure its wide applicability. Should WHO use the same grading system for all of its recommendations? • Although there are arguments for and against using the same grading system across a wide range of different types of recommendations, WHO should use a uniform grading system to prevent confusion for developers and users of recommendations

A Mumps Outbreak in Vojvodina, Serbia, in 2012 Underlines the Need for Additional Vaccination Opportunities for Young Adults

In 2012, mumps was introduced from Bosnia and Herzegovina to Vojvodina, causing an outbreak with 335 reported cases. The present manuscript analyses the epidemiological and laboratory characteristics of this outbreak, identifies its main causes and suggests potential future preventive measures. Sera of 133 patients were tested for mumps-specific antibodies by ELISA and 15 nose/throat swabs were investigated for mumps virus RNA by RT-PCR. IgG antibodies were found in 127 patients (95.5%). Mumps infection was laboratory-confirmed in 53 patients, including 44 IgM and 9 PCR positive cases. All other 282 cases were classified as epidemiologically-confirmed. More than half of the patients (n = 181, 54%) were 20-29 years old, followed by the 15-19 age bracket (n = 95, 28.4%). Twice as many males as females were affected (67% versus 33%). Disease complications were reported in 13 cases (3.9%), including 9 patients with orchitis and 4 with pancreatitis. According to medical records or anamnestic data, 190 patients (56.7%) were immunized with two doses and 35 (10.4%) with one dose of mumps-containing vaccine. The Serbian sequences corresponded to a minor genotype G variant detected during the 2011/2012 mumps outbreak in Bosnia and Herzegovina. Vaccine failures, the initial one-dose immunization policy and a vaccine shortage between 1999 and 2002 contributed to the outbreak. Additional vaccination opportunities should be offered to young adults during transition periods in their life trajectories

Improving the use of research evidence in guideline development: 8. Synthesis and presentation of evidence

BACKGROUND: The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the eighth of a series of 16 reviews that have been prepared as background for advice from the WHO Advisory Committee on Health Research to WHO on how to achieve this. OBJECTIVES: We reviewed the literature on the synthesis and presentation of research evidence, focusing on four key questions. METHODS: We searched PubMed and three databases of methodological studies for existing systematic reviews and relevant methodological research. We did not conduct systematic reviews ourselves. Our conclusions are based on the available evidence, consideration of what WHO and other organisations are doing and logical arguments. KEY QUESTIONS AND ANSWERS: We found two reviews of instruments for critically appraising systematic reviews, several studies of the importance of using extensive searches for reviews and determining when it is important to update reviews, and consensus statements about the reporting of reviews that informed our answers to the following questions. How should existing systematic reviews be critically appraised? • Because preparing systematic reviews can take over a year and require capacity and resources, existing reviews should be used when possible and updated, if needed. • Standard criteria, such as A MeaSurement Tool to Assess Reviews (AMSTAR), should be used to critically appraise existing systematic reviews, together with an assessment of the relevance of the review to the questions being asked. When and how should WHO undertake or commission new reviews? • Consideration should be given to undertaking or commissioning a new review whenever a relevant, up-to-date review of good quality is not available. • When time or resources are limited it may be necessary to undertake rapid assessments. The methods that are used to do these assessments should be reported, including important limitations and uncertainties and explicit consideration of the need and urgency of undertaking a full systematic review. • Because WHO has limited capacity for undertaking systematic reviews, reviews will often need to be commissioned when a new review is needed. Consideration should be given to establishing collaborating centres to undertake or support this work, similar to what some national organisations have done. How should the findings of systematic reviews be summarised and presented to committees responsible for making recommendations? • Concise summaries (evidence tables) of the best available evidence for each important outcome, including benefits, harms and costs, should be presented to the groups responsible for making recommendations. These should include an assessment of the quality of the evidence and a summary of the findings for each outcome. • The full systematic reviews, on which the summaries are based, should also be available to both those making recommendations and users of the recommendations. What additional information is needed to inform recommendations and how should this information be synthesised with information about effects and presented to committees? • Additional information that is needed to inform recommendations includes factors that might modify the expected effects, need (prevalence, baseline risk or status), values (the relative importance of key outcomes), costs and the availability of resources. • Any assumptions that are made about values or other factors that may vary from setting to setting should be made explicit. • For global guidelines that are intended to inform decisions in different settings, consideration should be given to using a template to assist the synthesis of information specific to a setting with the global evidence of the effects of the relevant interventions

Applying strategies from libertarian paternalism to decision making for prostate specific antigen (PSA) screening

<p>Abstract</p> <p>Background</p> <p>Despite the recent publication of results from two randomized clinical trials, prostate specific antigen (PSA) screening for prostate cancer remains a controversial issue. There is lack of agreement across studies that PSA screening significantly reduces prostate cancer mortality. In spite of these facts, the widespread use of PSA testing in the United States leads to overdetection and overtreatment of clinically indolent prostate cancer, and its associated harms of incontinence and impotence.</p> <p>Discussion</p> <p>Given the inconclusive results from clinical trials and incongruent PSA screening guidelines, the decision to screen for prostate cancer with PSA testing is an uncertain one for patients and health care providers. Screening guidelines from some health organizations recommend an informed decision making (IDM) or shared decision making (SDM) approach for deciding on PSA screening. These approaches aim to empower patients to choose among the available options by making them active participants in the decision making process. By increasing involvement of patients in the clinical decision-making process, IDM/SDM places more of the responsibility for a complex decision on the patient. Research suggests, however, that patients are not well-informed of the harms and benefits associated with prostate cancer screening and are also subject to an assortment of biases, emotion, fears, and irrational thought that interferes with making an informed decision. In response, the IDM/SDM approaches can be augmented with strategies from the philosophy of libertarian paternalism (LP) to improve decision making. LP uses the insights of behavioural economics to help people better make better choices. Some of the main strategies of LP applicable to PSA decision making are a default decision rule, framing of decision aids, and timing of the decision. In this paper, we propose that applying strategies from libertarian paternalism can help with PSA screening decision-making.</p> <p>Summary</p> <p>Our proposal to augment IDM and SDM approaches with libertarian paternalism strategies is intended to guide patients toward a better decision about testing while maintaining personal freedom of choice. While PSA screening remains controversial and evidence conflicting, a libertarian-paternalism influenced approach to decision making can help prevent the overdiagnosis and overtreatment of prostate cancer.</p

Feasibility and impact of providing feedback to vaccinating medical clinics: evaluating a public health intervention

<p>Abstract</p> <p>Background</p> <p>Vaccine coverage (VC) at a given age is a widely-used indicator for measuring the performance of vaccination programs. However, there is increasing data suggesting that measuring delays in administering vaccines complements the measure of VC. Providing feedback to vaccinators is recognized as an effective strategy for improving vaccine coverage, but its implementation has not been widely documented in Canada. The objective of this study was to evaluate the feasibility of providing personalized feedback to vaccinators and its impact on vaccination delays (VD).</p> <p>Methods</p> <p>In April and May 2008, a one-hour personalized feedback session was provided to health professionals in vaccinating medical clinics in the Quebec City region. VD for vaccines administered at two and twelve months of age were presented. Data from the regional vaccination registry were analysed for participating clinics. Two 12-month periods before and after the intervention were compared, namely from April 1^st, 2007 to March 31^st, 2008 and from June 1^st, 2008 to May 31^st, 2009.</p> <p>Results</p> <p>Ten medical clinics out of the twelve approached (83%), representing more than 2500 vaccinated children, participated in the project. Preparing and conducting the feedback involved 20 hours of work and expenses of $1000 per clinic. Based on a delay of one month, 94% of first doses of DTaP-Polio-Hib and 77% of meningococcal vaccine doses respected the vaccination schedule both before and after the intervention. Following the feedback, respect of the vaccination schedule increased for vaccines planned at 12 months for the four clinics that had modified their vaccination practices related to multiple injections (depending on the clinic, VD decreased by 24.4%, 32.0%, 40.2% and 44.6% respectively, p < 0.001 for all comparisons).</p> <p>Conclusions</p> <p>The present study shows that it is feasible to provide personalized feedback to vaccinating clinics. While it may have encouraged positive changes in practice concerning multiple injections, this intervention on its own did not impact vaccination delays of the clinics visited. It is possible that feedback integrated into other types of effective interventions and sustained over time may have more impact on VD.</p