Using GRADE Evidence to Decision frameworks to support the process of health policy-making

BACKGROUND: Grading of Recommendations, Assessment, Development and Evaluation (GRADE) Evidence to Decision (EtD) frameworks are well-known tools that enable guideline panels to structure the process of developing recommendations and making decisions in healthcare and public health. To date, they have not regularly been used for health policy-making. This article aims to illustrate the application of the GRADE EtD frameworks in the process of nutrition-related policy-making for a European country. METHODS: Based on methodological guidance by the GRADE Working Group and the findings of our recently published scoping review, we illustrate the process of moving from evidence to recommendations, by applying the EtD frameworks to a fictitious example. Sugar-sweetened beverage (SSB) taxation based on energy density was chosen as an example application. RESULTS: A fictitious guideline panel was convened by a national nutrition association to develop a population-level recommendation on SSB taxation aiming to reduce the burden of overweight and obesity. Exemplary evidence was summarized for each EtD criterion and conclusions were drawn based on all judgements made in relation to each criterion. As a result of the high priority to reduce the burden of obesity and because of the moderate desirable effects on health outcomes, but considering scarce or varying research evidence for other EtD criteria, the panel made a conditional recommendation for SSB taxation. Decision-makers may opt for conducting a pilot study prior to implementing the policy on a national level. CONCLUSIONS: GRADE EtD frameworks can be used by guideline panels to make the process of developing recommendations in the field of health policy more systematic, transparent and comprehensible

Use of the GRADE approach in health policymaking and evaluation: a scoping review of nutrition and physical activity policies

BACKGROUND Nutrition and physical activity policies have the potential to influence lifestyle patterns and reduce the burden of non-communicable diseases. In the world of health-related guidelines, GRADE (Grading of Recommendations, Assessment, Development and Evaluation) is the most widely used approach for assessing the certainty of evidence and determining the strength of recommendations. Thus, it is relevant to explore its usefulness also in the process of nutrition and physical activity policymaking and evaluation. The purpose of this scoping review was (i) to generate an exemplary overview of documents using the GRADE approach in the process of nutrition and physical activity policymaking and evaluation, (ii) to find out how the GRADE approach has been applied, and (iii) to explore which facilitators of and barriers to the use of GRADE have been described on the basis of the identified documents. The overarching aim of this work is to work towards improving the process of evidence-informed policymaking in the areas of dietary behavior, physical activity, and sedentary behavior. METHODS A scoping review was conducted according to current reporting standards. MEDLINE via Ovid, the Cochrane Library, and Web of Science were systematically searched up until 4 July 2019. Documents describing a body of evidence which was assessed for the development or evaluation of a policy, including documents labeled as \textquotedblguidelines,\textquotedbl or systematic reviews used to inform policymaking were included. RESULTS Thirty-six documents were included. Overall, 313 GRADE certainty of evidence ratings were identified in systematic reviews and guidelines; the strength of recommendations/policies was assessed in four documents, and six documents mentioned facilitators or barriers for the use of GRADE. The major reported barrier was the initial low starting level of a body of evidence from non-randomized studies when assessing the certainty of evidence. CONCLUSION This scoping review found that the GRADE approach has been used for policy evaluations, in the evaluation of the effectiveness of policy-relevant interventions (policymaking), as well as in the development of guidelines intended to guide policymaking. Several areas for future research were identified to explore the use of GRADE in health policymaking and evaluation

Towards a harmonized European surveillance for dietary and physical activity indicators in young and adult populations

Background The Policy Evaluation Network proposes a consolidated approach to measure comparable health indicators across European health surveillance systems to evaluate effectiveness of policy action. Methods In a stepwise approach, questionnaire items used by the systems for measuring diet and physical activity data to describe health indicators were identified based on their validity, reliability, and suitability to monitor achievement of health recommendations. They were collated to unified questionnaire modules and discussed bilaterally with representatives of these systems to explore barriers and facilitators for implementation. Also, establishment of a methodological competence platform was proposed, in which the surveillance and monitoring systems agree on the priorities and common quality standards for the harmonization process and to coordinate the integration of questionnaire modules into existing systems. Results In total, seven questionnaire modules were developed, of which two diet and two physical activity modules were proposed for implementation. Each module allows measurement of data reflecting only partial aspects of national and WHO recommendations related to diet and physical activity. Main barriers were the requirements of systems to monitor temporal trends and to minimize costs. Main facilitator for implementation was the systems’ use of questionnaire items that were comparable to the unified modules. Representatives agreed to participate in a methodological competence platform. Conclusion We successfully took first steps in the realization of the roadmap towards a harmonization of European surveillance by introducing unified questionnaire modules allowing the collection of comparable health indicators and by initiating the establishment of a competence platform to guide this process

advancing the evidence base for public policies impacting on dietary behaviour physical activity and sedentary behaviour in europe the policy evaluation network promoting a multidisciplinary approach

Abstract Non-communicable diseases (NCDs) are the leading cause of global mortality. As the social and economic costs of NCDs have escalated, action is needed to tackle important causes of many NCD's: low physical activity levels and unhealthy dietary behaviours. As these behaviours are driven by upstream factors, successful policy interventions are required that encourage healthy dietary behaviours, improve physical activity levels and reduce sedentary behaviours of entire populations. However, to date, no systematic research on the implementation and evaluation of policy interventions related to these health behaviours has been conducted across Europe. Consequently, no information on the merit, gaps, worth or utility of cross-European policy interventions is available, and no guidance or recommendations on how to enhance this knowledge across European countries exists. As part of the Joint Programming Initiative "A Healthy Diet for a Healthy Life" (JPI HDHL), 28 research institutes from seven European countries and New Zealand have combined their expertise to form the Policy Evaluation Network (PEN). PEN's aim is to advance tools to identify, evaluate, implement and benchmark policies designed to directly or indirectly target dietary behaviours, physical activity, and sedentary behaviour in Europe, as well as to understand how these policies increase or decrease health inequalities. Using well-defined evaluation principles and methods, PEN will examine the content, implementation and impact of policies addressing dietary behaviour, physical activity levels and sedentary behaviour across Europe. It will realise the first steps in a bespoke health policy monitoring and surveillance system for Europe, and refine our knowledge of appropriate research designs and methods for the quantification of policy impact. It will contribute to our understanding of how to achieve successful transnational policy implementation and monitoring of these policies in different cultural, demographic or socioeconomic settings. PEN will consider equity and diversity aspects to ensure that policy actions are inclusive and culturally sensitive. Finally, based on three policy cases, PEN will illustrate how best to evaluate the implementation and impact of such policies in order to yield healthy diets and activity patterns that result in healthier lives for all European citizens

Dynamics of the complex food environment underlying dietary intake in low-income groups: a systems map of associations extracted from a systematic umbrella literature review

Background: Inequalities in obesity pertain in part to differences in dietary intake in different socioeconomic groups. Examining the economic, social, physical and political food environment of low-income groups as a complex adaptive system – i.e. a system of multiple, interconnected factors exerting non-linear influence on an outcome, can enhance the development and assessment of effective policies and interventions by honouring the complexity of lived reality. We aimed to develop and apply novel causal loop diagramming methods in order to construct an evidence-based map of the underlying system of environmental factors that drives dietary intake in low-income groups. Methods: A systematic umbrella review was conducted on literature examining determinants of dietary intake and food environments in low-income youths and adults in high/upper-middle income countries. Information on the determinants and associations between determinants was extracted from reviews of quantitative and qualitative studies. Determinants were organised using the Determinants of Nutrition and Eating (DONE) framework. Associations were synthesised into causal loop diagrams that were subsequently used to interpret the dynamics underlying the food environment and dietary intake. The map was reviewed by an expert panel and systems-based analysis identified the system paradigm, structure, feedback loops and goals. Results: Findings from forty-three reviews and expert consensus were synthesised in an evidence-based map of the complex adaptive system underlying the food environment influencing dietary intake in low-income groups. The system was interpreted as operating within a supply-and-demand, economic paradigm. Five sub-systems (‘geographical accessibility’, ‘household finances’, ‘household resources’, ‘individual influences’, ‘social and cultural influences’) were presented as causal loop diagrams comprising 60 variables, conveying goals which undermine healthy dietary intake. Conclusions: Our findings reveal how poor dietary intake in low-income groups can be presented as an emergent property of a complex adaptive system that sustains a food environment that increases the accessibility, availability, affordability and acceptability of unhealthy foods. In order to reshape system dynamics driving unhealthy food environments, simultaneous, diverse and innovative strategies are needed to facilitate longer-term management of household finances and socially-oriented practices around healthy food production, supply and intake. Ultimately, such strategies must be supported by a system paradigm which prioritises health

Dynamics of the complex food environment underlying dietary intake in low-income groups: a systems map of associations extracted from a systematic umbrella literature review

Background: Inequalities in obesity pertain in part to differences in dietary intake in different socioeconomic groups. Examining the economic, social, physical and political food environment of low-income groups as a complex adaptive system – i.e. a system of multiple, interconnected factors exerting non-linear influence on an outcome, can enhance the development and assessment of effective policies and interventions by honouring the complexity of lived reality. We aimed to develop and apply novel causal loop diagramming methods in order to construct an evidence-based map of the underlying system of environmental factors that drives dietary intake in low-income groups. Methods: A systematic umbrella review was conducted on literature examining determinants of dietary intake and food environments in low-income youths and adults in high/upper-middle income countries. Information on the determinants and associations between determinants was extracted from reviews of quantitative and qualitative studies. Determinants were organised using the Determinants of Nutrition and Eating (DONE) framework. Associations were synthesised into causal loop diagrams that were subsequently used to interpret the dynamics underlying the food environment and dietary intake. The map was reviewed by an expert panel and systems-based analysis identified the system paradigm, structure, feedback loops and goals. Results: Findings from forty-three reviews and expert consensus were synthesised in an evidence-based map of the complex adaptive system underlying the food environment influencing dietary intake in low-income groups. The system was interpreted as operating within a supply-and-demand, economic paradigm. Five sub-systems (‘geographical accessibility’, ‘household finances’, ‘household resources’, ‘individual influences’, ‘social and cultural influences’) were presented as causal loop diagrams comprising 60 variables, conveying goals which undermine healthy dietary intake. Conclusions: Our findings reveal how poor dietary intake in low-income groups can be presented as an emergent property of a complex adaptive system that sustains a food environment that increases the accessibility, availability, affordability and acceptability of unhealthy foods. In order to reshape system dynamics driving unhealthy food environments, simultaneous, diverse and innovative strategies are needed to facilitate longer-term management of household finances and socially-oriented practices around healthy food production, supply and intake. Ultimately, such strategies must be supported by a system paradigm which prioritises health

Development of a framework to guide research into policies promoting physical activity and healthy diets in the European context: The system-based Policy Evaluation Network (PEN) framework

BACKGROUND: The Policy Evaluation Network (PEN) is a multidisciplinary Pan-European research consortium focussing on policies affecting dietary intake, physical activity and sedentary behaviour. At the start, the PEN consortium expressed the need for an overarching, system-based framework covering the complexities between the different domains of the policy process (design, implementation and outcomes) in order to execute all research activities in a coherent way. This article describes the PEN framework itself and its development process. METHODS: A staged approach to the development of a system-based framework was executed between February 2019 and February 2022. We started with a point-of-departure framework, made use of existing models, collected PEN outputs at different project stages (through online meetings, e-mail exchanges and workshops with PEN researchers) and drew updated versions of the framework, which resulted in the system-based PEN framework. RESULTS: The system-based PEN framework depicts the policy process as a complex system, visualizing the dynamic interrelations between and within policy domains (i.e. policy design, policy implementation and policy outcomes), the ways they interact with the context, and how to assure a focus on equity in each domain. CONCLUSIONS: The system-based PEN framework may guide researchers and professionals involved in the evaluation of health- or sustainability-related policies to consider their evaluation in a comprehensive picture, including domain interactions, contextual influences and equity considerations, as these can have important implications for the scope of their research. The stage-based process as applied for the development of the PEN framework can serve as a template for other research projects wishing to develop their own framework

Nutrition policies in Germany: a systematic assessment with the Food Environment Policy Index

OBJECTIVE: To systematically assess Germany’s nutrition policies, to benchmark them against international best practices and to identify priority policy actions to improve population-level nutrition in Germany. DESIGN: We applied the Food Environment Policy Index (Food-EPI), a methodological framework developed by the International Network for Food and Obesity/non-communicable Diseases Research, Monitoring and Action Support (INFORMAS) network. Qualitative content analysis of laws, directives and other documents formed the basis of a multistaged, structured consultation process. SETTING: Germany. PARTICIPANTS: The expert consultation process included fifty-five experts from academia, public administration and civil society. RESULTS: Germany lags behind international best practices in several key policy areas. For eighteen policy indicators, the degree of implementation compared with international best practices was rated as very low, for twenty-one as low, for eight as intermediate and for none as high. In particular, indicators on food taxation, regulation of food marketing as well as retail and food service sector policies were rated as very low to low. Identified priority actions included the binding implementation of nutrition standards for schools and kindergartens, a reform of the value added tax on foods and beverages, a sugar-sweetened beverage tax and stricter regulation of food marketing directed at children. CONCLUSIONS: The results show that Germany makes insufficient use of the potential of evidence-informed health-promoting nutrition policies. Adopting international best practices in key policy areas could help to reduce the burden of nutrition-related chronic disease and related inequalities in nutrition and health in Germany. Implementation of relevant policies requires political leadership, a broad societal dialogue and evidence-informed advocacy by civil society, including the scientific community

Barriers and facilitators to implementation of direct fruit and vegetables provision interventions in kindergartens and schools: a qualitative systematic review applying the consolidated framework for implementation research (CFIR)

Background Although children’s intake of fruit and vegetables has seen a recent rise, almost half of adolescents do not eat even one piece of fruit or vegetables per day. One way to address this problem is through interventions that provide fruit and vegetables directly to children in kindergartens and schools. For such interventions to meet their intended goals, what is important to consider in addition to impact is implementation. Our objective is to systematically review qualitative results reporting on the determinants (barriers and facilitators) to implementation of interventions that entail direct provision of fruit and vegetables in kindergarten and school settings and conduct a framework analysis of those results using the Consolidated Framework for Implementation Research (CFIR). Methods A systematic search was designed and run in November 2019 for: MEDLINE (Ovid), Embase (Ovid), PsychINFO (Ovid), ERIC (Ovid), Cochrane Library Reviews and Cochrane Library Trials. A keyword search of the journal Implementation Science was completed. Screening of titles and abstracts (n = 5427) and full texts (n = 227), led to 14 included articles. Coding and analysis were done using the framework method and CFIR. Results The following CFIR constructs were found relevant: 1) intervention characteristics domain: ‘design quality and packaging’, ‘adaptability’ ‘cost’; 2) outer setting: ‘cosmopolitanism’, ‘external policy and incentives’ ‘patients’ needs and resources’; 3) inner setting: ‘implementation climate’, ‘readiness for implementation’ and ‘structural characteristics’; 4) characteristics of individuals: ‘individual stage of change’, ‘knowledge and beliefs about the intervention’ 5) process: ‘engaging’, ‘executing’ and ‘reflecting and evaluating’. The review stresses the dual role of parents as both supporting the implementation and targets of the intervention, which could have implications for the design and implementation of future fruit and vegetables interventions. Positive child perceptions of the value of the intervention and perceived behavior change due to the intervention were reported as relevant facilitators to implementation across several studies, and should be taken into consideration in future design efforts. Conclusions CFIR offers a systematic way to identify and organize barriers and facilitators to implementation of interventions in the kindergarten and school setting. Revisions are encouraged to allow adequate space for perceptions of various implementation actors and the target group. PROSPERO registration CRD42020167697

Vitamin D food fortification in European countries: The underused potential to prevent cancer deaths

BACKGROUND: Meta-analyses of randomized controlled trials have shown that vitamin D supplementation reduces cancer mortality by 13%. Vitamin D fortification of foods may increase vitamin D levels in a similar manner as vitamin D supplementation and could achieve similar reductions in cancer mortality. Whereas some European countries already implemented widespread fortification of foods with vitamin D, in other countries only few or no foods are fortified. In this study, we estimated the reduction in cancer mortality presumably already achieved by current fortification policies in 2017 and the potential for further reductions if all countries had effective fortification. METHODS: We reviewed scientific literature, publicly available information, and contacted health authorities to obtain information on current vitamin D food fortification policies in 34 European countries. Together with country-specific cancer death statistics from Eurostat, information on life expectancy, and country-specific fortification policies, we used data from studies on supplementation and serum 25(OH)D increases and cancer mortality to estimate numbers of probably already prevented cancer deaths and numbers of potentially further preventable deaths and years of life lost. RESULTS: Current vitamin D fortification is estimated to prevent approximately 11,000 in the European Union and 27,000 cancer deaths in all European countries considered per year. If all countries considered here would implement adequate vitamin D fortification of foods, an estimated additional 129,000 cancer deaths (113,000 in the European Union) could be prevented, corresponding to almost 1.2 million prevented years of life lost (1.0 million in the EU) or approximately 9% of cancer deaths (10% in the EU). INTERPRETATION: Systematic fortification of foods might considerably reduce the burden of cancer deaths in Europe