A comparative evaluation of PDQ-Evidence

BACKGROUND: A strategy for minimising the time and obstacles to accessing systematic reviews of health system evidence is to collect them in a freely available database and make them easy to find through a simple ‘Google-style’ search interface. PDQ-Evidence was developed in this way. The objective of this study was to compare PDQ-Evidence to six other databases, namely Cochrane Library, EVIPNet VHL, Google Scholar, Health Systems Evidence, PubMed and Trip. METHODS: We recruited healthcare policy-makers, managers and health researchers in low-, middle- and highincome countries. Participants selected one of six pre-determined questions. They searched for a systematic review that addressed the chosen question and one question of their own in PDQ-Evidence and in two of the other six databases which they would normally have searched. We randomly allocated participants to search PDQ-Evidence first or to search the two other databases first. The primary outcomes were whether a systematic review was found and the time taken to find it. Secondary outcomes were perceived ease of use and perceived time spent searching. We asked open-ended questions about PDQ-Evidence, including likes, dislikes, challenges and suggestions for improvements. RESULTS: A total of 89 people from 21 countries completed the study; 83 were included in the primary analyses and 6 were excluded because of data errors that could not be corrected. Most participants chose PubMed and Cochrane Library as the other two databases. Participants were more likely to find a systematic review using PDQ-Evidence than using Cochrane Library or PubMed for the pre-defined questions. For their own questions, this difference was not found. Overall, it took slightly less time to find a systematic review using PDQ-Evidence. Participants perceived that it took less time, and most participants perceived PDQ-Evidence to be slightly easier to use than the two other databases. However, there were conflicting views about the design of PDQ-Evidence. CONCLUSIONS: PDQ-Evidence is at least as efficient as other databases for finding health system evidence. However, using PDQ-Evidence is not intuitive for some people

Worldwide use of the first set of physical activity Country Cards: The Global Observatory for Physical Activity - GoPA!

Background: The work of The Global Observatory for Physical Activity-GoPA! is the first global effort to compile standardized country-level surveillance, policy and research data for physical activity in order to better understand how countries and regions address promoting physical activity. GoPA! developed standardized country-specific physical activity profiles (“Country Cards”) to summarize country-level data through 2013. The aim of this study was to assess use of the Country Cards, identify the factors associated with their use, and develop recommendations for supporting country-level physical activity promotion. Methods: Cross sectional internet-based survey conducted between August–October 2016. Target study participants were national physical activity leaders and advocates in academia, government and practice from the GoPA! countries, and members of the International Society of Physical Activity and Health. A Country Card use composite score was created based on the diversity and frequency of use. Statistical analyses on the associations between the composite score and respondent characteristics, country characteristics, barriers and opinions were conducted (including descriptive analyses and a logistic regression with robust standard errors). Results: One hundred forty three participants from 68 countries completed the survey. Use of the Country Cards was associated with being part of the GoPA! network, knowing about the Country Cards, and on the stage of country capacity for physical activity promotion. Country Card knowledge varied by country income group, region and the country specific context. More diverse and frequent use of the cards (highest tertile of the composite score for use) was associated with: 1. Being a country contact vs general participant (OR 18.32–95% CI 5.63–59.55, p = 0.002), and 2. Collaborating with a government representative working in NCDs on a monthly or more frequent contact vs less frequent contact (OR 3.39–95% CI 1.00–11.54, P < 0.05). Conclusions: For the Country Cards to have a broader impact, GoPA! will need to widen its reach beyond the academic sector. With further refinement of the cards, and training in their implementation, they could be an important tool for advancing country capacity for contextually-relevant strategies, actions and timelines for PA promotion

Prioritisation of Clinical Research by the Example of Type 2 Diabetes: A Caregiver-Survey on Perceived Relevance and Need for Evidence

BACKGROUND: The Cochrane Collaboration aims at providing the best available evidence for interventions in health care. We wished to examine to which extent treatments considered relevant by caregivers in type 2 diabetes are covered by Cochrane systematic reviews. METHODOLOGY/PRINCIPAL FINDINGS: 130 different interventions in type 2 diabetes were identified based on a review of clinical practice guidelines and expert opinion (Table S1). 459 members of the German Diabetes Society (diabetologists, general practitioners, diabetic nurses, nutritionists, podologists, others) were surveyed via e-mail-list to rank a) the perceived clinical relevance and b) the perceived need for evidence of interventions, based on an internet survey. In the Cochrane Library, there were, at the time of this evaluation, 56 reviews on interventions in diabetes. Generally, coverage of topics by Cochrane reviews reflected the perceived clinical relevance and perceived need for evidence. As an example, highly ranked treatments such as lifestyle changes or oral antidiabetics were well covered, while low rank treatments such as complementary approaches were not covered. Discrepancies occurred with new treatments such as amylin-analogues (low relevance, high need for evidence, review not yet completed) and interventions with immediate and dramatic effects such as treating hypoglycemia (high relevance, low need for evidence, no review). Also, there was a relative scarcity of reviews concerning specific problems, in particular, treatment of late diabetic complications. CONCLUSIONS/SIGNIFICANCE: For most interventions, perceived relevance and perceived need for evidence are reflected by the evidence already available. Prioritizing should aim at improving immediacy and consideration of the treatment of complications

A systematic review of frameworks for the interrelationships of mental health evidence and policy in low- and middle-income countries

Background: The interrelationships between research evidence and policy-making are complex. Different theoretical frameworks exist to explain general evidence–policy interactions. One largely unexplored element of these interrelationships is how evidence interrelates with, and influences, policy/political agenda-setting. This review aims to identify the elements and processes of theories, frameworks and models on interrelationships of research evidence and health policy-making, with a focus on actionability and agenda-setting in the context of mental health in low- and middle-income countries (LMICs). Methods: A systematic review of theories was conducted based on the BeHeMOTh search method, using a tested and refined search strategy. Nine electronic databases and other relevant sources were searched for peer-reviewed and grey literature. Two reviewers screened the abstracts, reviewed full-text articles, extracted data and performed quality assessments. Analysis was based on a thematic analysis. The included papers had to present an actionable theoretical framework/model on evidence and policy interrelationships, such as knowledge translation or evidence-based policy, specifically target the agenda-setting process, focus on mental health, be from LMICs and published in English. Results: From 236 publications included in the full text analysis, no studies fully complied with our inclusion criteria. Widening the focus by leaving out ‘agenda-setting’, we included ten studies, four of which had unique conceptual frameworks focusing on mental health and LMICs but not agenda-setting. The four analysed frameworks confirmed research gaps from LMICs and mental health, and a lack of focus on agenda-setting. Frameworks and models from other health and policy areas provide interesting conceptual approaches and lessons with regards to agenda-setting. Conclusion: Our systematic review identified frameworks on evidence and policy interrelations that differ in their elements and processes. No framework fulfilled all inclusion criteria. Four actionable frameworks are applicable to mental health and LMICs, but none specifically target agenda-setting. We have identified agenda-setting as a research theory gap in the context of mental health knowledge translation in LMICs. Frameworks from other health/policy areas could offer lessons on agenda-setting and new approaches for creating policy impact for mental health and to tackle the translational gap in LMICs

Institutional capacity for health systems research in East and Central African schools of public health: experiences with a capacity assessment tool

BACKGROUND: Despite significant investments in health systems research (HSR) capacity development, there is a dearth of information regarding how to assess HSR capacity. An alliance of schools of public health (SPHs) in East and Central Africa developed a tool for the self-assessment of HSR capacity with the aim of producing institutional capacity development plans. METHODS: Between June and November 2011, seven SPHs across the Democratic Republic of Congo, Ethiopia, Kenya, Rwanda, Tanzania, and Uganda implemented this co-created tool. The objectives of the institutional assessments were to assess existing capacities for HSR and to develop capacity development plans to address prioritized gaps. A mixed-method approach was employed consisting of document analysis, self-assessment questionnaires, in-depth interviews, and institutional dialogues aimed at capturing individual perceptions of institutional leadership, collective HSR skills, knowledge translation, and faculty incentives to engage in HSR. Implementation strategies for the capacity assessment varied across the SPHs. This paper reports findings from semi-structured interviews with focal persons from each SPH, to reflect on the process used at each SPH to execute the institutional assessments as well as the perceived strengths and weaknesses of the assessment process. Results The assessment tool was robust enough to be utilized in its entirety across all seven SPHs resulting in a thorough HSR capacity assessment and a capacity development plan for each SPH. Successful implementation of the capacity assessment exercises depended on four factors: (i) support from senior leadership and collaborators, (ii) a common understanding of HSR, (iii) adequate human and financial resources for the exercise, and (iv) availability of data. Methods of extracting information from the results of the assessments, however, were tailored to the unique objectives of each SPH. Conclusions This institutional HSR capacity assessment tool and the process for its utilization may be valuable for any SPH. The self-assessments, as well as interviews with external stakeholders, provided diverse sources of input and galvanized interest around HSR at multiple levels.DFI

Maximising the availability and use of high quality evidence for policymaking:Collaborative, targeted and efficient evidence reviews

Abstract A number of barriers have been identified to getting evidence into policy. In particular, a lack of policy relevance and lack of timeliness have been identified as causing tension between researchers and policy makers. Rapid reviews are used increasingly as an approach to address timeliness, however, there is a lack of consensus on the most effective review methods and they do not necessarily address the need of policy makers. In the course of our work with the Scottish Government’s Review of maternity and neonatal services we developed a new approach to evidence synthesis, which this paper will describe. We developed a standardised approach to produce collaborative, targeted and efficient evidence reviews for policy making. This approach aimed to ensure the reviews were policy relevant, high quality and up-to-date, and which were presented in a consistent, transparent, and easy to access format. The approach involved the following stages: 1) establishing a review team with expertise both in the topic and in systematic reviewing, 2) clarifying the review questions with policy makers and subject experts (i.e., health professionals, service user representatives, researchers) who acted as review sponsors, 3) developing review protocols to systematically identify quantitative and qualitative review-level evidence on effectiveness, sustainability and acceptability; if review level evidence was not available, primary studies were sought, 4) agreeing a framework to structure the analysis of the reviews around a consistent set of key concepts and outcomes; in this case a published framework for maternal and newborn care was used, 5) developing an iterative process between policy makers, reviewers and review sponsors, 6) rapid searches and retrieval of literature, 7) analysis of identified literature which was mapped to the framework and included review sponsor input, 8) production of recommendations mapped to the agreed framework and presented as ‘summary topsheets’ in a consistent and easy to read format. Our approach has drawn on different components of pre-existing rapid review methodology to provide a rigorous and pragmatic approach to rapid evidence synthesis. Additionally, the use of a framework to map the evidence helped structure the review questions, expedited the analysis and provided a consistent template for recommendations, which took into account the policy context. We therefore propose that our approach (described in this paper) can be described as producing collaborative, targeted and efficient evidence reviews for policy makers

Role and use of evidence in policymaking: an analysis of case studies from the health sector in Nigeria.

Background Health policymaking is a complex process and analysing the role of evidence is still an evolving area in many low- and middle-income countries. Where evidence is used, it is greatly affected by cognitive and institutional features of the policy process. This paper examines the role of different types of evidence in health policy development in Nigeria. Methods The role of evidence was compared between three case studies representing different health policies, namely the (1) integrated maternal neonatal and child health strategy (IMNCH); (2) oral health (OH) policy; and (3) human resource for health (HRH) policy. The data was collected using document reviews and 31 in-depth interviews with key policy actors. Framework Approach was used to analyse the data, aided by NVivo 10 software. Results Most respondents perceived evidence to be factual and concrete to support a decision. Evidence was used more if it was perceived to be context-specific, accessible and timely. Low-cost high-impact evidence, such as the Lancet series, was reported to have been used in drafting the IMNCH policy. In the OH and HRH policies, informal evidence such as experts’ experiences and opinions, were reported to have been useful in the policy drafting stage. Both formal and informal evidence were mentioned in the HRH and OH policies, while the development of the IMNCH was revealed to have been informed mainly by more formal evidence. Overall, respondents suggested that formal evidence, such as survey reports and research publications, were most useful in the agenda-setting stage to identify the need for the policy and thus initiating the policy development process. International and local evidence were used to establish the need for a policy and develop policy, and less to develop policy implementation options. Conclusion Recognition of the value of different evidence types, combined with structures for generating and using evidence, are likely to enhance evidence-informed health policy development in Nigeria and other similar contexts

Guidelines for diagnosis and management of the cobalamin-related remethylation disorders cblC, cblD, cblE, cblF, cblG, cblJ and MTHFR deficiency

BACKGROUND: Remethylation defects are rare inherited disorders in which impaired remethylation of homocysteine to methionine leads to accumulation of homocysteine and perturbation of numerous methylation reactions. OBJECTIVE: To summarise clinical and biochemical characteristics of these severe disorders and to provide guidelines on diagnosis and management. DATA SOURCES: Review, evaluation and discussion of the medical literature (Medline, Cochrane databases) by a panel of experts on these rare diseases following the GRADE approach. KEY RECOMMENDATIONS: We strongly recommend measuring plasma total homocysteine in any patient presenting with the combination of neurological and/or visual and/or haematological symptoms, subacute spinal cord degeneration, atypical haemolytic uraemic syndrome or unexplained vascular thrombosis. We strongly recommend to initiate treatment with parenteral hydroxocobalamin without delay in any suspected remethylation disorder; it significantly improves survival and incidence of severe complications. We strongly recommend betaine treatment in individuals with MTHFR deficiency; it improves the outcome and prevents disease when given early