When assessing generalisability, focusing on differences in population or setting alone is insufficient.

Generalisability is typically only briefly mentioned in discussion sections of evaluation articles, which are unhelpful in judging whether an intervention could be implemented elsewhere, with similar effects. Several tools to assess generalisability exist, but they are difficult to operationalise and are rarely used. We believe a different approach is needed. Instead of focusing on similarities (or more likely, differences) in generic population and setting characteristics, generalisability assessments should focus on understanding an intervention's mechanism of action - why or how an intervention was effective. We believe changes are needed to four types of research. First, outcome evaluations should draw on programme theory. Second, process evaluations should aim to understand interventions' mechanism of action, rather than simply 'what happened'. Third, small scoping studies should be conducted in new settings, to explore how to enact identified mechanisms. Finally, innovative synthesis methods are required, in order to identify mechanisms of action where there is a lack of existing process evaluations

Lifestyle weight management programmes for children: A systematic review using Qualitative Comparative Analysis to identify critical pathways to effectiveness.

This study aimed to identify critical features of successful lifestyle weight management interventions for overweight children (0-11years). Eleven qualitative UK-based studies examining children's, parents' and providers' perspectives and experiences of programmes were synthesised to identify components felt to be critical. Studies for this views synthesis were identified from existing reviews and an update of one review's search, which was run in December 2015. The identified components were then explored in a synthesis of intervention evaluations (five 'most effective' and 15 'least effective') conducted in western Europe, North America, Australia or New Zealand. The intervention evaluations were identified from existing reviews and an update of one review's search, which was run in March 2016. This evaluation synthesis was carried out using Qualitative Comparative Analysis. Three important mechanisms were present in all the most effective interventions but absent in all the least effective: 1/ showing families how to change: a) providing child physical activity sessions, b) delivering practical behaviour change strategy sessions, c) providing calorie intake advice; 2/ ensuring all the family are on board: a) delivering discussion/education sessions for both children and parents, b) delivering child-friendly sessions, c) aiming to change behaviours across the whole family; 3/ enabling social support for both parents and children by delivering both child group sessions and parent group sessions. To conclude, programmes should ensure the whole family is on board the programme, that parents and children can receive social support and are not just told what to change, but shown how

Weight management programmes: Re-analysis of a systematic review to identify pathways to effectiveness.

BACKGROUND: Previous systematic reviews of weight management programmes (WMPs) have not been able to account for heterogeneity of effectiveness within programmes using top-down behavioural change taxonomies. This could be due to overlapping causal pathways to effectiveness (or lack of effectiveness) in these complex interventions. Qualitative comparative analysis (QCA) can help identify these overlapping pathways. METHODS: Using trials of adult WMPs with dietary and physical activity components identified from a previous systematic review, we selected the 10 most and 10 least effective interventions by amount of weight loss at 12 months compared to minimal treatment. Using intervention components suggested by synthesis of studies of programme user views, we labelled interventions as to the presence of these components and, using qualitative comparative analysis, developed pathways of component combinations that created the conditions sufficient for interventions to be most effective and least effective. RESULTS: Informed by the synthesis of views studies, we constructed 3 truth tables relating to quality of the user-provider relationship; perceived high need for guidance from providers; and quality of the relationship between peers in weight management programmes. We found effective interventions were characterized by opportunities to develop supportive relationships with providers or peers, directive provider-led goal setting and components perceived to foster self-regulation. CONCLUSIONS: Although QCA is an inductive method, this innovative approach has enabled the identification of potentially critical aspects of WMPs, such as the nature of relationships within them, which were previously not considered to be as important as more concrete content such as dietary focus

The importance of service-users' perspectives: A systematic review of qualitative evidence reveals overlooked critical features of weight management programmes.

BACKGROUND: Extensive research effort shows that weight management programmes (WMPs) targeting both diet and exercise are broadly effective. However, the critical features of WMPs remain unclear. OBJECTIVE: To develop a deeper understanding of WMPs critical features, we undertook a systematic review of qualitative evidence. We sought to understand from a service-user perspective how programmes are experienced, and may be effective, on the ground. SEARCH STRATEGY: We identified qualitative studies from existing reviews and updated the searches of one review. INCLUSION CRITERIA: We included UK studies capturing the views of adult WMP users. DATA EXTRACTION AND SYNTHESIS: Thematic analysis was used inductively to code and synthesize the evidence. MAIN RESULTS: Service users were emphatic that supportive relationships, with service providers or WMP peers, are the most critical aspect of WMPs. Supportive relationships were described as providing an extrinsic motivator or "hook" which helped to overcome barriers such as scepticism about dietary advice or a lack confidence to engage in physical activity. DISCUSSION AND CONCLUSIONS: The evidence revealed that service-users' understandings of the critical features of WMPs differ from the focus of health promotion guidance or descriptions of evaluated programmes which largely emphasize educational or goal setting aspects of WMPs. Existing programme guidance may not therefore fully address the needs of service users. The study illustrates that the perspectives of service users can reveal unanticipated intervention mechanisms or underemphasized critical features and underscores the value of a holistic understanding about "what happens" in complex psychosocial interventions such as WMPs

Assessing the capacity of primary health care facilities in Nigeria to deliver eye health promotion: Results of a mixed-methods feasibility study.

Over 25 million people in sub-Saharan Africa are blind or visually impaired, the majority from avoidable causes. Health promotion and disease prevention are important strategies for eye health, through good governance, health literacy and increasing access to eye care services. To increase equity in access for eyecare services, the World Health Organization Africa Region developed a package of interventions for primary eye care, which includes health promotion. The aim of this study was to assess the capacity of the primary healthcare system to deliver health promotion for eye care in Nigeria. Mixed methods were used during a survey of 48 government-owned primary health care facilities in Anambra state, Nigeria: interviews with district health supervisors, facility staff and village health workers, and a desk review of policy documents for primary health care and eye care in Nigeria. Findings were benchmarked against the capacities needed to deliver health promotion agreed through a Delphi exercise and were analysed using the World Health Organization’s health system building blocks. Eye health promotion policies exist but are fragmented across different national health policies. Health promotion activities focussed on “mobilising” community members to access care provided in facilities, particularly for women of childbearing age and young children, and health education was limited. Only one in ten facilities engaged the elderly and a fifth delivered health promotion for eye care. Health promotion activities were supervised in 43.2% of facilities and transport to remote areas was limited. A robust eye health promotion strategy needs to be included in the National Eye Health Policy. The scope of existing health promotion will need to expand to include eye conditions and different age groups. Increasing eye health literacy should be emphasized. Governance, training health workers in eye health promotion, educational materials, and transport to visit communities will also be needed

A bibliometric analysis of systematic reviews on vaccines and immunisation.

INTRODUCTION: SYSVAC is an online bibliographic database of systematic reviews and systematic review protocols on vaccines and immunisation compiled by the London School of Hygiene & Tropical Medicine and hosted by the World Health Organization (WHO) through their National Immunization Technical Advisory Groups (NITAG) resource centre (www.nitag-resource.org). Here the development of the database and a bibliometric review of its content is presented, describing trends in the publication of policy-relevant systematic reviews on vaccines and immunisation from 2008 to 2016. MATERIALS AND METHODS: Searches were conducted in seven scientific databases according to a standardized search protocol, initially in 2014 with the most recent update in January 2017. Abstracts and titles were screened according to specific inclusion criteria. All included publications were coded into relevant categories based on a standardized protocol and subsequently analysed to look at trends in time, topic, area of focus, population and geographic location. RESULTS: After screening for inclusion criteria, 1285 systematic reviews were included in the database. While in 2008 there were only 34 systematic reviews on a vaccine-related topic, this increased to 322 in 2016. The most frequent pathogens/diseases studied were influenza, human papillomavirus and pneumococcus. There were several areas of duplication and overlap. DISCUSSION: As more systematic reviews are published it becomes increasingly time-consuming for decision-makers to identify relevant information among the ever-increasing volume available. The risk of duplication also increases, particularly given the current lack of coordination of systematic reviews on vaccine-related questions, both in terms of their commissioning and their execution. The SYSVAC database offers an accessible catalogue of vaccine-relevant systematic reviews with, where possible access or a link to the full-text. CONCLUSIONS: SYSVAC provides a freely searchable platform to identify existing vaccine-policy-relevant systematic reviews. Systematic reviews will need to be assessed adequately for each specific question and quality

Human resource and governance challenges in the delivery of primary eye care: a mixed methods feasibility study in Nigeria.

BACKGROUND: To increase access to eye care, the World Health Organization's Africa Region recently launched a primary eye care (PEC) package for sub-Saharan Africa. To determine the technical feasibility of implementing this package, the capacity of health systems at primary level needs to be assessed, to identify capacity gaps that would need to be addressed to deliver effective and sustainable PEC. This study reports on the human resource and governance challenges for delivering PEC in Anambra State, Nigeria. METHODS: Design: This was a mixed methods feasibility study. A desk review of relevant Nigerian national health policy documents on both eye health and primary health care was conducted, and 48 primary health care facilities in Anambra state were surveyed. Data on human resource and governance in primary health facilities were collected using structured questionnaires and through observation with checklists. In-depth interviews were conducted with district supervisors and selected heads of facilities to explore the opportunities and challenges for the delivery of PEC in their facilities/districts. Data were analysed using the World Health Organization's health system framework. RESULTS: A clear policy for PEC is lacking. Supervision was conducted at least quarterly in 54% of facilities and 56% of facilities did not use the standard clinical management guidelines. There were critical shortages of health workers with 82% of facilities working with less than 20% of the number recommended. Many facilities used volunteers and/or ad hoc workers to mitigate staff shortages. CONCLUSION: Our study highlights the policy, governance and health workforce gaps that will need to be addressed to deliver PEC in Nigeria. Developing and implementing a specific policy for PEC is recommended. Implementation of existing national health policies may help address health workforce shortages at the primary health care level

Primary health care facility readiness to implement primary eye care in Nigeria: equipment, infrastructure, service delivery and health management information systems.

BACKGROUND: Over two-thirds of Africans have no access to eye care services. To increase access, the World Health Organization (WHO) recommends integrating eye care into primary health care, and the WHO Africa region recently developed a package for primary eye care. However, there are limited data on the capacities needed for delivery, to guide policymakers and implementers on the feasibility of integration. The overall purpose of this study was to assess the technical capacity of the health system at primary level to deliver the WHO primary eye care package. Findings with respect to service delivery, equipment and health management information systems (HMIS) are presented in this paper. METHODS: This was a mixed-methods, cross sectional feasibility study in Anambra State, Nigeria. Methods included a desk review of relevant Nigerian policies; a survey of 48 primary health facilities in six districts randomly selected using two stage sampling, and semi-structured interviews with six supervisors and nine purposively selected facility heads. Quantitative study tools included observational checklists and questionnaires. Survey data were analysed descriptively using STATA V.15.1 (Statcorp, Texas). Differences between health centres and health posts were analysed using the z-test statistic. Interview data were analysed using thematic analysis assisted by Open Code Software V.4.02. RESULTS: There are enabling national health policies for eye care, but no policy specifically for primary eye care. 85% of facilities had no medication for eye conditions and one in eight had no vitamin A in stock. Eyecare was available in < 10% of the facilities. The services delivered focussed on maternal and child health, with low attendance by adults aged over 50 years with over 50% of facilities reporting ≤10 attendances per year per 1000 catchment population. No facility reported data on patients with eye conditions in their patient registers. CONCLUSION: A policy for primary eye care is needed which aligns with existing eye health policies. There are currently substantial capacity gaps in service delivery, equipment and data management which will need to be addressed if eye care is to be successfully integrated into primary care in Nigeria

Can cash transfer interventions increase contraceptive use and reduce adolescent birth and pregnancy in low and middle income countries? A systematic review and meta-analysis

Becoming pregnant and giving birth under the age of 20 is associated with a range of adverse social, socioeconomic and health outcomes for adolescent girls and their children in Low and middle income countries. Cash transfers are an example of a structural intervention that can change the local social and economic environment, and have been linked with positive health and social outcomes across several domains. As part of a wider review of structural adolescent contraception interventions, we conducted a systematic review on the impact of cash transfers on adolescent contraception and fertility. Fifteen studies were included in the review with eleven studies providing evidence for meta-analyses on contraception use, pregnancy and childbearing. The evidence suggests that cash transfer interventions are generally ineffective in raising levels of contraceptive use. However, cash transfer interventions did reduce levels of early pregnancy (OR 0.90, 95% CI 0.81 to 1.00). There was suggestive evidence that conditional, but not unconditional, cash transfers reduce levels of early childbearing. Given that much of the evidence is drawn from interventions providing cash transfers conditional on school attendance, supporting school attendance may enable adolescent girls and young women to make life choices that do not involve early pregnancy

HPV vaccine introduction in Rwanda: Impacts on the broader health system.

OBJECTIVES: Rwanda was the first country in Africa to introduce the human papillomavirus (HPV) vaccine. This was achieved through multi-year school-based campaigns. Our study evaluated the impact of the HPV vaccine introduction on the country's immunisation programme and health system. METHODS: Thirty key informants were interviewed at national and district levels, and in participating schools. Twenty-seven health facilities completed a questionnaire exploring the effects of the new vaccine introduction on six health system building blocks, as defined by the World Health Organization. Routine service activity data were collected during a 90-day period around the introduction. RESULTS: Routine vaccination activities were not disrupted during the delivery, likely due to a strong Expanded Program on Immunization, appropriate planning and a well-resourced operation. Opportunities were seized to co-deliver other interventions targeted at children and adolescents, such as health promotion. Collaboration with the Ministry of Education was strengthened at national level. Although there were some temporary increases in staff workload, no major negative effects were reported. CONCLUSION: Despite its delivery through school-based campaigns, the HPV vaccine integrated well into the immunisation programme and health system. The introduction had no major negative effects. Some opportunities were seized to expand services and collaborations