Monitoring and Evaluation of National Vaccination Implementation: A Scoping Review of How Frameworks and Indicators Are Used in the Public Health Literature.

An effective Monitoring and Evaluation (M&E) framework helps vaccination programme managers determine progress and effectiveness for agreed indicators against clear benchmarks and targets. We aimed to identify the literature on M&E frameworks and indicators used in national vaccination programmes and synthesise approaches and lessons to inform development of future frameworks. We conducted a scoping review using Arksey and O'Malley's six-stage framework to identify and synthesise sources on monitoring or evaluation of national vaccination implementation that described a framework or indicators. The findings were summarised thematically. We included 43 eligible sources of 4291 screened. Most (95%) were in English and discussed high-income (51%) or middle-income (30%) settings, with 13 in Europe (30%), 10 in Asia-Pacific (23%), nine in Africa (21%), and eight in the Americas (19%), respectively, while three crossed regions. Only five (12%) specified the use of an M&E framework. Most (32/43; 74%) explicitly or implicitly included vaccine coverage indicators, followed by 12 including operational (28%), five including clinical (12%), and two including cost indicators (5%). The use of M&E frameworks was seldom explicit or clearly defined in our sources, with indicators rarely fully defined or benchmarked against targets. Sources focused on ways to improve vaccination programmes without explicitly considering ways to improve assessment. Literature on M&E framework and indicator use in national vaccination programmes is limited and focused on routine childhood vaccination. Therefore, documentation of more experiences and lessons is needed to better inform vaccination M&E beyond childhood

Effects of COVID-19 on sexual and reproductive health services access in the Asia-Pacific region: a qualitative study of expert and policymaker perspectives

10.1080/26410397.2023.2247237Sexual and Reproductive Health Matters31

Health system evaluation in conflict-affected countries: a scoping review of approaches and methods

Abstract Introduction Strengthening health systems in conflict-affected settings has become increasingly professionalised. However, evaluation remains challenging and often insufficiently documented in the literature. Many, particularly small-scale health system evaluations, are conducted by government bodies or non-governmental organisations (NGO) with limited capacity to publish their experiences. It is essential to identify the existing literature and main findings as a baseline for future efforts to evaluate the capacity and resilience of conflict-affected health systems. We thus aimed to synthesise the scope of methodological approaches and methods used in the peer-reviewed literature on health system evaluation in conflict-affected settings. Methods We conducted a scoping review using Arksey and O’Malley’s method and synthesised findings using the WHO health system ‘building blocks’ framework. Results We included 58 eligible sources of 2,355 screened, which included examination of health systems or components in 26 conflict-affected countries, primarily South Sudan and Afghanistan (7 sources each), Democratic Republic of the Congo (6), and Palestine (5). Most sources (86%) were led by foreign academic institutes and international donors and focused on health services delivery (78%), with qualitative designs predominating (53%). Theoretical or conceptual grounding was extremely limited and study designs were not generally complex, as many sources (43%) were NGO project evaluations for international donors and relied on simple and lower-cost methods. Sources were also limited in terms of geography (e.g., limited coverage of the Americas region), by component (e.g., preferences for specific components such as service delivery), gendered (e.g., limited participation of women), and colonised (e.g., limited authorship and research leadership from affected countries). Conclusion The evaluation literature in conflict-affected settings remains limited in scope and content, favouring simplified study designs and methods, and including those components and projects implemented or funded internationally. Many identified challenges and limitations (e.g., limited innovation/contextualisation, poor engagement with local actors, gender and language biases) could be mitigated with more rigorous and systematic evaluation approaches

Community engagement in health systems interventions and research in conflict-affected countries: a scoping review of approaches.

BACKGROUND: Healthcare research, planning, and delivery with minimal community engagement can result in financial wastage, failure to meet objectives, and frustration in the communities that programmes are designed to help. Engaging communities - individual service-users and user groups - in the planning, delivery, and assessment of healthcare initiatives from inception promotes transparency, accountability, and 'ownership'. Health systems affected by conflict must try to ensure that interventions engage communities and do not exacerbate existing problems. Engaging communities in interventions and research on conflict-affected health systems is essential to begin addressing effects on service delivery and access. OBJECTIVE: This review aimed to identify and interrogate the literature on community engagement in health system interventions and research in conflict-affected settings. METHODS: We conducted a scoping review using Arksey & O'Malley's framework, synthesising the data descriptively. RESULTS: We included 19 of 2,355 potential sources identified. Each discussed at least one aspect of community engagement, predominantly participatory methods, in 12 conflict-affected countries. Major lessons included the importance of engaging community and religious leaders, as well as people of lower socioeconomic status, in both designing and delivering culturally acceptable healthcare; mobilising community members and involving them in programme delivery to increase acceptability; mediating between governments, armed groups and other organisations to increase the ability of healthcare providers to remain in post; giving community members spaces for feedback on healthcare provision, to provide communities with evidence that programmes and initiatives are working. CONCLUSION: Community engagement in identifying and setting priorities, decision-making, implementing, and evaluating potential solutions helps people share their views and encourages a sense of ownership and increases the likely success of healthcare interventions. However, engaging communities can be particularly difficult in conflict-affected settings, where priorities may not be easy to identify, and many other factors, such as safety, power relations, and entrenched inequalities, must be considered