Towards systematic evaluation of epidemic responses during humanitarian crises: a scoping review of existing public health evaluation frameworks.

Epidemics continue to pose a significant public health threat to populations in low and middle-income countries. However, little is known about the appropriateness and performance of response interventions in such settings. We undertook a rapid scoping review of public health evaluation frameworks for emergency settings in order to judge their suitability for assessing epidemic response. Our search identified a large variety of frameworks. However, very few are suitable for framing the response to an epidemic, or its evaluation. We propose a generic epidemic framework that draws on elements of existing frameworks. We believe that this framework may potentially be of use in closing the gap between increasing global epidemic risk and the ability to respond effectively

Disparities in health financing allocation among infectious diseases in Ebola virus disease (EVD)-affected countries, 2005–2017

The Ebola virus disease (EVD) outbreaks impacted the population health due to over-stretched health systems and disrupted essential health services. Despite a call to achieve equal financial allocation depending on public health needs, there has been scant examination of the fair-ness of investment among infectious diseases. This study analyzes the extent to which equitable development assistance for health (DAH) has been provided in accordance with disease burden in EVD-affected countries. Estimates of disability-adjusted life years (DALYs) in the Global Burden of Disease (GBD) Study 2017 and DAH Database 1990–2019 in 2005–2017 were analyzed by disease category: vaccine-preventable diseases (VPDs), HIV/AIDS, malaria, tuberculosis, and EVD. HIV/AIDS generally recorded higher ratios of DAH per DALYs (DAH/DALYs). Malaria and tuberculosis showed different trends by country, and VPDs generally presented lower ratios. In West Africa in 2013–2016, DAH/DALYs surged in EVD and fluctuated in HIV/AIDS and malaria. Tuberculosis and VPDs consistently recorded lower ratios. To achieve the risk reduction during and after health emergencies, optimal funding allocation between diseases based on the disease burden is warranted in the pre-emergency period, along with measurement of immediate health needs of populations in real-time during an emergency

The practice of evaluating epidemic response in humanitarian and low-income settings: a systematic review.

BACKGROUND: Epidemics of infectious disease occur frequently in low-income and humanitarian settings and pose a serious threat to populations. However, relatively little is known about responses to these epidemics. Robust evaluations can generate evidence on response efforts and inform future improvements. This systematic review aimed to (i) identify epidemics reported in low-income and crisis settings, (ii) determine the frequency with which evaluations of responses to these epidemics were conducted, (iii) describe the main typologies of evaluations undertaken and (iv) identify key gaps and strengths of recent evaluation practice. METHODS: Reported epidemics were extracted from the following sources: World Health Organization Disease Outbreak News (WHO DON), UNICEF Cholera platform, Reliefweb, PROMED and Global Incidence Map. A systematic review for evaluation reports was conducted using the MEDLINE, EMBASE, Global Health, Web of Science, WPRIM, Reliefweb, PDQ Evidence and CINAHL Plus databases, complemented by grey literature searches using Google and Google Scholar. Evaluation records were quality-scored and linked to epidemics based on time and place. The time period for the review was 2010-2019. RESULTS: A total of 429 epidemics were identified, primarily in sub-Saharan Africa, the Middle East and Central Asia. A total of 15,424 potential evaluations records were screened, 699 assessed for eligibility and 132 included for narrative synthesis. Only one tenth of epidemics had a corresponding response evaluation. Overall, there was wide variability in the quality, content as well as in the disease coverage of evaluation reports. CONCLUSION: The current state of evaluations of responses to these epidemics reveals large gaps in coverage and quality and bears important implications for health equity and accountability to affected populations. The limited availability of epidemic response evaluations prevents improvements to future public health response. The diversity of emphasis and methods of available evaluations limits comparison across responses and time. In order to improve future response and save lives, there is a pressing need to develop a standardized and practical approach as well as governance arrangements to ensure the systematic conduct of epidemic response evaluations in low-income and crisis settings

Verbal autopsy to assess child mortality in a humanitarian setting.

Comment - No abstract available

Exploring the temporal patterns and crisis-related risk factors for population displacement in Somalia (2016-2018).

Introduction: Over the past 30 years, south-central Somalia, Puntland (north-east) and Somaliland (north-west) have experienced recurring drought- and conflict-related crises. By the end of 2018, the number of internally displaced persons (IDPs) in the region had reached 2.6 million; most were displaced to larger towns under government control, where humanitarian assistance was more accessible. Understanding the drivers of crisis-related displacement can provide insight into how responses can best manage and respond to displacement to prevent downstream morbidity and mortality. We aimed to explore the temporal patterns and crisis-related risk factors for population displacement in Somalia from 2016 to 2018, a period of severe drought. Methods: We conducted an ecological study of secondary panel data stratified by district and month. The study population included all people in the region from 2016 to 2018. The outcome was defined as the number of new out-migrating internally displaced persons (IDPs) per district-month. Exposure variables included armed conflict, rainfall, food insecurity and food security services. Lags at one, two and three months were generated to explore possible delayed effects. All univariate and multivariate analyses were conducted using negative binomial regression models with mixed effects incorporating the district as a random effect. Results: From 2016 to 2018, the proportion of IDPs increased from 9% to 25% in Somalia, Puntland and Somaliland. We observed strong associations between IDP out-migration rate and failed rains at a three-month lag, food insecurity at a one-month lag, and the presence of therapeutic food services with no lag. IDP out-migration rate was not associated with armed conflict intensity, and cash- and rations-based food security services. Discussion: This study identified temporal, and socially and biologically plausible associations between key crisis-related risk factors and displacement in Somalia. The findings suggest a sequence of events spanning a few months, where failed rains and consequent food insecurity likely prompted early population out-migration to larger urban centers where humanitarian services were more accessible. The presence of therapeutics-based food security services could represent a more general correlate of crisis severity and the decision to migrate

Defining, measuring and interpreting the appropriateness of humanitarian assistance

This paper presents findings from a literature review of methods that explicitly assess the appropriateness of a humanitarian response. We set out to highlight the key features and limitations of each method and introduce a definition and conceptual framework for the measurement and interpretation of the appropriateness of humanitarian responses. This review is part of a broader project to enhance the accountability of humanitarian responses through developing auditing approaches for real-time monitoring. We identified eight methods that explicitly analyse the appropriateness of a humanitarian response. The review revealed that existing methods vary considerably in their definitions of ‘appropriateness’, provide insufficient guidance on measurement, are vulnerable to interpretive bias and frequently report findings on ‘appropriateness’ in an ambiguous manner. These findings suggest that, as a matter of accountability, more structured and systematic approaches to measuring the appropriateness of humanitarian response are needed. We propose a definition and conceptual framework for the measurement and interpretation of the appropriateness of humanitarian response that seeks to address the limitations identified in the review. We provide a brief overview of the main components and features of a systematic approach and audit tool for assessing the ‘appropriateness’ of a humanitarian response. The use of this and other systematic approaches is essential for enhancing governance and accountability in humanitarian responses

Evaluating COVID-19 decision-making in a humanitarian setting: The case study of Somalia

The global COVID-19 pandemic is unprecedented in its scope and impact. While a great deal of research has been directed towards the response in high-income countries, relatively little is known about the way in which decision-makers in low-income and crisis-affected countries have contended with the epidemic. Through use of an a priori decision framework, we aimed to evaluate the process of policy and operational decision-making in relation to the COVID-19 response in Somalia, a chronically fragile country, focusing particularly on the use of information and the role of transparency. We undertook a desk review, observed a number of key decision-making fora and conducted a series of key informant and focus group discussions with a range of decision-makers including state authority, civil society, humanitarian and development actors. We found that nearly all actors struggled to make sense of the scale of the epidemic and form an appropriate response. Decisions made during the early months had a large impact on the course of the epidemic response. Decision-makers relied heavily on international norms and were constrained by a number of factors within the political environment including resource limitations, political contestation and low population adherence to response measures. Important aspects of the response suffered from a transparency deficit and would have benefitted from more inclusive decision-making. Development of decision support tools appropriate for crisis-affected settings that explicitly deal with individual and environmental decision factors could lead to more effective and timely epidemic response.</jats:p

Public health information in crisis-affected populations: a review of methods and their use for advocacy and action.

Valid and timely information about various domains of public health underpins the effectiveness of humanitarian public health interventions in crises. However, obstacles including insecurity, insufficient resources and skills for data collection and analysis, and absence of validated methods combine to hamper the quantity and quality of public health information available to humanitarian responders. This paper, the second in a Series of four papers, reviews available methods to collect public health data pertaining to different domains of health and health services in crisis settings, including population size and composition, exposure to armed attacks, sexual and gender-based violence, food security and feeding practices, nutritional status, physical and mental health outcomes, public health service availability, coverage and effectiveness, and mortality. The paper also quantifies the availability of a minimal essential set of information in large armed conflict and natural disaster crises since 2010: we show that information was available and timely only in a small minority of cases. On the basis of this observation, we propose an agenda for methodological research and steps required to improve on the current use of available methods. This proposition includes setting up a dedicated interagency service for public health information and epidemiology in crises

A method for small-area estimation of population mortality in settings affected by crises.

BACKGROUND: Populations affected by crises (armed conflict, food insecurity, natural disasters) are poorly covered by demographic surveillance. As such, crisis-wide estimation of population mortality is extremely challenging, resulting in a lack of evidence to inform humanitarian response and conflict resolution. METHODS: We describe here a 'small-area estimation' method to circumvent these data gaps and quantify both total and excess (i.e. crisis-attributable) death rates and tolls, both overall and for granular geographic (e.g. district) and time (e.g. month) strata. The method is based on analysis of data previously collected by national and humanitarian actors, including ground survey observations of mortality, displacement-adjusted population denominators and datasets of variables that may predict the death rate. We describe the six sequential steps required for the method's implementation and illustrate its recent application in Somalia, South Sudan and northeast Nigeria, based on a generic set of analysis scripts. RESULTS: Descriptive analysis of ground survey data reveals informative patterns, e.g. concerning the contribution of injuries to overall mortality, or household net migration. Despite some data sparsity, for each crisis that we have applied the method to thus far, available predictor data allow the specification of reasonably predictive mixed effects models of crude and under 5 years death rate, validated using cross-validation. Assumptions about values of the predictors in the absence of a crisis provide counterfactual and excess mortality estimates. CONCLUSIONS: The method enables retrospective estimation of crisis-attributable mortality with considerable geographic and period stratification, and can therefore contribute to better understanding and historical memorialisation of the public health effects of crises. We discuss key limitations and areas for further development

Auditing the quality of epidemic decision-making in Somalia: a pilot evaluation

OBJECTIVE: To assess decision-making quality through piloting an audit tool among decision-makers responding to the COVID-19 epidemic in Somalia. DESIGN AND SETTING: We utilised a mixed-methods programme evaluation design comprising quantitative and qualitative methods. Decision-makers in Somalia piloted the audit tool generating a scorecard for decision-making in epidemic response. They also participated in key informant interviews discussing their experience with the audit process and results. PARTICIPANTS: A total of 18 decision-makers from two humanitarian agencies responding to COVID-19 in Somalia were recruited to pilot the audit tool. OUTCOME MEASURES AND ANALYSIS: We used thematic analysis to assess the feasibility and perceived utility of the audit tool by intended users (decision-makers). We also calculated Fleiss' Kappa to assess inter-rater agreement in the audit scorecard. RESULTS: The audit highlighted areas of improvement in decision-making among both organisations including in the dimensions of accountability and transparency. Despite the audit occurring in a highly complex operating environment, decision-makers found the process to be feasible and of high utility. The flexibility of the audit approach allowed for organisations to adapt the audit to their needs. As a result, organisation reported a high level of acceptance of the findings. CONCLUSION: Strengthening decision-making processes is key to realising the objectives of epidemic response. This pilot evaluation contributes towards this goal by the testing what, to our knowledge, may be the first tool designed specifically to assess quality of decision-making processes in epidemic response. The tool has proven feasible and acceptable in assessing decision-making quality in an ongoing response and has potential applicability in assessing decision-making in broader humanitarian response