What are the benefits and risks of using return on investment to defend public health programs?

Return on investment (ROI) is an economic measure used to indicate how much economic benefit is derived from a program in relation to its costs. Interest in the use of ROI in public health has grown substantially over recent years. Given its potential influence on resource allocation, it is crucial to understand the benefits and the risks of using ROI to defend public health programs. In this paper, we explore those benefits and risks. We present two recent examples of ROI use in public health in the United States and Canada and conclude with a series of proposals to minimize the risks associated with using ROI to defend public health interventions

Lost in Translation: Piloting a Novel Framework to Assess the Challenges in Translating Scientific Uncertainty From Empirical Findings to WHO Policy Statements.

BACKGROUND:Calls for evidence-informed public health policy, with implicit promises of greater program effectiveness, have intensified recently. The methods to produce such policies are not self-evident, requiring a conciliation of values and norms between policy-makers and evidence producers. In particular, the translation of uncertainty from empirical research findings, particularly issues of statistical variability and generalizability, is a persistent challenge because of the incremental nature of research and the iterative cycle of advancing knowledge and implementation. This paper aims to assess how the concept of uncertainty is considered and acknowledged in World Health Organization (WHO) policy recommendations and guidelines. METHODS:We selected four WHO policy statements published between 2008-2013 regarding maternal and child nutrient supplementation, infant feeding, heat action plans, and malaria control to represent topics with a spectrum of available evidence bases. Each of these four statements was analyzed using a novel framework to assess the treatment of statistical variability and generalizability. RESULTS:WHO currently provides substantial guidance on addressing statistical variability through GRADE (Grading of Recommendations Assessment, Development, and Evaluation) ratings for precision and consistency in their guideline documents. Accordingly, our analysis showed that policy-informing questions were addressed by systematic reviews and representations of statistical variability (eg, with numeric confidence intervals). In contrast, the presentation of contextual or "background" evidence regarding etiology or disease burden showed little consideration for this variability. Moreover, generalizability or "indirectness" was uniformly neglected, with little explicit consideration of study settings or subgroups. CONCLUSION:In this paper, we found that non-uniform treatment of statistical variability and generalizability factors that may contribute to uncertainty regarding recommendations were neglected, including the state of evidence informing background questions (prevalence, mechanisms, or burden or distributions of health problems) and little assessment of generalizability, alternate interventions, and additional outcomes not captured by systematic review. These other factors often form a basis for providing policy recommendations, particularly in the absence of a strong evidence base for intervention effects. Consequently, they should also be subject to stringent and systematic evaluation criteria. We suggest that more effort is needed to systematically acknowledge (1) when evidence is missing, conflicting, or equivocal, (2) what normative considerations were also employed, and (3) how additional evidence may be accrued

Heterogeneity in the Relationship between Disinfection By-Products in Drinking Water and Cancer: A Systematic Review.

The epidemiological evidence demonstrating the effect of disinfection by-products (DBPs) from drinking water on colon and rectal cancers is well documented. However, no systematic assessment has been conducted to assess the potential effect measure modification (EMM) in the relationship between DBPs and cancer. The objective of this paper is to conduct a systematic literature review to determine the extent to which EMM has been assessed in the relationship between DBPs in drinking water in past epidemiological studies. Selected articles (n = 19) were reviewed, and effect estimates and covariates that could have been used in an EMM assessment were gathered. Approximately half of the studies assess EMM (n = 10), but the majority of studies only estimate it relative to sex subgroups (n = 6 for bladder cancer and n = 2 both for rectal and colon cancers). Although EMM is rarely assessed, several variables that could have a potential modification effect are routinely collected in these studies, such as socioeconomic status or age. The role of environmental exposures through drinking water can play an important role and contribute to cancer disparities. We encourage a systematic use of subgroup analysis to understand which populations or territories are more vulnerable to the health impacts of DBPs

A Difference-in-Differences Approach to Assess the Effect of a Heat Action Plan on Heat-Related Mortality, and Differences in Effectiveness According to Sex, Age, and Socioeconomic Status (Montreal, Quebec).

BackgroundThe impact of heat waves on mortality and health inequalities is well documented. Very few studies have assessed the effectiveness of heat action plans (HAPs) on health, and none has used quasi-experimental methods to estimate causal effects of such programs.ObjectivesWe developed a quasi-experimental method to estimate the causal effects associated with HAPs that allows the identification of heterogeneity across subpopulations, and to apply this method specifically to the case of the Montreal (Quebec, Canada) HAP.MethodsA difference-in-differences approach was undertaken using Montreal death registry data for the summers of 2000-2007 to assess the effectiveness of the Montreal HAP, implemented in 2004, on mortality. To study equity in the effect of HAP implementation, we assessed whether the program effects were heterogeneous across sex (male vs. female), age (≥ 65 years vs. < 65 years), and neighborhood education levels (first vs. third tertile). We conducted sensitivity analyses to assess the validity of the estimated causal effect of the HAP program.ResultsWe found evidence that the HAP contributed to reducing mortality on hot days, and that the mortality reduction attributable to the program was greater for elderly people and people living in low-education neighborhoods.ConclusionThese findings show promise for programs aimed at reducing the impact of extreme temperatures and health inequities. We propose a new quasi-experimental approach that can be easily applied to evaluate the impact of any program or intervention triggered when daily thresholds are reached. Citation: Benmarhnia T, Bailey Z, Kaiser D, Auger N, King N, Kaufman J. 2016. A difference-in-differences approach to assess the effect of a heat action plan on heat-related mortality, and differences in effectiveness according to sex, age, and socioeconomic status (Montreal, Quebec). Environ Health Perspect 124:1694-1699; http://dx.doi.org/10.1289/EHP203

The Use of a Quasi-Experimental Study on the Mortality Effect of a Heat Wave Warning System in Korea.

Many cities and countries have implemented heat wave warning systems to combat the health effects of extreme heat. Little is known about whether these systems actually reduce heat-related morbidity and mortality. We examined the effectiveness of heat wave alerts and health plans in reducing the mortality risk of heat waves in Korea by utilizing the discrepancy between the alerts and the monitored temperature. A difference-in-differences analysis combined with propensity score weighting was used. Mortality, weather monitoring, and heat wave alert announcement data were collected for 7 major cities during 2009-2014. Results showed evidence of risk reduction among people aged 19-64 without education (-0.144 deaths/1,000,000 people, 95% CI: -0.227, -0.061) and children aged 0-19 (-0.555 deaths/1,000,000 people, 95% CI: -0.993, -0.117). Decreased cardiovascular and respiratory mortality was found in several subgroups including single persons, widowed people, blue-collar workers, people with no education or the highest level of education (university or higher). No evidence was found for decreased all-cause mortality in the population (1.687 deaths/1,000,000 people per day; 95% CI: 1.118, 2.255). In conclusion, heat wave alerts may reduce mortality for several causes and subpopulations of age and socio-economic status. Further work needs to examine the pathways through which the alerts impact subpopulations differently

Vulnerability to Heat-related Mortality: A Systematic Review, Meta-analysis, and Meta-regression Analysis

International audienceBACKGROUND: Addressing vulnerability to heat-related mortality is a necessary step in the development of policies dictated by heat action plans. We aimed to provide a systematic assessment of the epidemiologic evidence regarding vulnerability to heat-related mortality. METHODS: Studies assessing the association between high ambient temperature or heat waves and mortality among different subgroups and published between January 1980 and August 2014 were selected. Estimates of association for all the included subgroups were extracted. We assessed the presence of heterogeneous effects between subgroups conducting Cochran Q tests. We conducted random effect meta-analyses of ratios of relative risks (RRR) for high ambient temperature studies. We performed random effects meta-regression analyses to investigate factors associated with the magnitude of the RRR. RESULTS: Sixty-one studies were included. Using the Cochran Q test, we consistently found evidence of vulnerability for the elderly ages \textgreater85 years. We found a pooled RRR of 0.99 (95% confidence interval [CI] = 0.97, 1.01) for male sex, 1.02 (95% CI = 1.01, 1.03) for age \textgreater65 years, 1.04 (95% CI = 1.02, 1.07) for age \textgreater75 years, 1.03 (95% CI = 1.01, 1.05) for low individual socioeconomic status (SES), and 1.01 (95% CI = 0.99, 1.02) for low ecologic SES. CONCLUSIONS: We found strongest evidence of heat-related vulnerability for the elderly ages \textgreater65 and \textgreater75 years and low SES groups (at the individual level). Studies are needed to clarify if other subgroups (e.g., children, people living alone) are also vulnerable to heat to inform public health program

Advancing our Understanding of Heat Wave Criteria and Associated Health Impacts to Improve Heat Wave Alerts in Developing Country Settings.

Health effects of heat waves with high baseline temperatures in areas such as India remain a critical research gap. In these regions, extreme temperatures may affect the underlying population's adaptive capacity; heat wave alerts should be optimized to avoid continuous high alert status and enhance constrained resources, especially under a changing climate. Data from registrars and meteorological departments were collected for four communities in Northwestern India. Propensity Score Matching (PSM) was used to obtain the relative risk of mortality and number of attributable deaths (i.e., absolute risk which incorporates the number of heat wave days) under a variety of heat wave definitions (n = 13) incorporating duration and intensity. Heat waves' timing in season was also assessed for potential effect modification. Relative risk of heat waves (risk of mortality comparing heat wave days to matched non-heat wave days) varied by heat wave definition and ranged from 1.28 [95% Confidence Interval: 1.11-1.46] in Churu (utilizing the 95th percentile of temperature for at least two consecutive days) to 1.03 [95% CI: 0.87-1.23] in Idar and Himmatnagar (utilizing the 95th percentile of temperature for at least four consecutive days). The data trended towards a higher risk for heat waves later in the season. Some heat wave definitions displayed similar attributable mortalities despite differences in the number of identified heat wave days. These findings provide opportunities to assess the "efficiency" (or number of days versus potential attributable health impacts) associated with alternative heat wave definitions. Findings on both effect modification and trade-offs between number of days identified as "heat wave" versus health effects provide tools for policy makers to determine the most important criteria for defining thresholds to trigger heat wave alerts

Mapping socioeconomic inequalities in malaria in Sub-Sahara African countries

Despite reductions in malaria incidence and mortality across Sub-Saharan (SSA) countries, malaria control and elimination efforts are currently facing multiple global challenges such as climate and land use change, invasive vectors, and disruptions in healthcare delivery. Although relationships between malaria risks and socioeconomic factors have been widely demonstrated, the strengths and variability of these associations have not been quantified across SSA. In this study, we used data from population-based malaria indicator surveys in SSA countries to assess spatial trends in relative and absolute socioeconomic inequalities, analyzed as social (mothers’ highest educational level—MHEL) and economic (wealth index—WI) inequalities in malaria prevalence. To capture spatial variations in socioeconomic (represented by both WI and MHEL) inequalities in malaria, we calculated both the Slope Index of Inequality (SII) and Relative Index of Inequality (RII) in each administrative region. We also conducted cluster analyses based on Local Indicator of Spatial Association (LISA) to consider the spatial auto-correlation in SII and RII across regions and countries. A total of 47,404 participants in 1874 Primary Sampling Units (PSU) were analyzed across the 13 SSA countries. Our multi-country assessment provides estimations of strong socioeconomic inequalities between and within SSA countries. Such within- and between- countries inequalities varied greatly according to the socioeconomic metric and the scale used. Countries located in Eastern Africa showed a higher median Slope Index of Inequality (SII) and Relative Index of Inequality (RII) in malaria prevalence relative to WI in comparison to countries in other locations across SSA. Pockets of high SII in malaria prevalence in relation to WI and MHEL were observed in the East part of Africa. This study was able to map this wide range of malaria inequality metrics at a very local scale and highlighted the spatial clustering patterns of pockets of high and low malaria inequality values