Methodological Challenges to Economic Evaluations of Vaccines: Is a Common Approach Still Possible?

Economic evaluation of vaccination is a key tool to inform effective spending on vaccines. However, many evaluations have been criticised for failing to capture features of vaccines which are relevant to decision makers. These include broader societal benefits (such as improved educational achievement, economic growth and political stability), reduced health disparities, medical innovation, reduced hospital beds pressures, greater peace of mind and synergies in economic benefits with non-vaccine interventions. Also, the fiscal implications of vaccination programmes are not always made explicit. Alternative methodological frameworks have been proposed to better capture these benefits. However, any broadening of the methodology for economic evaluation must also involve evaluations of non-vaccine interventions, and hence may not always benefit vaccines given a fixed health-care budget. The scope of an economic evaluation must consider the budget from which vaccines are funded, and the decision-maker's stated aims for that spending to achieve

Discounting in the evaluation of the cost-effectiveness of a vaccination programme: A critical review.

Discounting future costs and health benefits usually has a large effect on results of cost-effectiveness evaluations of vaccination because of delays between the initial expenditure in the programme and the health benefits from averting disease. Most guidelines currently recommend discounting both costs and health effects at a positive, constant, common rate back to a common point in time. A review of 84 published economic evaluations of vaccines found that most of them apply these recommendations. However, both technical and normative arguments have been presented for discounting health at a different rate to consumption (differential discounting), discounting at a rate that changes over time (non-constant discounting), discounting intra-generational and inter-generational effects at a different rate (two-stage discounting), and discounting the health gains from an intervention to a different discount year from the time of intervention (delayed discounting). These considerations are particularly acute for vaccines, because their effects can occur in a different generation from the one paying for them, and because the time of vaccination, of infection aversion, and of disease aversion usually differ. Using differential, two-stage or delayed discounting in model-based cost-effectiveness evaluations of vaccination raises technical challenges, but mechanisms have been proposed to overcome them

What makes an eLife paper in epidemiology and global health?

The best papers provide evidence that can be used to make changes that improve the health and lives of people around the world

Informing Global Cost-Effectiveness Thresholds Using Country Investment Decisions: Human Papillomavirus Vaccine Introductions in 2006-2018.

OBJECTIVES: Cost-effectiveness analysis can guide decision making about health interventions, but the appropriate cost-effectiveness threshold to use is unclear in most countries. The World Health Organization (WHO) recommends vaccinating girls 9 to 14 years against human papillomavirus (HPV), but over half the world's countries have not introduced it. This study aimed to investigate whether country-level decisions about HPV vaccine introduction are consistent with a particular cost-effectiveness threshold, and to estimate what that threshold may be. METHODS: The cost-effectiveness of vaccinating 12-year-old girls was estimated in 179 countries using the Papillomavirus Rapid Interface for Modelling and Economics (PRIME) model, together with vaccine price data from World Health Organization's Market Information for Access to Vaccines database. In each year from 2006 to 2018, countries were categorized based on (1) whether they had introduced HPV vaccination, and (2) whether the incremental cost-effectiveness ratio for HPV vaccine introduction fell below a certain cost-effectiveness threshold. RESULTS: A cost-effectiveness threshold of 60% to 65% of GDP per capita has the best ability to discriminate countries that introduced vaccination, with a diagnostic odds ratio of about 7. For low-income countries the optimal threshold was lower, at 30% to 40% of GDP per capita. CONCLUSIONS: A cost-effectiveness threshold has some ability to discriminate between HPV vaccine introducer and non-introducer countries, although the average threshold is below the widely used threshold of 1 GDP per capita. These results help explain the current pattern of HPV vaccine use globally. They also inform the extent to which cost-effectiveness thresholds proposed in the literature reflect countries' actual investment decisions

Cost-benefit analysis of vaccination: a comparative analysis of eight approaches for valuing changes to mortality and morbidity risks.

BACKGROUND: There is increasing interest in estimating the broader benefits of public health interventions beyond those captured in traditional cost-utility analyses. Cost-benefit analysis (CBA) in principle offers a way to capture such benefits, but a wide variety of methods have been used to monetise benefits in CBAs. METHODS: To understand the implications of different CBA approaches for capturing and monetising benefits and their potential impact on public health decision-making, we conducted a CBA of human papillomavirus (HPV) vaccination in the United Kingdom using eight methods for monetising health and economic benefits, valuing productivity loss using either (1) the human capital or (2) the friction cost method, including the value of unpaid work in (3) human capital or (4) friction cost approaches, (5) adjusting for hard-to-fill vacancies in the labour market, (6) using the value of a statistical life, (7) monetising quality-adjusted life years and (8) including both productivity losses and monetised quality-adjusted life years. A previously described transmission dynamic model was used to project the impact of vaccination on cervical cancer outcomes. Probabilistic sensitivity analysis was conducted to capture uncertainty in epidemiologic and economic parameters. RESULTS: Total benefits of vaccination varied by more than 20-fold (£0.6-12.4 billion) across the approaches. The threshold vaccine cost (maximum vaccine cost at which HPV vaccination has a benefit-to-cost ratio above one) ranged from £69 (95% CI £56-£84) to £1417 (£1291-£1541). CONCLUSIONS: Applying different approaches to monetise benefits in CBA can lead to widely varying outcomes on public health interventions such as vaccination. Use of CBA to inform priority setting in public health will require greater convergence around appropriate methodology to achieve consistency and comparability across different studies

Cost-eff ectiveness of female human papillomavirus vaccination in 179 countries: a PRIME modelling study

Background Introduction of human papillomavirus (HPV) vaccination in settings with the highest burden of HPV is not universal, partly because of the absence of quantitative estimates of country-specifi c eff ects on health and economic costs. We aimed to develop and validate a simple generic model of such eff ects that could be used and understood in a range of settings with little external support. Methods We developed the Papillomavirus Rapid Interface for Modelling and Economics (PRIME) model to assess cost-eff ectiveness and health eff ects of vaccination of girls against HPV before sexual debut in terms of burden of cervical cancer and mortality. PRIME models incidence according to proposed vaccine effi cacy against HPV 16/18, vaccine coverage, cervical cancer incidence and mortality, and HPV type distribution. It assumes lifelong vaccine protection and no changes to other screening programmes or vaccine uptake. We validated PRIME against existing reports of HPV vaccination cost-eff ectiveness, projected outcomes for 179 countries (assuming full vaccination of 12-year-old girls), and outcomes for 71 phase 2 GAVI-eligible countries (using vaccine uptake data from the GAVI Alliance). We assessed diff erences between countries in terms of cost-eff ectiveness and health eff ects. Findings In validation, PRIME reproduced cost-eff ectiveness conclusions for 24 of 26 countries from 17 published studies, and for all 72 countries in a published study of GAVI-eligible countries. Vaccination of a cohort of 58 million 12-year-old girls in 179 countries prevented 690 000 cases of cervical cancer and 420 000 deaths during their lifetime (mostly in low-income or middle-income countries), at a net cost of US$4 billion. HPV vaccination was very cost eff ective (with every disability-adjusted life-year averted costing less than the gross domestic product per head) in 156 (87%) of 179 countries. Introduction of the vaccine in countries without national HPV vaccination at present would prevent substantially more cases of cervical cancer than in countries with such programmes, although the disparity has narrowed since 2012. If 71 phase 2 GAVI-eligible countries adopt vaccination according to forecasts, then in 2070 GAVI Alliance-funded vaccination could prevent 200 000 cases of cervical cancer and 100 000 deaths in some of the highest-burden countries. Interpretation Large between-country disparities exist for HPV vaccination, with countries with the most to gain yet to introduce national HPV vaccination. Support from the GAVI Alliance could help to reduce such disparities, but a substantial burden will remain even after presently projected vaccine introductions

Impact of measles supplementary immunization activities on reaching children missed by routine programs.

BACKGROUND: Measles supplementary immunization activities (SIAs) are vaccination campaigns that supplement routine vaccination programs with a recommended second dose opportunity to children of different ages regardless of their previous history of measles vaccination. They are conducted every 2-4 years and over a few weeks in many low- and middle-income countries. While SIAs have high vaccination coverage, it is unclear whether they reach the children who miss their routine measles vaccine dose. Determining who is reached by SIAs is vital to understanding their effectiveness, as well as measure progress towards measles control. METHODS: We examined SIAs in low- and middle-income countries from 2000 to 2014 using data from the Demographic and Health Surveys. Conditional on a child's routine measles vaccination status, we examined whether children participated in the most recent measles SIA. RESULTS: The average proportion of zero-dose children (no previous routine measles vaccination defined as no vaccination date before the SIA) reached by SIAs across 14 countries was 66%, ranging from 28% in São Tomé and Príncipe to 91% in Nigeria. However, when also including all children with routine measles vaccination data, this proportion decreased to 12% and to 58% when imputing data for children with vaccination reported by the mother and vaccination marks on the vaccination card across countries. Overall, the proportions of zero-dose children reached by SIAs declined with increasing household wealth. CONCLUSIONS: Some countries appeared to reach a higher proportion of zero-dose children using SIAs than others, with proportions reached varying according to the definition of measles vaccination (e.g., vaccination dates on the vaccination card, vaccination marks on the vaccination card, and/or self-reported data). This suggests that some countries could improve their targeting of SIAs to children who miss other measles vaccine opportunities. Across all countries, SIAs played an important role in reaching children from poor households

The impact of vaccination on gender equity: conceptual framework and human papillomavirus (HPV) vaccine case study.

BACKGROUND: Although the beneficial effects of vaccines on equity by socioeconomic status and geography are increasingly well-documented, little has been done to extend these analyses to examine the linkage between vaccination and gender equity. In this paper, evidence from the published literature is used to develop a conceptual framework demonstrating the potential impact of vaccination on measures of gender equity. This framework is then applied to human papillomavirus (HPV) vaccination in three countries with different economic and disease burden profiles to establish a proof of concept in a variety of contexts. METHODS: We conducted a literature review examining evidence on the linkage between health outcomes and dimensions of gender equity. We utilized the Papillomavirus Rapid Interface for Modelling and Economics (PRIME) model to estimate cervical cancer incidence and deaths due to HPV types 16/18 by age in each country. We estimated labor force participation and fertility effects from improvements in health, and converted these into inputs consistent with those used to calculate the United Nations Gender Inequality Index to assess gender equity. RESULTS: In our case study, we found that HPV vaccination among girls could help narrow socioeconomic gender disparities by quantifying the main pathways by which HPV vaccination improves health, which enables improvement in gender equity indicators such as labor force participation and maternal mortality ratios. While these improvements are small when averaged over the entire population, the components measured - labor force participation and maternal mortality ratio - account for 50% of the index scores. CONCLUSIONS: This proof of concept model is a starting point to inform future health and economic analyses that might incorporate the impact of gender equity as an additional impact of vaccination in improving the health and well-being of the population

Burden of Severe Pneumonia, Pneumococcal Pneumonia and Pneumonia Deaths in Indian States: Modelling Based Estimates.

The burden of severe pneumonia in terms of morbidity and mortality is unknown in India especially at sub-national level. In this context, we aimed to estimate the number of severe pneumonia episodes, pneumococcal pneumonia episodes and pneumonia deaths in children younger than 5 years in 2010. We adapted and parameterized a mathematical model based on the epidemiological concept of potential impact fraction developed CHERG for this analysis. The key parameters that determine the distribution of severe pneumonia episode across Indian states were state-specific under-5 population, state-specific prevalence of selected definite pneumonia risk factors and meta-estimates of relative risks for each of these risk factors. We applied the incidence estimates and attributable fraction of risk factors to population estimates for 2010 of each Indian state. We then estimated the number of pneumococcal pneumonia cases by applying the vaccine probe methodology to an existing trial. We estimated mortality due to severe pneumonia and pneumococcal pneumonia by combining incidence estimates with case fatality ratios from multi-centric hospital-based studies. Our results suggest that in 2010, 3.6 million (3.3-3.9 million) episodes of severe pneumonia and 0.35 million (0.31-0.40 million) all cause pneumonia deaths occurred in children younger than 5 years in India. The states that merit special mention include Uttar Pradesh where 18.1% children reside but contribute 24% of pneumonia cases and 26% pneumonia deaths, Bihar (11.3% children, 16% cases, 22% deaths) Madhya Pradesh (6.6% children, 9% cases, 12% deaths), and Rajasthan (6.6% children, 8% cases, 11% deaths). Further, we estimated that 0.56 million (0.49-0.64 million) severe episodes of pneumococcal pneumonia and 105 thousand (92-119 thousand) pneumococcal deaths occurred in India. The top contributors to India's pneumococcal pneumonia burden were Uttar Pradesh, Bihar, Madhya Pradesh and Rajasthan in that order. Our results highlight the need to improve access to care and increase coverage and equity of pneumonia preventing vaccines in states with high pneumonia burden

Seropositivity to non-vaccine incorporated genotypes induced by the bivalent and quadrivalent HPV vaccines: A systematic review and meta-analysis.

BACKGROUND: Human papillomavirus vaccines have demonstrated remarkable efficacy against persistent infection and disease associated with vaccine-incorporated genotypes and a degree of efficacy against some genetically related, non-vaccine-incorporated genotypes. The vaccines differ in the extent of cross-protection against these non-vaccine genotypes. Data supporting the role for neutralizing antibodies as a correlate or surrogate of cross-protection are lacking, as is a robust assessment of the seroconversion rates against these non-vaccine genotypes. METHODS: We performed a systematic review and meta-analysis of available data on vaccine-induced neutralizing antibody seropositivity to non-vaccine incorporated HPV genotypes. RESULTS: Of 304 articles screened, 9 were included in the analysis representing ca. 700 individuals. The pooled estimate for seropositivity against HPV31 for the bivalent vaccine (86%; 95%CI 78-91%) was higher than that for the quadrivalent vaccine (61%; 39-79%; p=0.011). The pooled estimate for seropositivity against HPV45 for the bivalent vaccine (50%; 37-64%) was also higher than that for the quadrivalent vaccine (16%; 6-36%; p=0.007). Seropositivity against HPV33, HPV52 and HPV58 were similar between the vaccines. Mean seropositivity rates across non-vaccine genotypes were positively associated with the corresponding vaccine efficacy data reported from vaccine trials. CONCLUSIONS: These data improve our understanding of vaccine-induced functional antibody specificity against non-vaccine incorporated genotypes and may help to parameterize vaccine-impact models and improve patient management in a post-vaccine setting