We discuss eight randomized evaluations intended to increase vaccination uptake conducted by the US General Services Administration’s Office of Evaluation Sciences (OES). These evaluations had a median sample size of 55,000, deployed a variety of behaviorally-informed direct communications, and used administrative data to measure vaccination uptake. The confidence interval from an internal meta-analysis shows changes in vaccination rates ranging from -0.004 to 0.394 percentage points. Two studies yielded statistically significant increases, of 0.59 and 0.16 percentage points. The other six were not statistically significant, although the studies were powered to detect effect sizes in line with published research. This work highlights the likely effects of government communications and demonstrates the value of conducting rapid evaluations to support COVID-19 vaccination efforts

Balu, R.

Burnett, R.

Chen, N.

Debroy, P.

Johnson, R.

Kappes, H.

Leight, J.

Omer, S.

Safran, E.

Steffel, M.

Toma, Mattie

Trump, K.

Yokum, D.

The COVID-19 pandemic has added new urgency to the question of how best to motivate people to get needed vaccines. In this article, we present lessons gleaned from government evaluations of eight large randomized controlled trials of interventions that used direct communications to increase the uptake of routine vaccines. These evaluations, conducted by the U.S. General Services Administration’s Office of Evaluation Sciences (OES) before the start of the pandemic, had a median sample size of 55,000. Participating organizations deployed a variety of behaviorally informed direct communications and used administrative data to measure whether people who received the communications got vaccinated or took steps toward vaccination. The results of six of the eight evaluations were not statistically significant, and a meta-analysis suggests that changes in vaccination rates ranged from -0.004 to 0.394 percentage points. The remaining two evaluations yielded increases in vaccination rates that were statistically significant, albeit modest: 0.59 and 0.16 percentage points. Agencies looking for cost-effective ways to use communications to boost vaccine uptake in the field—whether for COVID-19 or for other diseases-may want to evaluate program effectiveness early on so messages and methods may be adjusted as needed, and they should expect effects to be smaller than those seen in academic studies

Warwick Research Archives Portal Repository

Using communication to boost vaccination : lessons for COVID-19 from evaluations of eight large-scale programs to promote routine vaccinations

Lessons for COVID-19 vaccination from eight federal government communication evaluations

Lessons for COVID-19 vaccination from eight federal government communication evaluations

Abstract

Similar works

Full text

Available Versions

Warwick Research Archives Portal Repository