Vouchers for scaling up insecticide-treated nets in Tanzania: Methods for monitoring and evaluation of a national health system intervention

BACKGROUND: The Tanzania National Voucher Scheme (TNVS) uses the public health system and the commercial sector to deliver subsidised insecticide-treated nets (ITNs) to pregnant women. The system began operation in October 2004 and by May 2006 was operating in all districts in the country. Evaluating complex public health interventions which operate at national level requires a multidisciplinary approach, novel methods, and collaboration with implementers to support the timely translation of findings into programme changes. This paper describes this novel approach to delivering ITNs and the design of the monitoring and evaluation (M&E). METHODS: A comprehensive and multidisciplinary M&E design was developed collaboratively between researchers and the National Malaria Control Programme. Five main domains of investigation were identified: (1) ITN coverage among target groups, (2) provision and use of reproductive and child health services, (3) "leakage" of vouchers, (4) the commercial ITN market, and (5) cost and cost-effectiveness of the scheme. RESULTS: The evaluation plan combined quantitative (household and facility surveys, voucher tracking, retail census and cost analysis) and qualitative (focus groups and in-depth interviews) methods. This plan was defined in collaboration with implementing partners but undertaken independently. Findings were reported regularly to the national malaria control programme and partners, and used to modify the implementation strategy over time. CONCLUSION: The M&E of the TNVS is a potential model for generating information to guide national and international programmers about options for delivering priority interventions. It is independent, comprehensive, provides timely results, includes information on intermediate processes to allow implementation to be modified, measures leakage as well as coverage, and measures progress over time

Can working with the private for-profit sector improve utilization of quality health services by the poor? A systematic review of the literature

BACKGROUND: There has been a growing interest in the role of the private for-profit sector in health service provision in low- and middle-income countries. The private sector represents an important source of care for all socioeconomic groups, including the poorest and substantial concerns have been raised about the quality of care it provides. Interventions have been developed to address these technical failures and simultaneously take advantage of the potential for involving private providers to achieve public health goals. Limited information is available on the extent to which these interventions have successfully expanded access to quality health services for poor and disadvantaged populations. This paper addresses this knowledge gap by presenting the results of a systematic literature review on the effectiveness of working with private for-profit providers to reach the poor. METHODS: The search topic of the systematic literature review was the effectiveness of interventions working with the private for-profit sector to improve utilization of quality health services by the poor. Interventions included social marketing, use of vouchers, pre-packaging of drugs, franchising, training, regulation, accreditation and contracting-out. The search for published literature used a series of electronic databases including PubMed, Popline, HMIC and CabHealth Global Health. The search for grey and unpublished literature used documents available on the World Wide Web. We focused on studies which evaluated the impact of interventions on utilization and/or quality of services and which provided information on the socioeconomic status of the beneficiary populations. RESULTS: A total of 2483 references were retrieved, of which 52 qualified as impact evaluations. Data were available on the average socioeconomic status of recipient communities for 5 interventions, and on the distribution of benefits across socioeconomic groups for 5 interventions. CONCLUSION: Few studies provided evidence on the impact of private sector interventions on quality and/or utilization of care by the poor. It was, however, evident that many interventions have worked successfully in poor communities and positive equity impacts can be inferred from interventions that work with types of providers predominantly used by poor people. Better evidence of the equity impact of interventions working with the private sector is needed for more robust conclusions to be drawn

Improving lives through better evidence

In 2014, 3ie organised a Festshrift to celebrate the contributions of Howard White, 3ie’s founding executive director, to development studies. In this introductory article, we provide a reflection on the contributions made in his career so far. Common themes include substance, namely a focus on the poor and disenfranchised; methodology, including theory of change and counterfactual analysis; and the promotion of evidence-based policy. We present an overview of the papers contained in the issue, which were commissioned from colleagues who have worked with Howard over the years. A second issue of the Journal of Development Effectiveness containing further papers commissioned as part of the Festschrift will be published in December 2015