Implementation Research to Catalyze Advances in Health Systems Strengthening in sub-Saharan Africa: the African Health Initiative (Preface)

The importance of strengthening health systems has gained increased attention in recent years, and there have been renewed calls for a focus on health systems as part and parcel of meeting the health related Millennium Development Goals. Despite the growing focus on health systems, the largest global health initiatives -- suchas PEPFAR, PMI, the Global Fund to Fight AIDS, TB, and Malaria, and GAVI -- continue to have a disease specific focus. The divergence in opinion on what constitutes health systems strengthening and the scarcity of rigorous evaluations of various approaches undermine efforts to focus on health systems as a means of improving population health. In response to this challenge, the Doris DukeCharitable Foundation (DDCF) launched the African Health Initiative (AHI) to catalyze significant advances instrengthening health systems by supporting Population Health and Implementation Training (PHIT) Partnerships in five diverse sub-Saharan African contexts. Each Partnership is implementing and evaluating an innovative project designed to address key health systems constraints and improve service delivery and health outcomes. This article is a preface to a series of reports

Paying primary health care centers for performance in Rwanda

Paying for performance (P4P) provides financial incentives for providers to increase the use and quality of care. P4P can affect health care by providing incentives for providers to put more effort into specific activities, and by increasing the amount of resources available to finance the delivery of services. This paper evaluates the impact of P4P on the use and quality of prenatal, institutional delivery, and child preventive care using data produced from a prospective quasi-experimental evaluation nested into the national rollout of P4P in Rwanda. Treatment facilities were enrolled in the P4P scheme in 2006 and comparison facilities were enrolled two years later. The incentive effect is isolated from the resource effect by increasing comparison facilities'input-based budgets by the average P4P payments to the treatment facilities. The data were collected from 166 facilities and a random sample of 2158 households. P4P had a large and significant positive impact on institutional deliveries and preventive care visits by young children, and improved quality of prenatal care. The authors find no effect on the number of prenatal care visits or on immunization rates. P4P had the greatest effect on those services that had the highest payment rates and needed the lowest provider effort. P4P financial performance incentives can improve both the use of and the quality of health services. Because the analysis isolates the incentive effect from the resource effect in P4P, the results indicate that an equal amount of financial resources without the incentives would not have achieved the same gain in outcomes.Health Monitoring&Evaluation,Population Policies,Health Systems Development&Reform,Disease Control&Prevention,Adolescent Health

Missing safer sex strategies in HIV Prevention: A call for further research

Despite the efforts of educators, public health officials, and HIV/AIDS prevention experts, condom promotion has failed to stop the HIV epidemic in most of sub- Saharan Africa and most researchers and policy makers have focused on risk reductions for interventions for penetrative sex. We consider another HIV prevention option: female-to-male oral sex (fellatio). Extensive medical evidence indicates that fellatio is roughly as protective against HIV transmission as vaginal sex with a condom, and much safer than unprotected sex, but it is rarely emphasized in HIV prevention curricula. Moreover, available data on the practice of oral sex in Africa suggests that the practice is very rare compared to the practice in the United States. This paper reviews some of the existing evidence on the efficacy and prevalence of oral sex, discusses the potential of this safer sex strategy for mitigating the spread of HIV in Africa, and stresses the need for further research

The effect of performance-based financing on illness, care-seeking and treatment among children: an impact evaluation in Rwanda

Background Performance-based financing (PBF) strategies are promoted as a supply-side, results-based financing mechanism to improve primary health care. This study estimated the effects of Rwanda’s PBF program on less-incentivized child health services and examined the differential program impact by household poverty. Methods Districts were allocated to intervention and comparison for PBF implementation in Rwanda. Using Demographic Health Survey data from 2005 to 2007–08, a community-level panel dataset of 5781 children less than 5 years of age from intervention and comparison districts was created. The impacts of PBF on reported childhood illness, facility care-seeking, and treatment received were estimated using a difference-in-differences model with community fixed effects. An interaction term between poverty and the program was estimated to identify the differential effect of PBF among children from poorer families. Results There was no measurable difference in estimated probability of reporting illness with diarrhea, fever or acute respiratory infections between the intervention and comparison groups. Seeking care at a facility for these illnesses increased over time, however no differential effect by PBF was seen. The estimated effect of PBF on receipt of treatment for poor children is 45 percentage points higher (p = 0.047) compared to the non-poor children seeking care for diarrhea or fever. Conclusions PBF, a supply-side incentive program, improved the quality of treatment received by poor children conditional on patients seeking care, but it did not impact the propensity to seek care. These findings provide additional evidence that PBF incentivizes the critical role staff play in assuring quality services, but does little to influence consumer demand for these services. Efforts to improve child health need to address both supply and demand, with additional attention to barriers due to poverty if equity in service use is a concern

Towards Universal Health Coverage: An Evaluation of Rwanda Mutuelles in Its First Eight Years

Background: Mutuelles is a community-based health insurance program, established since 1999 by the Government of Rwanda as a key component of the national health strategy on providing universal health care. The objective of the study was to evaluate the impact of Mutuelles on achieving universal coverage of medical services and financial risk protection in its first eight years of implementation. Methods and Findings: We conducted a quantitative impact evaluation of Mutuelles between 2000 and 2008 using nationally-representative surveys. At the national and provincial levels, we traced the evolution of Mutuelles coverage and its impact on child and maternal care coverage from 2000 to 2008, as well as household catastrophic health payments from 2000 to 2006. At the individual level, we investigated the impact of Mutuelles' coverage on enrollees' medical care utilization using logistic regression. We focused on three target populations: the general population, under-five children, and women with delivery. At the household level, we used logistic regression to study the relationship between Mutuelles coverage and the probability of incurring catastrophic health spending. The main limitation was that due to insufficient data, we are not able to study the impact of Mutuelles on health outcomes, such as child and maternal mortalities, directly. The findings show that Mutuelles improved medical care utilization and protected households from catastrophic health spending. Among Mutuelles enrollees, those in the poorest expenditure quintile had a significantly lower rate of utilization and higher rate of catastrophic health spending. The findings are robust to various estimation methods and datasets. Conclusions: Rwanda's experience suggests that community-based health insurance schemes can be effective tools for achieving universal health coverage even in the poorest settings. We suggest a future study on how eliminating Mutuelles copayments for the poorest will improve their healthcare utilization, lower their catastrophic health spending, and affect the finances of health care providers

Rainfall variation and child health: effect of rainfall on diarrhea among under 5 children in Rwanda, 2010

BACKGROUND:Diarrhea among children under 5 years of age has long been a major public health concern. Previous studies have suggested an association between rainfall and diarrhea. Here, we examined the association between Rwandan rainfall patterns and childhood diarrhea and the impact of household sanitation variables on this relationship.METHODS:We derived a series of rain-related variables in Rwanda based on daily rainfall measurements and hydrological models built from daily precipitation measurements collected between 2009 and 2011. Using these data and the 2010 Rwanda Demographic and Health Survey database, we measured the association between total monthly rainfall, monthly rainfall intensity, runoff water and anomalous rainfall and the occurrence of diarrhea in children under 5 years of age.RESULTS:Among the 8601 children under 5 years of age included in the survey, 13.2 % reported having diarrhea within the 2 weeks prior to the survey. We found that higher levels of runoff were protective against diarrhea compared to low levels among children who lived in households with unimproved toilet facilities (OR?=?0.54, 95 % CI: [0.34, 0.87] for moderate runoff and OR?=?0.50, 95 % CI: [0.29, 0.86] for high runoff) but had no impact among children in household with improved toilets.CONCLUSION:Our finding that children in households with unimproved toilets were less likely to report diarrhea during periods of high runoff highlights the vulnerabilities of those living without adequate sanitation to the negative health impacts of environmental events

Low risk of attrition among adults on antiretroviral therapy in the Rwandan national program: a retrospective cohort analysis of 6, 12, and 18 month outcomes

Background: We report levels and determinants of attrition in Rwanda, one of the few African countries with universal ART access. Methods: We analyzed data abstracted from health facility records of a nationally representative sample of adults [≥18 years] who initiated ART 6, 12, and 18 months prior to data collection; and collected facility characteristics with a health facility assessment questionnaire. Weighted proportions and rates of attrition [loss to follow-up or death] were calculated, and patient- and health facility-level factors associated with attrition examined using Cox proportional hazard models. Results: 1678 adults initiated ART 6, 12 and 18 months prior to data collection, with 1508 person-years [PY] on ART. Attrition was 6.8% [95% confidence interval [CI] 6.0-7.8]: 2.9% [2.4-3.5] recorded deaths and 3.9% [3.4-4.5] lost to follow-up. Population attrition rate was 7.5/100PY [6.1-9.3]. Adjusted hazard ratio [aHR] for attrition was 4.2 [3.0-5.7] among adults enrolled from in-patient wards [vs 2.2 [1.6-3.0] from PMTCT, ref: VCT]. Compared to adults who initiated ART 18 months earlier, aHR for adults who initiated ART 12 and 6 months earlier was 1.8 [1.3-2.5] and 1.3 [0.9-1.9] respectively. Male aHR was 1.4 [1.0-1.8]. AHR of adults enrolled at urban health facilities was 1.4 [1.1-1.8, ref: rural health facilities]. AHR for adults with CD4+ ≥200 cells/μL vs <200 cells/μL was 0.8 [0.6-1.0]; and adults attending facilities with performance-based financing since 2004–2006 [vs. 2007–2008] had aHR 0.8 [0.6-0.9]. Conclusions: Attrition was low in the Rwandan national program. The above patient and facility correlates of attrition can be the focus of interventions to sustain high retention

High Levels of Adherence and Viral Suppression in a Nationally Representative Sample of HIV-Infected Adults on Antiretroviral Therapy for 6, 12 and 18 Months in Rwanda

Background: Generalizable data are needed on the magnitude and determinants of adherence and virological suppression among patients on antiretroviral therapy (ART) in Africa. Methods: We conducted a cross-sectional survey with chart abstraction, patient interviews and site assessments in a nationally representative sample of adults on ART for 6, 12 and 18 months at 20 sites in Rwanda. Adherence was assessed using 3- and 30-day patient recall. A systematically selected sub-sample had viral load (VL) measurements. Multivariable logistic regression examined predictors of non-perfect (less than 100%) 30-day adherence and detectable VL (greater than 40 copies/ml). Results: Overall, 1,417 adults were interviewed and 837 had VL measures. Ninety-four percent and 78% reported perfect adherence for the last 3 and 30 days, respectively. Eighty-three percent had undetectable VL. In adjusted models, characteristics independently associated with higher odds of non-perfect 30-day adherence were: being on ART for 18 months (vs. 6 months); younger age; reporting severe (vs. no or few) side effects in the prior 30 days; having no documentation of CD4 cell count at ART initiation (vs. having a CD4 cell count of less than 200 cells/µL); alcohol use; and attending sites which initiated ART services in 2003–2004 and 2005 (vs. 2006–2007); sites with ≥600 (vs. less than 600 patients) on ART; or sites with peer educators. Participation in an association for people living with HIV/AIDS; and receiving care at sites which regularly conduct home-visits were independently associated with lower odds of non-adherence. Higher odds of having a detectable VL were observed among patients at sites with peer educators. Being female; participating in an association for PLWHA; and using a reminder tool were independently associated with lower odds of having detectable VL. Conclusions: High levels of adherence and viral suppression were observed in the Rwandan national ART program, and associated with potentially modifiable factors

Approaches to ensuring and improving quality in the context of health system strengthening: a cross-site analysis of the five African Health Initiative Partnership programs

Background: Integrated into the work in health systems strengthening (HSS) is a growing focus on the importance of ensuring quality of the services delivered and systems which support them. Understanding how to define and measure quality in the different key World Health Organization building blocks is critical to providing the information needed to address gaps and identify models for replication. Description of approaches We describe the approaches to defining and improving quality across the five country programs funded through the Doris Duke Charitable Foundation African Health Initiative. While each program has independently developed and implemented country-specific approaches to strengthening health systems, they all included quality of services and systems as a core principle. We describe the differences and similarities across the programs in defining and improving quality as an embedded process essential for HSS to achieve the goal of improved population health. The programs measured quality across most or all of the six WHO building blocks, with specific areas of overlap in improving quality falling into four main categories: 1) defining and measuring quality; 2) ensuring data quality, and building capacity for data use for decision making and response to quality measurements; 3) strengthened supportive supervision and/or mentoring; and 4) operational research to understand the factors associated with observed variation in quality. Conclusions: Learning the value and challenges of these approaches to measuring and improving quality across the key components of HSS as the projects continue their work will help inform similar efforts both now and in the future to ensure quality across the critical components of a health system and the impact on population health

Toward utilization of data for program management and evaluation: quality assessment of five years of health management information system data in Rwanda

Background: Health data can be useful for effective service delivery, decision making, and evaluating existing programs in order to maintain high quality of healthcare. Studies have shown variability in data quality from national health management information systems (HMISs) in sub-Saharan Africa which threatens utility of these data as a tool to improve health systems. The purpose of this study is to assess the quality of Rwanda's HMIS data over a 5-year period. Methods: The World Health Organization (WHO) data quality report card framework was used to assess the quality of HMIS data captured from 2008 to 2012 and is a census of all 495 publicly funded health facilities in Rwanda. Factors assessed included completeness and internal consistency of 10 indicators selected based on WHO recommendations and priority areas for the Rwanda national health sector. Completeness was measured as percentage of non-missing reports. Consistency was measured as the absence of extreme outliers, internal consistency between related indicators, and consistency of indicators over time. These assessments were done at the district and national level. Results: Nationally, the average monthly district reporting completeness rate was 98% across 10 key indicators from 2008 to 2012. Completeness of indicator data increased over time: 2008, 88%; 2009, 91%; 2010, 89%; 2011, 90%; and 2012, 95% (p<0.0001). Comparing 2011 and 2012 health events to the mean of the three preceding years, service output increased from 3% (2011) to 9% (2012). Eighty-three percent of districts reported ratios between related indicators (ANC/DTP1, DTP1/DTP3) consistent with HMIS national ratios. Conclusion and policy implications Our findings suggest that HMIS data quality in Rwanda has been improving over time. We recommend maintaining these assessments to identify remaining gaps in data quality and that results are shared publicly to support increased use of HMIS data