Fact sheet—Measuring quality of care: A review of methodologies and indicators

Broad support for the promotion of high-quality service delivery in family planning (FP) programs is rooted in the publication in 1990 of a formal framework outlining its essential elements. This framework, developed by Judith Bruce of the Population Council, defines FP service delivery quality through six critical elements: choice of methods, information provided to clients, interpersonal relations, provider competence, follow-up mechanisms, and appropriate range of services offered. This factsheet argues that despite widespread endorsement of the Bruce framework and development of standardized data collection instruments, obstacles to accurate measures of quality of care remain. It concludes that further discussion within the research community must ensure appropriate, feasible, and efficient strategies for measuring quality, to reduce quality-related barriers to optimal FP use

MEASURING THE QUALITY OF FAMILY PLANNING SERVICE DELIVERY IN URBAN KENYA

Family planning saves lives but is underutilized in developing countries. Improvements in the quality of family planning service delivery may lead to increased contraceptive prevalence; however the association between quality and family planning use has not been well established. Additionally, the validity of standard instruments used to measure the quality of family planning service delivery is unknown. This research used the simulated client method and original data collected from family planning service providers and clients at 19 health facilities in Western Kenya to test the validity of standard facility-level data collection instruments. This research also estimated the association between quality of care and family planning use in urban Kenya using individual (n=3,990 women) and facility-level (n=260 facilities) cross-sectional data collected in 2010-2011 by the Measurement, Learning & Evaluation Project. Results of the validation analysis found that all three standard instruments used to measure family planning service quality performed poorly when compared to the referent standard of simulated client data. This suggests that revised approaches to measuring family planning service quality may be needed to ensure accurate assessment of programs and to better inform quality improvement interventions. Additionally, the multivariate analysis found that the consistent availability of an appropriate mix of contraceptive methods as well as provision of information by providers on side effects and provider treatment of clients are all associated with significant increases in the likelihood of current modern contraceptive use. This suggests that efforts to strengthen contraceptive security and improve the content of contraceptive counseling and treatment of clients by providers have the potential to significantly increase contraceptive use in urban Kenya.Doctor of Philosoph

Measuring quality of care: A review of previously used methodologies and indicators

Despite successful efforts to increase financial and geographic access to family planning services in many parts of the developing world, large numbers of women with a desire to delay or limit future pregnancies are not using contraceptive methods. Several multi-country, large-scale facility surveys incorporate indicators for measuring the quality of family planning service delivery. These facility surveys use data collection tools such as facility audits, provider and client questionnaires, and third party observation guides. A limited body of research indicates that the validity of these tools is low, however, while large variations in analytical approaches inhibit use of existing literature for summarizing progress or making comparisons over time or between countries. This working paper concludes that further discussion within the research community is warranted to ensure appropriate, feasible, and efficient strategies for measuring quality, and reducing quality-related barriers to optimal family planning use

"If the Big Fish are Doing It Then Why Not Me Down Here?": Informal Fee Payments and Reproductive Health Care Provider Motivation in Kenya

Informal fees are payments made by patients to their health care provider that are over and above the official cost of services. Payments may be motivated by a combination of factors such as low supervision, weak sanctions, and inadequate provider salaries. The practice of soliciting informal fees from patients may result in restricted access to medical care and reduced care-seeking behavior among vulnerable populations. The objective of this study is to examine nuanced health care provider perspectives on informal fee payments solicited from reproductive health patients in Kenya. We conducted in-depth semistructured interviews in 2015–2016 among a sample of 20 public and private-sector Kenyan health care workers. Interviews were coded and analyzed using an iterative thematic approach. More than half of participants reported that solicitation of informal fees is common practice in health care facilities. Providers reported low public-sector wages were a primary driver of informal fee solicitation coupled with collusion among senior staff. Additionally, patients may be unaware that they are being asked to pay more than the official cost of services. Strategies for reducing this behavior include more adequate and timely remuneration within the public sector, educating patient populations of free or low-cost services, and evidence-based methods to increase provider motivation

Provider barriers to family planning access in urban Kenya

A better understanding of the prevalence of service provider-imposed barriers to family planning can inform programs intended to increase contraceptive use. This study, based on data from urban Kenya, describes the frequency of provider self-reported restrictions related to clients’ age, parity, marital status, and third party consent, and considers the impact of facility type and training on restrictive practices

The effect of women's property rights on HIV: a search for quantitative evidence

In recent years efforts to reduce HIV transmission have begun to incorporate a structural interventions approach, whereby the social, political, and economic environment in which people live is considered an important determinant of individual behaviors. This approach to HIV prevention is reflected in the growing number of programs designed to address insecure or nonexistent property rights for women living in developing countries. Qualitative and anecdotal evidence suggests that property ownership may allow women to mitigate social, economic, and biological effects of HIV for themselves and others through increased food security and income generation. Even so, the relationship between women’s property and inheritance rights (WPIR) and HIV transmission behaviors is not well understood. We explored sources of data that could be used to establish quantitative links between WPIR and HIV. Our search for quantitative evidence included (1) a review of peer-reviewed and “grey” literature reporting on quantitative associations between WPIR and HIV, (2) identification and assessment of existing data sets for their utility in exploring this relationship, and (3) interviews with organizations addressing women’s property rights in Kenya and Uganda about the data they collect. We found no quantitative studies linking insecure WPIR to HIV transmission behaviors. Data sets with relevant variables were scarce, and those with both WPIR and HIV variables could only provide superficial evidence of associations. Organizations addressing WPIR in Kenya and Uganda did not collect data that could shed light on the connection between WPIR and HIV, but two had data and community networks that could provide a good foundation for a future study that would include the collection of additional information. Collaboration between groups addressing WPIR and HIV transmission could provide the quantitative evidence needed to determine whether and how a WPIR structural intervention could decrease HIV transmission

Exploring association between place of delivery and newborn care with early-neonatal mortality in Bangladesh

Objective Bangladesh achieved the fourth Millennium Development Goal well ahead of schedule, with a significant reduction in under-5 mortality between 1990 and 2015. However, the reduction in neonatal mortality has been stagnant in recent years. The purpose of this study is to explore the association between place of delivery and newborn care with early neonatal mortality (ENNM), which represents more than 80% of total neonatal mortality in Bangladesh. Methods In this study, 2014 Bangladesh Demographic and Health Survey data were used to assess early neonatal survival in children born in the three years preceding the survey. The roles of place of the delivery and newborn care in ENNM were examined using multivariable logistic regression models adjusted for clustering and relevant socio-economic, pregnancy, and newborn characteristics. Results Between 2012 and 2014, there were 4,624 deliveries in 17,863 sampled households, 39% of which were delivered at health facilities. The estimated early neonatal mortality rate during this period was 15 deaths per 1,000 live births. We found that newborns who had received at least 3 components of essential newborn care (ENC) were 56% less likely to die during the first seven days of their lives compared to their counterparts who received 0–2 components of ENC (aOR: 0.44; 95% CI: 0.24–0.81). In addition, newborns who had received any postnatal care (PNC) were 68% less likely to die in the early neonatal period than those who had not received any PNC (aOR: 0.32; 95% CI: 0.16–0.64). Facility delivery was not significantly associated with the risk of early newborn death in any of the models. Conclusion Our study findings highlight the importance of newborn and postnatal care in preventing early neonatal deaths. Further, findings suggest that increasing the proportion of women who give birth in a healthcare facility is not sufficient to reduce ENNM by itself; to realize the theoretical potential of facility delivery to avert neonatal deaths, we must also ensure quality of care during delivery, guarantee all components of ENC, and provide high-quality early PNC. Therefore, sustained efforts to expand access to high-quality ENC and PNC are needed in health facilities, particularly in facilities serving low-income populations

Association between skilled maternal healthcare and postpartum contraceptive use in Ethiopia

Abstract Background The postpartum period provides an important opportunity to address unmet need for contraception and reduce short birth intervals. This study aims to assess the association between skilled maternal healthcare and postpartum contraceptive use in Ethiopia. Methods Data for this analysis come from the 2011 to 2016 Ethiopian Demographic and Health Surveys (EDHS) and include nearly 5000 married women of reproductive age with a recent birth. Multivariate logistic regression was conducted to investigate the relationship between skilled maternal healthcare and postpartum contraceptive use. Results Between rounds of the 2011 and 2016 EDHS, the postpartum contraceptive prevalence increased from 15 to 23% and delivery in public facilities, use of skilled birth assistance, and skilled antenatal care also grew. In both survey rounds, educated women had approximately twice the odds of postpartum contraceptive use, compared with non-educated women, while an initially significant relationship between wealth and postpartum contraceptive use diminished in significance by 2016. Women with a desire to limit future pregnancy had five to six times the odds of postpartum contraceptive use in both survey rounds, and women in 2016 – unlike those in 2011 – with a desire to delay pregnancy were significantly more likely to use contraception (adjusted odds ratio (AOR) = 4.38, 95% CI: 1.46-13.18) compared to women who wanted another child soon. In 2011, no statistically significant associations were found between any maternal healthcare and postpartum contraceptive use. In contrast, in 2016, postpartum contraceptive use was significantly associated with an institutional delivery (AOR = 1.71, 95% confidence interval (CI): 1.12-2.62) and skilled antenatal care (AOR = 2.41, 95% CI: 1.41-4.10). No significant relationship was observed in either survey round between postpartum contraceptive use and skilled delivery or postnatal care. Conclusions A comparison of postpartum women in the 2011 and 2016 EDHS reveals increased use of both contraception and skilled maternal healthcare services and improved likelihood of contraceptive use among women with an institutional delivery or antenatal care, perhaps as a result of increased attention to postpartum family planning integration. Additionally, results suggest postpartum women are now using contraception to space future pregnancies, with the potential to help women achieve more optimal birth intervals

Accuracy of Standard Measures of Family Planning Service Quality: Findings from the Simulated Client Method

Despite widespread endorsement within the field of international family planning regarding the importance of quality of care as a reproductive right, the field has yet to develop validated data collection instruments to accurately assess quality in terms of its public health importance. This study, conducted among 19 higher volume public and private facilities in Kisumu, Kenya, used the simulated client method to test the validity of three standard data collection instruments included in large-scale facility surveys: provider interviews, client interviews, and observation of client-provider interactions. Results found low specificity and positive predictive values in each of the three instruments for a number of quality indicators, suggesting that quality of care may be overestimated by traditional methods. Revised approaches to measuring family planning service quality may be needed to ensure accurate assessment of programs and to better inform quality improvement interventions

Quality of Care and Contraceptive Use in Urban Kenya

CONTEXT—Family planning is highly beneficial to women’s overall health, morbidity, and mortality, particularly in developing countries. Yet, in much of sub-Saharan Africa, contraceptive prevalence remains low while unmet need for family planning remains high. It has been frequently hypothesized that the poor quality of family planning service provision in many low-income settings acts as a barrier to optimal rates of contraceptive use but this association has not been rigorously tested. METHODS—Using data collected from 3,990 women in 2010, this study investigates the association between family planning service quality and current modern contraceptive use in five cities in Kenya. In addition to individual-level data, audits of select facilities and service provider interviews were conducted in 260 facilities. Within 126 higher-volume clinics, exit interviews were conducted with family planning clients. Individual and facility-level data are linked based on the source of the woman’s current method or other health service. Adjusted prevalence ratios are estimated using binomial regression and we account for clustering of observations within facilities using robust standard errors. RESULTS—Solicitation of client preferences, assistance with method selection, provision of information by providers on side effects, and provider treatment of clients were all associated with a significantly increased likelihood of current modern contraceptive use and effects were often stronger among younger and less educated women. CONCLUSION—Efforts to strengthen contraceptive security and improve the content of contraceptive counseling and treatment of clients by providers have the potential to significantly increase contraceptive use in urban Kenya