Health service quality in 2929 facilities in six low-income and middle-income countries: a positive deviance analysis

BACKGROUND: Primary care is of insufficient quality in many low-income and middle-income countries. Some health facilities perform better than others despite operating in similar contexts, although the factors that characterise best performance are not well known. Existing best-performance analyses are concentrated in high-income countries and focus on hospitals. We used the positive deviance approach to identify the factors that differentiate best from worst primary care performance among health facilities across six low-resource health systems. METHODS: This positive deviance analysis used nationally representative samples of public and private health facilities from Service Provision Assessments of the Democratic Republic of the Congo, Haiti, Malawi, Nepal, Senegal, and Tanzania. Data were collected starting June 11, 2013, in Malawi and ending Feb 28, 2020, in Senegal. We assessed facility performance through completion of the Good Medical Practice Index (GMPI) of essential clinical actions (eg, taking a thorough history, conducting an adequate physical examination) according to clinical guidelines and measured with direct observations of care. We identified hospitals and clinics in the top decile of performance (defined as best performers) and conducted a quantitative, cross-national positive deviance analysis to compare them with facilities performing below the median (defined as worst performers) and identify facility-level factors that explain the gap between best and worst performance. FINDINGS: We identified 132 best-performing and 664 worst-performing hospitals, and 355 best-performing and 1778 worst-performing clinics based on clinical performance across countries. The mean GMPI score was 0.81 (SD 0.07) for the best-performing hospitals and 0.44 (0.09) for the worst-performing hospitals. Among clinics, mean GMPI scores were 0.75 (0.07) for the best performers and 0.34 (0.10) for the worst performers. High-quality governance, management, and community engagement were associated with best performance compared with worst performance. Private facilities out-performed government-owned hospitals and clinics. INTERPRETATION: Our findings suggest that best-performing health facilities are characterised by good management and leaders who can engage staff and community members. Governments should look to best performers to identify scalable practices and conditions for success that can improve primary care quality overall and decrease quality gaps between health facilities. FUNDING: Bill & Melinda Gates Foundation

Magnitude and pattern of improvement in processes of care for hospitalised children with diarrhoea and dehydration in Kenyan hospitals participating in a clinical network

Objective WHO recommends optimisation of available interventions to reduce deaths of under‐five children with diarrhoea and dehydration (DD). Clinical networks may help improve practice across many hospitals but experience with such networks is scarce. We describe magnitude and patterns of changes in processes of care for children with DD over the first 3 years of a clinical network. Methods Observational study involving children aged 2–59 months with DD admitted to 13 hospitals participating in the clinical network. Processes of individual patient care including agreement of assessment, diagnosis and treatment according to WHO guidelines were combined using the composite Paediatric Admission Quality of Care (PAQC) score (range 0–6). Results Data from 7657 children were analysed and improvements in PAQC scores were observed. Predicted mean PAQC score for all the hospitals at enrolment was 59.8% (95% CI: 54.7, 64.9) but showed a wide variation (variance 10.7%, 95% CI: 5.8, 19.6). Overall mean PAQC score increased by 13.8% (95% CI: 8.7–18.9, SD between hospitals: ±8.2) in the first 12 months, with an average 0.9% (95% CI: 0.3–1.5, SD ± 1.0) increase per month and plateaued thereafter, and changes were similar in two groups of hospitals joining the network at different times. Conclusion Adherence to guidelines for children admitted with DD can be improved through participation in a clinical network but improvement is limited, not uniform for all aspects of care and contexts and occurs early. Future research should address these issues

Implementation experience during an eighteen month intervention to improve paediatric and newborn care in Kenyan district hospitals

<p>Abstract</p> <p>Background</p> <p>We have conducted an intervention study aiming to improve hospital care for children and newborns in Kenya. In judging whether an intervention achieves its aims, an understanding of how it is delivered is essential. Here, we describe how the implementation team delivered the intervention over 18 months and provide some insight into how health workers, the primary targets of the intervention, received it.</p> <p>Methods</p> <p>We used two approaches. First, a description of the intervention is based on an analysis of records of training, supervisory and feedback visits to hospitals, and brief logs of key topics discussed during telephone calls with local hospital facilitators. Record keeping was established at the start of the study for this purpose with analyses conducted at the end of the intervention period. Second, we planned a qualitative study nested within the intervention project and used in-depth interviews and small group discussions to explore health worker and facilitators' perceptions of implementation. After thematic analysis of all interview data, findings were presented, discussed, and revised with the help of hospital facilitators.</p> <p>Results</p> <p>Four hospitals received the full intervention including guidelines, training and two to three monthly support supervision and six monthly performance feedback visits. Supervisor visits, as well as providing an opportunity for interaction with administrators, health workers, and facilitators, were often used for impromptu, limited refresher training or orientation of new staff. The personal links that evolved with senior staff seemed to encourage local commitment to the aims of the intervention. Feedback seemed best provided as open meetings and discussions with administrators and staff. Supervision, although sometimes perceived as fault finding, helped local facilitators become the focal point of much activity including key roles in liaison, local monitoring and feedback, problem solving, and orientation of new staff to guidelines. In four control hospitals receiving a minimal intervention, local supervision and leadership to implement new guidelines, despite their official introduction, were largely absent.</p> <p>Conclusion</p> <p>The actual content of an intervention and how it is implemented and received may be critical determinants of whether it achieves its aims. We have carefully described our intervention approach to facilitate appraisal of the quantitative results of the intervention's effect on quality of care. Our findings suggest ongoing training, external supportive supervision, open feedback, and local facilitation may be valuable additions to more typical in-service training approaches, and may be feasible.</p

Effect of a multi-faceted quality improvement intervention on inappropriate antibiotic use in children with non-bloody diarrhoea admitted to district hospitals in Kenya

BACKGROUND: There are few reports of interventions to reduce the common but irrational use of antibiotics for acute non-bloody diarrhoea amongst hospitalised children in low-income settings. We undertook a secondary analysis of data from an intervention comprising training of health workers, facilitation, supervision and face-to-face feedback, to assess whether it reduced inappropriate use of antibiotics in children with non-bloody diarrhoea and no co-morbidities requiring antibiotics, compared to a partial intervention comprising didactic training and written feedback only. This outcome was not a pre-specified end-point of the main trial. METHODS: Repeated cross-sectional survey data from a cluster-randomised controlled trial of an intervention to improve management of common childhood illnesses in Kenya were used to describe the prevalence of inappropriate antibiotic use in a 7-day period in children aged 2-59 months with acute non-bloody diarrhoea. Logistic regression models with random effects for hospital were then used to identify patient and clinician level factors associated with inappropriate antibiotic use and to assess the effect of the intervention. RESULTS: 9, 459 admission records of children were reviewed for this outcome. Of these, 4, 232 (44.7%) were diagnosed with diarrhoea, with 130 of these being bloody (dysentery) therefore requiring antibiotics. 1, 160 children had non-bloody diarrhoea and no co-morbidities requiring antibiotics-these were the focus of the analysis. 750 (64.7%) of them received antibiotics inappropriately, 313 of these being in the intervention hospitals vs. 437 in the controls. The adjusted logistic regression model showed the baseline-adjusted odds of inappropriate antibiotic prescription to children admitted to the intervention hospitals was 0.30 times that in the control hospitals (95%CI 0.09-1.02). CONCLUSION: We found some evidence that the multi-faceted, sustained intervention described in this paper led to a reduction in the inappropriate use of antibiotics in treating children with non-bloody diarrhoea. TRIAL REGISTRATION: International Standard Randomised Controlled Trial Number Register ISRCTN42996612

A Multifaceted Intervention to Implement Guidelines and Improve Admission Paediatric Care in Kenyan District Hospitals: A Cluster Randomised Trial

Philip Ayieko and colleagues report the outcomes of a cluster-randomized trial carried out in eight Kenyan district hospitals evaluating the effects of a complex intervention involving improved training and supervision for clinicians. They found a higher performance of hospitals assigned to the complex intervention on a variety of process of care measures, as compared to those receiving the control intervention

Developing a tool to measure health worker motivation in district hospitals in Kenya

BACKGROUND: We wanted to try to account for worker motivation as a key factor that might affect the success of an intervention to improve implementation of health worker practices in eight district hospitals in Kenya. In the absence of available tools, we therefore aimed to develop a tool that could enable a rapid measurement of motivation at baseline and at subsequent points during the 18-month intervention study. METHODS: After a literature review, a self-administered questionnaire was developed to assess the outcomes and determinants of motivation of Kenyan government hospital staff. The initial questionnaire included 23 questions (from seven underlying constructs) related to motivational outcomes that were then used to construct a simpler tool to measure motivation. Parallel qualitative work was undertaken to assess the relevance of the questions chosen and the face validity of the tool. RESULTS: Six hundred eighty-four health workers completed the questionnaires at baseline. Reliability analysis and factor analysis were used to produce the simplified motivational index, which consisted of 10 equally-weighted items from three underlying factors. Scores on the 10-item index were closely correlated with scores for the 23-item index, indicating that in future rapid assessments might be based on the 10 questions alone. The 10-item motivation index was also able to identify statistically significant differences in mean health worker motivation scores between the study hospitals (p<0.001). The parallel qualitative work in general supported these conclusions and contributed to our understanding of the three identified components of motivation. CONCLUSION: The 10-item score developed may be useful to monitor changes in motivation over time within our study or be used for more extensive rapid assessments of health worker motivation in Kenya

Explaining the effects of a multifaceted intervention to improve inpatient care in rural Kenyan hospitals -- interpretation based on retrospective examination of data from participant observation, quantitative and qualitative studies

<p>Abstract</p> <p>Background</p> <p>We have reported the results of a cluster randomized trial of rural Kenyan hospitals evaluating the effects of an intervention to introduce care based on best-practice guidelines. In parallel work we described the context of the study, explored the process and perceptions of the intervention, and undertook a discrete study on health worker motivation because this was felt likely to be an important contributor to poor performance in Kenyan public sector hospitals. Here, we use data from these multiple studies and insights gained from being participants in and observers of the intervention process to provide our explanation of how intervention effects were achieved as part of an effort to better understand implementation in low-income hospital settings.</p> <p>Methods</p> <p>Initial hypotheses were generated to explain the variation in intervention effects across place, time, and effect measure (indicator) based on our understanding of theory and informed by our implementation experience and participant observations. All data sources available for hospitals considered as cases for study were then examined to determine if hypotheses were supported, rejected, or required modification. Data included transcriptions of interviews and group discussions, field notes and that from the detailed longitudinal quantitative investigation. Potentially useful explanatory themes were identified, discussed by the implementing and research team, revised, and merged as part of an iterative process aimed at building more generic explanatory theory. At the end of this process, findings were mapped against a recently reported comprehensive framework for implementation research.</p> <p>Results</p> <p>A normative re-educative intervention approach evolved that sought to reset norms and values concerning good practice and promote 'grass-roots' participation to improve delivery of correct care. Maximal effects were achieved when this strategy and external support supervision helped create a soft-contract with senior managers clarifying roles and expectations around desired performance. This, combined with the support of facilitators acting as an expert resource and 'shop-floor' change agent, led to improvements in leadership, accountability, and resource allocation that enhanced workers' commitment and capacity and improved clinical microsystems. Provision of correct care was then particularly likely if tasks were simple and a good fit to existing professional routines. Our findings were in broad agreement with those defined as part of recent work articulating a comprehensive framework for implementation research.</p> <p>Conclusions</p> <p>Using data from multiple studies can provide valuable insight into how an intervention is working and what factors may explain variability in effects. Findings clearly suggest that major intervention strategies aimed at improving child and newborn survival in low-income settings should go well beyond the fixed inputs (training, guidelines, and job aides) that are typical of many major programmes. Strategies required to deliver good care in low-income settings should recognize that this will need to be co-produced through engagement often over prolonged periods and as part of a directive but adaptive, participatory, information-rich, and reflective process.</p

Contextual influences on health worker motivation in district hospitals in Kenya

<p>Abstract</p> <p>Background</p> <p>Organizational factors are considered to be an important influence on health workers' uptake of interventions that improve their practices. These are additionally influenced by factors operating at individual and broader health system levels. We sought to explore contextual influences on worker motivation, a factor that may modify the effect of an intervention aimed at changing clinical practices in Kenyan hospitals.</p> <p>Methods</p> <p>Franco LM, et al's (Health sector reform and public sector health worker motivation: a conceptual framework. Soc Sci Med. 2002, 54: 1255–66) model of motivational influences was used to frame the study Qualitative methods including individual in-depth interviews, small-group interviews and focus group discussions were used to gather data from 185 health workers during one-week visits to each of eight district hospitals. Data were collected prior to a planned intervention aiming to implement new practice guidelines and improve quality of care. Additionally, on-site observations of routine health worker behaviour in the study sites were used to inform analyses.</p> <p>Results</p> <p>Study settings are likely to have important influences on worker motivation. Effective management at hospital level may create an enabling working environment modifying the impact of resource shortfalls. Supportive leadership may foster good working relationships between cadres, improve motivation through provision of local incentives and appropriately handle workers' expectations in terms of promotions, performance appraisal processes, and good communication. Such organisational attributes may counteract de-motivating factors at a national level, such as poor schemes of service, and enhance personally motivating factors such as the desire to maintain professional standards.</p> <p>Conclusion</p> <p>Motivation is likely to influence powerfully any attempts to change or improve health worker and hospital practices. Some factors influencing motivation may themselves be influenced by the processes chosen to implement change.</p

Quality of hospital care for sick newborns and severely malnourished children in Kenya: A two-year descriptive study in 8 hospitals

BACKGROUND: Given the high mortality associated with neonatal illnesses and severe malnutrition and the development of packages of interventions that provide similar challenges for service delivery mechanisms we set out to explore how well such services are provided in Kenya. METHODS: As a sub-component of a larger study we evaluated care during surveys conducted in 8 rural district hospitals using convenience samples of case records. After baseline hospitals received either a full multifaceted intervention (intervention hospitals) or a partial intervention (control hospitals) aimed largely at improving inpatient paediatric care for malaria, pneumonia and diarrhea/dehydration. Additional data were collected to: i) examine the availability of routine information at baseline and their value for morbidity, mortality and quality of care reporting, and ii) compare the care received against national guidelines disseminated to all hospitals. RESULTS: Clinical documentation for neonatal and malnutrition admissions was often very poor at baseline with case records often entirely missing. Introducing a standard newborn admission record (NAR) form was associated with an increase in median assessment (IQR) score to 25/28 (22-27) from 2/28 (1-4) at baseline. Inadequate and incorrect prescribing of penicillin and gentamicin were common at baseline. For newborns considerable improvements in prescribing in the post baseline period were seen for penicillin but potentially serious errors persisted when prescribing gentamicin, particularly to low-birth weight newborns in the first week of life. Prescribing essential feeds appeared almost universally inadequate at baseline and showed limited improvement after guideline dissemination. CONCLUSION: Routine records are inadequate to assess newborn care and thus for monitoring newborn survival interventions. Quality of documented inpatient care for neonates and severely malnourished children is poor with limited improvement after the dissemination of clinical practice guidelines. Further research evaluating approaches to improving care for these vulnerable groups is urgently needed. We also suggest pre-service training curricula should be better aligned to help improve newborn survival particularly

Development of paediatric quality of inpatient care indicators for low-income countries - A Delphi study

BACKGROUND: Indicators of quality of care for children in hospitals in low-income countries have been proposed, but information on their perceived validity and acceptability is lacking. METHODS: Potential indicators representing structural and process aspects of care for six common conditions were selected from existing, largely qualitative WHO assessment tools and guidelines. We employed the Delphi technique, which combines expert opinion and existing scientific information, to assess their perceived validity and acceptability. Panels of experts, one representing an international panel and one a national (Kenyan) panel, were asked to rate the indicators over 3 rounds and 2 rounds respectively according to a variety of attributes. RESULTS: Based on a pre-specified consensus criteria most of the indicators presented to the experts were accepted: 112/137(82%) and 94/133(71%) for the international and local panels respectively. For the other indicators there was no consensus; none were rejected. Most indicators were rated highly on link to outcomes, reliability, relevance, actionability and priority but rated more poorly on feasibility of data collection under routine conditions. There was moderate to substantial agreement between the two panels of experts. CONCLUSIONS: This Delphi study provided evidence for the perceived usefulness of most of a set of measures of quality of hospital care for children proposed for use in low-income countries. However, both international and local experts expressed concerns that data for many process-based indicators may not currently be available. The feasibility of widespread quality assessment and responsiveness of indicators to intervention should be examined as part of continued efforts to improve approaches to informative hospital quality assessment