'Do you trust those data?'-a mixed-methods study assessing the quality of data reported by community health workers in Kenya and Malawi.

High-quality data are essential to monitor and evaluate community health worker (CHW) programmes in low- and middle-income countries striving towards universal health coverage. This mixed-methods study was conducted in two purposively selected districts in Kenya (where volunteers collect data) and two in Malawi (where health surveillance assistants are a paid cadre). We calculated data verification ratios to quantify reporting consistency for selected health indicators over 3 months across 339 registers and 72 summary reports. These indicators are related to antenatal care, skilled delivery, immunization, growth monitoring and nutrition in Kenya; new cases, danger signs, drug stock-outs and under-five mortality in Malawi. We used qualitative methods to explore perceptions of data quality with 52 CHWs in Kenya, 83 CHWs in Malawi and 36 key informants. We analysed these data using a framework approach assisted by NVivo11. We found that only 15% of data were reported consistently between CHWs and their supervisors in both contexts. We found remarkable similarities in our qualitative data in Kenya and Malawi. Barriers to data quality mirrored those previously reported elsewhere including unavailability of data collection and reporting tools; inadequate training and supervision; lack of quality control mechanisms; and inadequate register completion. In addition, we found that CHWs experienced tensions at the interface between the formal health system and the communities they served, mediated by the social and cultural expectations of their role. These issues affected data quality in both contexts with reports of difficulties in negotiating gender norms leading to skipping sensitive questions when completing registers; fabrication of data; lack of trust in the data; and limited use of data for decision-making. While routine systems need strengthening, these more nuanced issues also need addressing. This is backed up by our finding of the high value placed on supportive supervision as an enabler of data quality

Motivation of health surveillance assistants in Malawi: A qualitative study

Background: Motivation of health workers is a critical component of performance and is shaped by multiple factors. This study explored factors that influence motivation of health surveillance assistants (HSAs) in Malawi, with the aim of identifying interventions that can be applied to enhance motivation and performance of HSAs.Methods: A qualitative study capturing the perspectives of purposively selected participants was conducted in two districts: Salima and Mchinji. Participants included HSAs, health managers, and various community members. Data were collected through focus group discussions (n = 16) and in-depth interviews (n = 44). The study sample was comprised of 112 women and 65 men. Qualitative data analysis was informed by existing frameworks on factors influencing health worker motivation.Results: Our analysis identified five key themes shaping HSA motivation: salary, accommodation, human resource management, supplies and logistics, and community links. Each of these played out at different levels—individual, family, community, and organisational—with either positive or negative effects. Demotivating factors related primarily to the organisational level, while motivating factors were more often related to individual, family, and community levels. A lack of financial incentives and shortages of basic supplies and materials were key factors demotivating HSAs. Supervision was generally perceived as unsupportive, uncoordinated, and top-down. Most HSAs complained of heavy workload. Many HSAs felt further recognition and support from the Ministry of Health, and the development of a clear career pathway would improve their motivation.Conclusions: Factors shaping motivation of HSAs are complex and multilayered; experiences at one level will impact other levels. Interventions are required to enhance HSA motivation, including strengthening the supervision system, developing career progression pathways, and ensuring clear and transparent incentives. HSAs have unique experiences, and there is need to hear and address these to better enable HSAs to cope with the challenging conditions they work in

Does supportive supervision enhance community health worker motivation? A mixed-methods study in four African countries.

Supportive supervision is an important element of community health worker (CHW) programmes and is believed to improve CHW motivation and performance. A group supervision intervention, which included training and mentorship of supervisors, was implemented in Ethiopia, Kenya, Malawi and Mozambique. In three of the countries, this was combined with individual and/or peer supervision. A mixed-methods implementation study was conducted to assess the effect of the supervision intervention on CHWs' perceptions of supervision and CHW motivation-related outcomes. In total, 153 in-depth interviews were conducted with CHWs, their supervisors and managers. In addition, questionnaires assessing perceived supervision and motivation-related outcomes (organizational and community commitment, job satisfaction and conscientiousness) were administered to a total of 278 CHWs pre- and post-intervention, and again after 1 year. Interview transcripts were thematically analysed using a coding framework. Changes in perceived supervision and motivation-related outcomes were assessed using Friedman's ANOVA and post hoc Wilcoxon signed-rank tests. Interview participants reported that the supervision intervention improved CHW motivation. In contrast, the quantitative survey found no significant changes for measures of perceived supervision and inconsistent changes in motivation-related outcomes. With regard to the process of supervision, the problem-solving focus, the sense of joint responsibilities and team work, cross-learning and skill sharing, as well as the facilitating and coaching role of the supervisor, were valued. The empowerment and participation of supervisees in decision making also emerged in the analysis, albeit to a lesser extent. Although qualitative and quantitative findings differed, which could be related to the slightly different focus of methods used and a 'ceiling effect' limiting the detection of observable differences from the survey, the study suggests that there is potential for integrating supportive group supervision models in CHW programmes. A combination of group with individual or peer supervision, preferably accompanied with methods that assess CHW performance and corresponding feedback systems, could yield improved motivation and performance

Is quality affordable for community health systems? Costs of integrating quality improvement into close-to-community health programmes in five low-income and middle-income countries.

INTRODUCTION: Countries aspiring to universal health coverage view close-to-community (CTC) providers as a low-cost means of increasing coverage. However, due to lack of coordination and unreliable funding, the quality of large-scale CTC healthcare provision is highly variable and routine data about service quality are not trustworthy. Quality improvement (QI) approaches are a means of addressing these issues, yet neither the costs nor the budget impact of integrating QI approaches into CTC programme costs have been assessed. METHODS: This paper examines the costs and budget impact of integrating QI into existing CTC health programmes in five countries (Ethiopia, Indonesia, Kenya, Malawi, Mozambique) between 2015 and 2017. The intervention involved: (1) QI team formation; (2) Phased training interspersed with supportive supervision; which resulted in (3) QI teams independently collecting and analysing data to conduct QI interventions. Project costs were collected using an ingredients approach from a health systems perspective. Based on project costs, costs of local adoption of the intervention were modelled under three implementation scenarios. RESULTS: Annualised economic unit costs ranged from $62 in Mozambique to$254 in Ethiopia per CTC provider supervised, driven by the context, type of community health model and the intensity of the intervention. The budget impact of Ministry-led QI for community health is estimated at 0.53% or less of the general government expenditure on health in all countries (and below 0.03% in three of the five countries). CONCLUSION: CTC provision is a key component of healthcare delivery in many settings, so QI has huge potential impact. The impact is difficult to establish conclusively, but as a first step we have provided evidence to assess affordability of QI for community health. Further research is needed to assess whether QI can achieve the level of benefits that would justify the required investment

Measuring motivation among close-to-community health workers: developing the CTC Provider Motivational Indicator Scale across six countries

Background: Close-to-community (CTC) health service providers are a cost-effective and important resource in the promotion of and increasing access to health services. However, many CTC provider programmes suffer from high rates of de-motivation and attrition due to inadequate support systems. Recent literature has identified the lack of rigorous approaches towards measuring and monitoring motivation among CTC providers as an important gap. Building on scales used in previous studies, we set out to develop a short, simple-to-administer scale to monitor and measure indicators of CTC provider motivation across CTC programmes implemented in six countries: Ethiopia, Kenya, Malawi, Mozambique, Indonesia, and Bangladesh. Methods: We used focus group discussions (n = 18) and interviews (n = 106) conducted with CTC providers across all six countries, applying thematic analysis techniques to identify key determinants of motivation across these contexts. These themes were then used to carry out a systematic search of the literature, to identify existing scales or questionnaires developed for the measurement of these themes. A composite 24-item scale was then administered to CTC providers (n = 695) across the six countries. Survey responses were subsequently randomly assigned to one of two datasets: the first for scale refinement, using exploratory techniques, and the second for factorial validation. Confirmatory factor analysis was applied to both datasets. Results: Results suggest a 12-item, four-factor structure, measuring community commitment, organisational commitment, job satisfaction, and work conscientiousness as common indicators of motivation among CTC providers across the six countries. Conclusions: Consistent with previous studies, findings support the inclusion of job satisfaction, organisational commitment, and work conscientiousness within the CTC Provider Motivation Indicator Scale. In addition, findings further supported the addition of a fourth, community commitment, sub-scale. Practical applications of the revised scale, including how it can be applied to monitor motivation levels within CTC provider programming, are discussed. Keywords: Close-to-community health workers, Community health workers, Motivation, LMIC

How do decision-makers use evidence in community health policy and financing decisions? A qualitative study and conceptual framework in four African countries.

Various investments could help countries deliver on the universal health coverage (UHC) goals set by the global community; community health is a pillar of many national strategies towards UHC. Yet despite resource mobilization towards this end, little is known about the potential costs and value of these investments, as well as how evidence on the same would be used in related decisions. This qualitative study was conducted to understand the use of evidence in policy and financing decisions for large-scale community health programmes in low- and middle-income countries. Through key informant interviews with 43 respondents in countries with community health embedded in national UHC strategies (Ethiopia, Kenya, Malawi, Mozambique) and at global institutions, we investigated evidence use in community health financing and policy decision-making, as well as evidentiary needs related to community health data for decision-making. We found that evidence use is limited at all levels, in part due to a perceived lack of high-quality, relevant evidence. This perception stems from two main areas: first, desire for local evidence that reflects the context, and second, much existing economic evidence does not deal with what decision-makers value when it comes to community health systems-i.e. coverage and (to a lesser extent) quality. Beyond the evidence gap, there is limited capacity to assess and use the evidence. Elected officials also face political challenges to disinvestment as well as structural obstacles to evidence use, including the outsized influence of donor priorities. Evaluation data must to speak to decision-maker interests and constraints more directly, alongside financiers of community health providing explicit guidance and support on the role of evidence use in decision-making, empowering national decision-makers. Improved data quality, increased relevance of evidence and capacity for evidence use can drive improved efficiency of financing and evidence-based policymaking

A new scale to assess health-facility level management: the development and validation of the facility management scale in Ghana, Uganda, and Malawi

Background: The increased recognition of governance, leadership, and management as determinants of health system performance has prompted calls for research focusing on the nature, quality, and measurement of this key health system building block. In low- or middle-income contexts (LMIC), where facility-level management and performance remain a challenge, valid tools to measure management have the potential to boost performance and accelerate improvements. We, therefore, sought to develop a Facility-level Management Scale (FMS) and test its reliability in the psychometric properties in three African contexts. Methods: The FMS was administered to 881 health workers in; Ghana (n = 287; 32.6%), Malawi (n = 66; 7.5%) and Uganda (n = 528; 59.9%). Half of the sample data was randomly subjected to exploratory factor analysis (EFA) and Monte Carlo Parallel Component Analysis to explore the FMS’ latent structure. The construct validity of this structure was then tested on the remaining half of the sample using confirmatory factor analysis (CFA). The FMS’ convergent and divergent validity, as well as internal consistency, were also tested. Results: Findings from the EFA and Monte Carlo PCA suggested the retention of three factors (labelled ‘Supportive Management’, ‘Resource Management’ and ‘Time management’). The 3-factor solution explained 51% of the variance in perceived facility management. These results were supported by the results of the CFA (N = 381; χ2 = 256.8, df = 61, p < 0.001; CFI = 0.94; TLI = 0.92; RMSEA [95% CI] = 0.065 [0.057–0.074]; SRMR = 0.047). Conclusion: The FMS is an open-access, short, easy-to-administer scale that can be used to assess how health workers perceive facility-level management in LMICs. When used as a regular monitoring tool, the FMS can identify key strengths or challenges pertaining to time, resources, and supportive management functions at the health facility level

From PERFORM to PERFORM2Scale: Lessons from scaling-up a health management strengthening intervention to support Universal Health Coverage in three African countries

Strengthening management and leadership competencies among district and local health managers has emerged as a common approach for health systems strengthening and to achieve Universal Health Coverage (UHC). While the literature is rich with localised examples of initiatives that aim to strengthen the capacity of district or local health managers, particularly in sub-Saharan Africa, considerably less attention is paid to the science of how to scale-up these initiatives. The aim of this paper is thus to examine the process of scaling-up a management strengthening intervention (MSI) and identify new knowledge and key lessons learned that can be used to inform the scale-up process of other complex health interventions, in support of UHC. Qualitative methods were used to identify lessons learned from scaling-up the MSI in Ghana, Malawi and Uganda. We conducted 14 interviews with district health management team members, three scale-up assessments with 20 scale-up stakeholders, and three reflection discussions with 11 research team members. We also kept records of activities throughout MSI and scale-up implementation. Data was recorded, transcribed, and analysed against the Theory of Change to identify both scale-up outcomes and the factors affecting these outcomes. The MSI was ultimately scaled-up across 27 districts. Repeated MSI cycles over time were found to foster greater feelings of autonomy among district health management teams (DHMTs) to address longstanding local problems, a more innovative use of existing resources without relying on additional funding, and improved teamwork. The use of ‘resource teams’ and the emergence of MSI ‘champions’, were both instrumental in supporting scale-up efforts. Challenges to the sustainability of the MSI include limited government buy-in and lack of sustained financial investment

Care for Child Development in rural Malawi – a model feasibility and pilot study

Evidence demonstrates that encouraging stimulation, early communication, and nutrition improves child development. Detailed feasibility studies in real‐world situations in Africa are limited. We piloted Care for Child Development through six health surveillance assistants (HSAs) in group and individual sessions with 60 caregivers and children <2 years and assessed recruitment, frequency, timings, and quality of intervention. We collected baseline/endline anthropometric, child development (MDAT), maternal stress (SRQ), and family care indicators (FCIs) data and determined acceptability through 20 interviews with caregivers and HSAs. HSAs could only provide coverage on 14.2% of eligible children in their areas; 86% of group sessions and a mean of 3.6/12 individual sessions offered to mothers were completed. Pre‐ and post‐assessment of children demonstrated significant changes in MDAT language and social Z‐scores and FCIs. Caregivers perceived sessions as beneficial and HSAs good leaders but that they could be provided through other mechanisms. Integrated Care for Child Development programs for 0–2 years old are readily accepted in Malawi, but they are not feasible to conduct universally through HSAs due to limited coverage; other models need to be considered

How to scale-up: a comparative case study of scaling up a district health management strengthening intervention in Ghana, Malawi and Uganda

Background The need to scale up public health interventions in low- and middle-income countries to ensure equitable and sustainable impact is widely acknowledged. However, there has been little understanding of how projects have sought to address the importance of scale-up in the design and implementation of their initiatives. This paper aims to gain insight into the facilitators of the scale-up of a district-level health management strengthening intervention in Ghana, Malawi and Uganda. Methods The study took a comparative case study approach with two rounds of data collection (2019 and 2021) in which a combination of different qualitative methods was applied. Interviews and group discussions took place with district, regional and national stakeholders who were involved in the implementation and scale-up of the intervention. Results A shared vision among the different stakeholders about how to institutionalize the intervention into the existing system facilitated scale-up. The importance of champions was also identified, as they influence buy-in from key decision makers, and when decision makers are convinced, political and financial support for scale-up can increase. In two countries, a specific window of opportunity facilitated scale-up. Taking a flexible approach towards scale-up, allowing adaptations of the intervention and the scale-up strategy to the context, was also identified as a facilitator. The context of decentralization and the politics and power relations between stakeholders involved also influenced scale-up. Conclusions Despite the identification of the facilitators of the scale-up, full integration of the intervention into the health system has proven challenging in all countries. Approaching scale-up from a systems change perspective could be useful in future scale-up efforts, as it focuses on sustainable systems change at scale (e.g. improving district health management) by testing a combination of interventions that could contribute to the envisaged change, rather than horizontally scaling up and trying to embed one particular intervention in the system