“We don’t trust all data coming from all facilities”: factors influencing the quality of care network data quality in Ethiopia

BACKGROUND: Good quality data are a key to quality health care. In 2017, WHO has launched the Quality of Care Network (QCN) to reduce maternal, newborn and stillbirth mortality via learning and sharing networks. Guided by the principle of equity and dignity, the network members agreed to implement the programme in 2017-2021. OBJECTIVE: This paper seeks to explore how QCN has contributed to improving data quality and to identify factors influencing quality of data in Ethiopia. METHODS: We conducted a qualitative study in selected QCN facilities in Ethiopia using key informant interview and observation methods. We interviewed 40 people at national, sub-national and facility levels. Non-participant observations were carried out in four purposively selected health facilities; we accessed monthly reports from 41 QCN learning facilities. A codebook was prepared following a deductive and inductive analytical approach, coded using Nvivo 12 and thematically analysed. RESULTS: There was a general perception that QCN had improved health data documentation and use in the learning facilities, achieved through coaching, learning and building from pre-existing initiatives. QCN also enhanced the data elements available by introducing a broader set of quality indicators. However, the perception of poor data quality persisted. Factors negatively affecting data quality included a lack of integration of QCN data within routine health system activities, the perception that QCN was a pilot, plus a lack of inclusive engagement at different levels. Both individual and system capabilities needed to be strengthened. CONCLUSION: There is evidence of QCN's contribution to improving data awareness. But a lack of inclusive engagement of actors, alignment and limited skill for data collection and analysis continued to affect data quality and use. In the absence of new resources, integration of new data activities within existing routine health information systems emerged as the most important potential action for positive change

Effectiveness of a multi-country implementation-focused network on quality of care: Delivery of interventions and processes for improved maternal, newborn and child health outcomes

The Network for Improving Quality of Care for Maternal, Newborn and Child Health (QCN) aims to work through learning, action, leadership and accountability. We aimed to evaluate the effectiveness of QCN in these four areas at the global level and in four QCN countries: Bangladesh, Ethiopia, Malawi and Uganda. This mixed method evaluation comprised 2–4 iterative rounds of data collection between 2019–2022, involving stakeholder interviews, hospital observations, QCN members survey, and document review. Qualitative data was analysed using a coding framework developed from underlying theories on network effectiveness, behaviour change, and QCN proposed theory of change. Survey data capturing respondents’ perception of QCN was analysed with descriptive statistics. The QCN global level, led by the WHO secretariat, was effective in bringing together network countries’ governments and global actors via providing online and in-person platforms for communication and learning. In-country, various interventions were delivered in ‘learning districts’, however often separately by different partners in different locations, and pandemic-disrupted. Governance structures for quality of care were set-up, some preceding QCN, and were found to be stronger and better (though often externally) resourced at national than local levels. Awareness of operational plans and network activities differed between countries, was lower at local than national levels, but increased from 2019 to 2022. Engagement with, and value of, QCN was perceived to be higher in Uganda and Bangladesh than in Malawi or Ethiopia. Capacity building efforts were implemented in all countries–yet often dependent on implementing partners and donors. QCN stakeholders agreed 15 core monitoring indicators though data collection was challenging, especially for indicators requiring new or parallel systems. Accountability initiatives remained nascent in 2022. Global and national leadership elements of QCN have been most effective to date, with action, learning and accountability more challenging, partner or donor dependent, remaining to be scaled-up, and pandemic-disrupted

Opportunities to sustain a multi-country quality of care network: Lessons on the actions of four countries Bangladesh, Ethiopia, Malawi, and Uganda

The Quality of Care Network (QCN) is a global initiative that was established in 2017 under the leadership of WHO in 11 low-and- middle income countries to improve maternal, newborn, and child health. The vision was that the Quality of Care Network would be embedded within member countries and continued beyond the initial implementation period: that the Network would be sustained. This paper investigated the experience of actions taken to sustain QCN in four Network countries (Bangladesh, Ethiopia, Malawi, and Uganda) and reports on lessons learned. Multiple iterative rounds of data collection were conducted through qualitative interviews with global and national stakeholders, and non-participatory observation of health facilities and meetings. A total of 241 interviews, 42 facility and four meeting observations were carried out. We conducted a thematic analysis of all data using a framework approach that defined six critical actions that can be taken to promote sustainability. The analysis revealed that these critical actions were present with varying degrees in each of the four countries. Although vulnerabilities were observed, there was good evidence to support that actions were taken to institutionalize the innovation within the health system, to motivate micro-level actors, plan opportunities for reflection and adaptation from the outset, and to support strong government ownership. Two actions were largely absent and weakened confidence in future sustainability: managing financial uncertainties and fostering community ownership. Evidence from four countries suggested that the QCN model would not be sustained in its original format, largely because of financial vulnerability and insufficient time to embed the innovation at the sub-national level. But especially the efforts made to institutionalize the innovation in existing systems meant that some characteristics of QCN may be carried forward within broader government quality improvement initiatives

Individual interactions in a multi-country implementation-focused quality of care network for maternal, newborn and child health: A social network analysis

The Network for Improving Quality of Care for Maternal, Newborn and Child Health (QCN) was established to build a cross-country platform for joint-learning around quality improvement implementation approaches to reduce mortality. This paper describes and explores the structure of the QCN in four countries and at global level. Using Social Network Analysis (SNA), this cross-sectional study maps the QCN networks at global level and in four countries (Bangladesh, Ethiopia, Malawi and Uganda) and assesses the interactions among actors involved. A pre-tested closed-ended structured questionnaire was completed by 303 key actors in early 2022 following purposeful and snowballing sampling. Data were entered into an online survey tool, and exported into Microsoft Excel for data management and analysis. This study received ethical approval as part of a broader evaluation. The SNA identified 566 actors across the four countries and at global level. Bangladesh, Malawi and Uganda had multiple-hub networks signifying multiple clusters of actors reflecting facility or district networks, whereas the network in Ethiopia and at global level had more centralized networks. There were some common features across the country networks, such as low overall density of the network, engagement of actors at all levels of the system, membership of related committees identified as the primary role of actors, and interactions spanning all types (learning, action and information sharing). The most connected actors were facility level actors in all countries except Ethiopia, which had mostly national level actors. The results reveal the uniqueness and complexity of each network assessed in the evaluation. They also affirm the broader qualitative evaluation assessing the nature of these networks, including composition and leadership. Gaps in communication between members of the network and limited interactions of actors between countries and with global level actors signal opportunities to strengthen QCN

"We don't trust all data coming from all facilities": factors influencing the quality of care network data quality in Ethiopia.

BACKGROUND: Good quality data are a key to quality health care. In 2017, WHO has launched the Quality of Care Network (QCN) to reduce maternal, newborn and stillbirth mortality via learning and sharing networks. Guided by the principle of equity and dignity, the network members agreed to implement the programme in 2017-2021. OBJECTIVE: This paper seeks to explore how QCN has contributed to improving data quality and to identify factors influencing quality of data in Ethiopia. METHODS: We conducted a qualitative study in selected QCN facilities in Ethiopia using key informant interview and observation methods. We interviewed 40 people at national, sub-national and facility levels. Non-participant observations were carried out in four purposively selected health facilities; we accessed monthly reports from 41 QCN learning facilities. A codebook was prepared following a deductive and inductive analytical approach, coded using Nvivo 12 and thematically analysed. RESULTS: There was a general perception that QCN had improved health data documentation and use in the learning facilities, achieved through coaching, learning and building from pre-existing initiatives. QCN also enhanced the data elements available by introducing a broader set of quality indicators. However, the perception of poor data quality persisted. Factors negatively affecting data quality included a lack of integration of QCN data within routine health system activities, the perception that QCN was a pilot, plus a lack of inclusive engagement at different levels. Both individual and system capabilities needed to be strengthened. CONCLUSION: There is evidence of QCN's contribution to improving data awareness. But a lack of inclusive engagement of actors, alignment and limited skill for data collection and analysis continued to affect data quality and use. In the absence of new resources, integration of new data activities within existing routine health information systems emerged as the most important potential action for positive change

“We don’t trust all data coming from all facilities”: factors influencing the quality of care network data quality in Ethiopia

Background Good quality data are a key to quality health care. In 2017, WHO has launched the Quality of Care Network (QCN) to reduce maternal, newborn and stillbirth mortality via learning and sharing networks. Guided by the principle of equity and dignity, the network members agreed to implement the programme in 2017–2021. Objective This paper seeks to explore how QCN has contributed to improving data quality and to identify factors influencing quality of data in Ethiopia. Methods We conducted a qualitative study in selected QCN facilities in Ethiopia using key informant interview and observation methods. We interviewed 40 people at national, sub-national and facility levels. Non-participant observations were carried out in four purposively selected health facilities; we accessed monthly reports from 41 QCN learning facilities. A codebook was prepared following a deductive and inductive analytical approach, coded using Nvivo 12 and thematically analysed. Results There was a general perception that QCN had improved health data documentation and use in the learning facilities, achieved through coaching, learning and building from pre-existing initiatives. QCN also enhanced the data elements available by introducing a broader set of quality indicators. However, the perception of poor data quality persisted. Factors negatively affecting data quality included a lack of integration of QCN data within routine health system activities, the perception that QCN was a pilot, plus a lack of inclusive engagement at different levels. Both individual and system capabilities needed to be strengthened. Conclusion There is evidence of QCN’s contribution to improving data awareness. But a lack of inclusive engagement of actors, alignment and limited skill for data collection and analysis continued to affect data quality and use. In the absence of new resources, integration of new data activities within existing routine health information systems emerged as the most important potential action for positive change

QCN papers common country context.

The Network for Improving Quality of Care for Maternal, Newborn and Child Health (QCN) aims to work through learning, action, leadership and accountability. We aimed to evaluate the effectiveness of QCN in these four areas at the global level and in four QCN countries: Bangladesh, Ethiopia, Malawi and Uganda. This mixed method evaluation comprised 2–4 iterative rounds of data collection between 2019–2022, involving stakeholder interviews, hospital observations, QCN members survey, and document review. Qualitative data was analysed using a coding framework developed from underlying theories on network effectiveness, behaviour change, and QCN proposed theory of change. Survey data capturing respondents’ perception of QCN was analysed with descriptive statistics. The QCN global level, led by the WHO secretariat, was effective in bringing together network countries’ governments and global actors via providing online and in-person platforms for communication and learning. In-country, various interventions were delivered in ‘learning districts’, however often separately by different partners in different locations, and pandemic-disrupted. Governance structures for quality of care were set-up, some preceding QCN, and were found to be stronger and better (though often externally) resourced at national than local levels. Awareness of operational plans and network activities differed between countries, was lower at local than national levels, but increased from 2019 to 2022. Engagement with, and value of, QCN was perceived to be higher in Uganda and Bangladesh than in Malawi or Ethiopia. Capacity building efforts were implemented in all countries–yet often dependent on implementing partners and donors. QCN stakeholders agreed 15 core monitoring indicators though data collection was challenging, especially for indicators requiring new or parallel systems. Accountability initiatives remained nascent in 2022. Global and national leadership elements of QCN have been most effective to date, with action, learning and accountability more challenging, partner or donor dependent, remaining to be scaled-up, and pandemic-disrupted.</div

Network Perceived as Valuable (survey data).

The Network for Improving Quality of Care for Maternal, Newborn and Child Health (QCN) aims to work through learning, action, leadership and accountability. We aimed to evaluate the effectiveness of QCN in these four areas at the global level and in four QCN countries: Bangladesh, Ethiopia, Malawi and Uganda. This mixed method evaluation comprised 2–4 iterative rounds of data collection between 2019–2022, involving stakeholder interviews, hospital observations, QCN members survey, and document review. Qualitative data was analysed using a coding framework developed from underlying theories on network effectiveness, behaviour change, and QCN proposed theory of change. Survey data capturing respondents’ perception of QCN was analysed with descriptive statistics. The QCN global level, led by the WHO secretariat, was effective in bringing together network countries’ governments and global actors via providing online and in-person platforms for communication and learning. In-country, various interventions were delivered in ‘learning districts’, however often separately by different partners in different locations, and pandemic-disrupted. Governance structures for quality of care were set-up, some preceding QCN, and were found to be stronger and better (though often externally) resourced at national than local levels. Awareness of operational plans and network activities differed between countries, was lower at local than national levels, but increased from 2019 to 2022. Engagement with, and value of, QCN was perceived to be higher in Uganda and Bangladesh than in Malawi or Ethiopia. Capacity building efforts were implemented in all countries–yet often dependent on implementing partners and donors. QCN stakeholders agreed 15 core monitoring indicators though data collection was challenging, especially for indicators requiring new or parallel systems. Accountability initiatives remained nascent in 2022. Global and national leadership elements of QCN have been most effective to date, with action, learning and accountability more challenging, partner or donor dependent, remaining to be scaled-up, and pandemic-disrupted.</div

PLOS GLOBAL HEALTH QCN Evaluation Collection 2-page summary.

PLOS GLOBAL HEALTH QCN Evaluation Collection 2-page summary.</p

Network awareness (survey data).

The Network for Improving Quality of Care for Maternal, Newborn and Child Health (QCN) aims to work through learning, action, leadership and accountability. We aimed to evaluate the effectiveness of QCN in these four areas at the global level and in four QCN countries: Bangladesh, Ethiopia, Malawi and Uganda. This mixed method evaluation comprised 2–4 iterative rounds of data collection between 2019–2022, involving stakeholder interviews, hospital observations, QCN members survey, and document review. Qualitative data was analysed using a coding framework developed from underlying theories on network effectiveness, behaviour change, and QCN proposed theory of change. Survey data capturing respondents’ perception of QCN was analysed with descriptive statistics. The QCN global level, led by the WHO secretariat, was effective in bringing together network countries’ governments and global actors via providing online and in-person platforms for communication and learning. In-country, various interventions were delivered in ‘learning districts’, however often separately by different partners in different locations, and pandemic-disrupted. Governance structures for quality of care were set-up, some preceding QCN, and were found to be stronger and better (though often externally) resourced at national than local levels. Awareness of operational plans and network activities differed between countries, was lower at local than national levels, but increased from 2019 to 2022. Engagement with, and value of, QCN was perceived to be higher in Uganda and Bangladesh than in Malawi or Ethiopia. Capacity building efforts were implemented in all countries–yet often dependent on implementing partners and donors. QCN stakeholders agreed 15 core monitoring indicators though data collection was challenging, especially for indicators requiring new or parallel systems. Accountability initiatives remained nascent in 2022. Global and national leadership elements of QCN have been most effective to date, with action, learning and accountability more challenging, partner or donor dependent, remaining to be scaled-up, and pandemic-disrupted.</div