Implementation of a novel ultrasound training programme for midwives in Malawi:A mixed methods evaluation using the RE-AIM framework

IntroductionDespite recommendation that all women receive an ultrasound in pregnancy prior to 24 weeks', this remains unavailable to many women in low-income countries where trained practitioners are scarce. Although many programmes have demonstrated efficacy, few have achieved longterm sustainability, with a lack of information about how best to implement such programmes. This mixed-methods study aimed to evaluate the implementation of a novel education package to teach ultrasound-naive midwives in Malawi basic obstetric ultrasound, assessing its impact in the context of the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework.MethodsThe study ran across six sites in Malawi between October 2020 and June 2021, encompassing three phases; pre-implementation, implementation and post-implementation. Twenty nine midwives underwent a bespoke education package with matched pre and post course surveys assessed their knowledge, attitudes and confidence and "hands on" assessments evaluating practical skills. Training evaluation forms and in-depth interviews explored their satisfaction with the package, with repeat assessment and remote image review evaluating maintenance of skills.Results28/29 midwives completed the training, with significant increases in knowledge, confidence and practical skills. Adherence to the education package varied, however many changes to the proposed methodology were adaptive and appeared to facilitate the efficacy of the programme. Unfortunately, despite reporting approval regarding the training itself, satisfaction regarding supervision and follow up was mixed, reflecting the difficulties encountered with providing ongoing in-person and remote support.ConclusionThis programme was successful in improving trainees' knowledge, confidence and skill in performing basic obstetric ultrasound, largely on account of an adaptive approach to implementation. The maintenance of ongoing support was challenging, reflected by trainee dissatisfaction. By evaluating the success of this education package based on its implementation and not just its efficacy, we have generated new insights into the barriers to sustainable upscale, specifically those surrounding maintenance

Training in Ultrasound to Determine Gestational Age (TUDA): Evaluation of a Novel Education Package to Teach Ultrasound-Naive Midwives Basic Obstetric Ultrasound in Malawi

IntroductionAlthough ultrasound to determine gestational age is fundamental to the optimum management of pregnancy and is recommended for all women by the World Health Organisation, it remains unavailable to many women in low-income countries where trained practitioners are scarce. This study aimed to evaluate a novel, context-specific education package to teach midwives basic obstetric ultrasound, including the determination of gestational age by measurement of fetal femur length.MethodsThe study was conducted across six sites in Malawi in January 2021. Following a virtual “training of the trainers”, local teams delivered a 10-day programme encompassing both didactic and “hands on” components. Matched pre and post course tests assessed participants' knowledge of key concepts, with Objective Structured Clinical Examinations used to evaluate practical skills. To achieve a pass, trainees were required to establish the gestational age to within ±7 days of an experienced practitioner and achieve an overall score of &amp;gt;65% on five consecutive occasions. A matched pre and post course survey explored participants' attitudes and confidence in performing ultrasound examinations.ResultsOf the 29 midwives who participated, 28 finished the programme and met the criteria specified to pass. 22 midwives completed the matched knowledge tests, with the mean (SD) score increasing from 10.2 (3.3) to 18 (2.5) after training (P &amp;lt;0.0001). Mean difference 7.9, 95% CI 6.5–9.2. Midwives passed 87% of the Observed Structured Clinical Examinations, establishing the gestational age to within ±7 days of an experienced practitioner in 89% of assessments. Beliefs regarding the importance of antenatal ultrasound increased post course (p = 0.02), as did confidence in performing ultrasound examinations (p &amp;lt;0.0001).ConclusionThis study demonstrates not only that ultrasound-naive practitioners can be taught to perform basic obstetric ultrasound dating scans, confidently and competently, after 10 days of training, but also that local teams can be orientated to successfully deliver the programme virtually. Previous ultrasound training initiatives, while often more comprehensive in their syllabus, have been of considerably longer duration and this is likely to be a barrier to upscaling opportunities. We propose that this focused training increases the potential for widescale and sustainable implementation.</jats:sec

Implementation of a novel ultrasound training programme for midwives in Malawi: A mixed methods evaluation using the RE-AIM framework

INTRODUCTION: Despite recommendation that all women receive an ultrasound in pregnancy prior to 24 weeks', this remains unavailable to many women in low-income countries where trained practitioners are scarce. Although many programmes have demonstrated efficacy, few have achieved longterm sustainability, with a lack of information about how best to implement such programmes. This mixed-methods study aimed to evaluate the implementation of a novel education package to teach ultrasound-naive midwives in Malawi basic obstetric ultrasound, assessing its impact in the context of the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework. METHODS: The study ran across six sites in Malawi between October 2020 and June 2021, encompassing three phases; pre-implementation, implementation and post-implementation. Twenty nine midwives underwent a bespoke education package with matched pre and post course surveys assessed their knowledge, attitudes and confidence and "hands on" assessments evaluating practical skills. Training evaluation forms and in-depth interviews explored their satisfaction with the package, with repeat assessment and remote image review evaluating maintenance of skills. RESULTS: 28/29 midwives completed the training, with significant increases in knowledge, confidence and practical skills. Adherence to the education package varied, however many changes to the proposed methodology were adaptive and appeared to facilitate the efficacy of the programme. Unfortunately, despite reporting approval regarding the training itself, satisfaction regarding supervision and follow up was mixed, reflecting the difficulties encountered with providing ongoing in-person and remote support. CONCLUSION: This programme was successful in improving trainees' knowledge, confidence and skill in performing basic obstetric ultrasound, largely on account of an adaptive approach to implementation. The maintenance of ongoing support was challenging, reflected by trainee dissatisfaction. By evaluating the success of this education package based on its implementation and not just its efficacy, we have generated new insights into the barriers to sustainable upscale, specifically those surrounding maintenance

Informing prevention of stillbirth and preterm birth in Malawi:development of a minimum dataset for health facilities participating in the DIPLOMATIC collaboration

OBJECTIVE: The global research group, DIPLOMATIC (Using eviDence, Implementation science, and a clinical trial PLatform to Optimise MATernal and newborn health in low Income Countries), aims to reduce stillbirths and preterm births and optimise outcomes for babies born preterm. Minimum datasets for routine data collection in healthcare facilities participating in DIPLOMATIC (initially in Malawi) were designed to assist understanding of baseline maternal and neonatal care processes and outcomes, and facilitate evaluation of improvement interventions and pragmatic clinical trials. DESIGN: Published and grey literature was reviewed alongside extensive in-country consultation to define relevant clinical best practice guidance, and the existing local data and reporting infrastructure, to identify requirements for the minimum datasets. Data elements were subjected to iterative rounds of consultation with topic experts in Malawi and Scotland, the relevant Malawian professional bodies and the Ministry of Health in Malawi to ensure relevance, validity and feasibility. SETTING: Antenatal, maternity and specialist neonatal care in Malawi. RESULTS: The resulting three minimum datasets cover the maternal and neonatal healthcare journey for antenatal, maternity and specialist neonatal care, with provision for effective linkage of records for mother/baby pairs. They can facilitate consistent, precise recording of relevant outcomes (stillbirths, preterm births, neonatal deaths), risk factors and key care processes. CONCLUSIONS: Poor quality routine data on care processes and outcomes constrain healthcare system improvement. The datasets developed for implementation in DIPLOMATIC partner facilities reflect, and hence support delivery of, internationally agreed best practice for maternal and newborn care in low-income settings. Informed by extensive consultation, they are designed to integrate with existing local data infrastructure and reporting as well as meeting research data needs. This work provides a transferable example of strengthening data infrastructure to underpin a learning healthcare system approach in low-income settings.DIPLOMATIC is funded by the UK National Institute for Health Research

Exploring the effect of implementation and context on a stepped-wedge randomised controlled trial of a vital sign triage device in routine maternity care in low-resource settings

© 2019 The Author(s). Background: Interventions aimed at reducing maternal mortality are increasingly complex. Understanding how complex interventions are delivered, to whom, and how they work is key in ensuring their rapid scale-up. We delivered a vital signs triage intervention into routine maternity care in eight low- and middle-income countries with the aim of reducing a composite outcome of morbidity and mortality. This was a pragmatic, hybrid effectiveness-implementation stepped-wedge randomised controlled trial. In this study, we present the results of the mixed-methods process evaluation. The aim was to describe implementation and local context and integrate results to determine whether differences in the effect of the intervention across sites could be explained. Methods: The duration and content of implementation, uptake of the intervention and its impact on clinical management were recorded. These were integrated with interviews (n = 36) and focus groups (n = 19) at 3 months and 6-9 months after implementation. In order to determine the effect of implementation on effectiveness, measures were ranked and averaged across implementation domains to create a composite implementation strength score and then correlated with the primary outcome. Results: Overall, 61.1% (n = 2747) of health care providers were trained in the intervention (range 16.5% to 89.2%) over a mean of 10.8 days. Uptake and acceptability of the intervention was good. All clusters demonstrated improved availability of vital signs equipment. There was an increase in the proportion of women having their blood pressure measured in pregnancy following the intervention (79.2% vs. 97.6%; OR 1.30 (1.29-1.31)) and no significant change in referral rates (3.7% vs. 4.4% OR 0.89; (0.39-2.05)). Availability of resources and acceptable, effective referral systems influenced health care provider interaction with the intervention. There was no correlation between process measures within or between domains, or between the composite score and the primary outcome. Conclusions: This process evaluation has successfully described the quantity and quality of implementation. Variation in implementation and context did not explain differences in the effectiveness of the intervention on maternal mortality and morbidity. We suggest future trials should prioritise in-depth evaluation of local context and clinical pathways. Trial registration: Trial registration: ISRCTN41244132. Registered on 2 Feb 2016

Mapping the medical outcomes study HIV health survey (MOS-HIV) to the EuroQoL 5 Dimension (EQ-5D-3L) utility index

10.1186/s12955-019-1135-8Health and Quality of Life Outcomes1718

Effect of a novel vital sign device on maternal mortality and morbidity in low-resource settings: a pragmatic, stepped-wedge, cluster-randomised controlled trial

Summary: Background: In 2015, an estimated 303 000 women died in pregnancy and childbirth. Obstetric haemorrhage, sepsis, and hypertensive disorders of pregnancy account for more than 50% of maternal deaths worldwide. There are effective treatments for these pregnancy complications, but they require early detection by measurement of vital signs and timely administration to save lives. The primary aim of this trial was to determine whether implementation of the CRADLE Vital Sign Alert and an education package into community and facility maternity care in low-resource settings could reduce a composite of all-cause maternal mortality or major morbidity (eclampsia and hysterectomy). Methods: We did a pragmatic, stepped-wedge, cluster-randomised controlled trial in ten clusters across Africa, India, and Haiti, introducing the device into routine maternity care. Each cluster contained at least one secondary or tertiary hospital and their main referral facilities. Clusters crossed over from existing routine care to the CRADLE intervention in one of nine steps at 2-monthly intervals, with CRADLE devices replacing existing equipment at the randomly allocated timepoint. A computer-generated randomly allocated sequence determined the order in which the clusters received the intervention. Because of the nature of the intervention, this trial was not masked. Data were gathered monthly, with 20 time periods of 1 month. The primary composite outcome was at least one of eclampsia, emergency hysterectomy, and maternal death. This study is registered with the ISRCTN registry, number ISRCTN41244132. Findings: Between April 1, 2016, and Nov 30, 2017, among 536 223 deliveries, the primary outcome occurred in 4067 women, with 998 maternal deaths, 2692 eclampsia cases, and 681 hysterectomies. There was an 8% decrease in the primary outcome from 79·4 per 10 000 deliveries pre-intervention to 72·8 per 10 000 deliveries post-intervention (odds ratio [OR] 0·92, 95% CI 0·86–0·97; p=0·0056). After planned adjustments for variation in event rates between and within clusters over time, the unexpected degree of variability meant we were unable to judge the benefit or harms of the intervention (OR 1·22, 95% CI 0·73–2·06; p=0·45). Interpretation: There was an absolute 8% reduction in primary outcome during the trial, with no change in resources or staffing, but this reduction could not be directly attributed to the intervention due to variability. We encountered unanticipated methodological challenges with this trial design, which can provide valuable learning for future research and inform the trial design of future international stepped-wedge trials. Funding: Newton Fund Global Research Programme: UK Medical Research Council; Department of Biotechnology, Ministry of Science & Technology, Government of India; and UK Department of International Development