Interval follow up of a 4-day pilot program to implement the WHO surgical safety checklist at a Congolese hospital

Abstract Background The World Health Organisation Surgical Safety Checklist (SSC) improves surgical outcomes and the research question is no longer ‘does the SSC work?’ but, ‘how to make the SSC work?’ Evidence for implementation strategies in low-income countries is sparse and existing strategies are heavily based on long-term external support. Short but effective implementation programs are required if widespread scale up is to be achieved. We designed and delivered a four-day pilot SSC training course at a single hospital centre in the Republic of Congo, and evaluated the implementation after one year. We hypothesised that participants would still be using the checklist over 50% of the time. Method We taught the four-day SSC training course at Dolisie hospital in February 2014, and undertook a mixed methods impact evaluation based on the Kirkpatrick model in May 2015. SSC implementation was evaluated using self-reported questionnaire with a 3 point Likert scale to assess six key process measures. Learning, behaviour, organisational change and facilitators and inhibitors to change were evaluated with questionnaires, interviews and focus group discussion. Results Seventeen individuals participated in the training and seven (40%) were available for impact evaluation at 15 months. No participant had used the SSC prior to training. Over half the participants were following the six processes measures always or most of the time: confirmation of patient identity and the surgical procedure (57%), assessment of difficult intubation risk (72%), assessment of the risk of major blood loss (86%), antibiotic prophylaxis given before skin incision (86%), use of a pulse oximeter (86%), and counting sponges and instruments (71%). All participants reported positive improvements in teamwork, organisation and safe anesthesia. Most participants reported they worked in helpful, supportive and respectful atmosphere; and could speak up if they saw something that might harm a patient. However, less than half felt able to challenge those in authority. Conclusion Our study demonstrates that a 4-day pilot course for SSC implementation resulted in over 50% of participants using the SSC at 15 months, positive changes in learning, behaviour and organisational change, but less impact on hierarchical culture. The next step is to test our novel implementation strategy in a larger hospital setting

Overcoming challenges in implementing the WHO Surgical Safety Checklist: lessons learnt from using a checklist training course to facilitate rapid scale up in Madagascar

The WHO Surgical Safety Checklist was launched in 2009, and appropriate use reduces mortality, surgical site infections and complications after surgery by up to 50%. Implementation across low-income and middle-income countries has been slow; published evidence is restricted to reports from a few single institutions, and significant challenges to successful implementation have been identified and presented. The Mercy Ships Medical Capacity Building team developed a multidisciplinary 3-day Surgical Safety Checklist training programme designed for rapid wide-scale implementation in all regional referral hospitals in Madagascar. Particular attention was given to addressing previously reported challenges to implementation. We taught 427 participants in 21 hospitals; at 3–4 months postcourse, we collected surveys from 183 participants in 20 hospitals and conducted one focus group per hospital. We used a concurrent embedded approach in this mixed-methods design to evaluate participants’ experiences and behavioural change as a result of the training programme. Quantitative and qualitative data were analysed using descriptive statistics and inductive thematic analysis, respectively. This analysis paper describes our field experiences and aims to report participants’ responses to the training course, identify further challenges to implementation and describe the lessons learnt. Recommendations are given for stakeholders seeking widespread rapid scale up of quality improvement initiatives to promote surgical safety worldwide

Evaluation of a countrywide implementation of the world health organisation surgical safety checklist in Madagascar

Background: The 2009 World Health Organisation (WHO) surgical safety checklist significantly reduces surgical mortality and morbidity (up to 47%). Yet in 2016, only 25% of East African anesthetists regularly use the checklist. Nationwide implementation of the checklist is reported in high-income countries, but in low- and middle-income countries (LMICs) reports of successful implementations are sparse, limited to single institutions and require intensive support. Since checklist use leads to the biggest improvements in outcomes in LMICs, methods of wide-scale implementation are needed. We hypothesized that, using a three-day course, successful wide-scale implementation of the checklist could be achieved, as measured by at least 50% compliance with six basic safety processes at three to four months. We also aimed to determine predictors for checklist utilization. Materials and methods Using a blended educational implementation strategy based on prior pilot studies we designed a three-day dynamic educational course to facilitate widespread implementation of the WHO checklist. The course utilized lectures, film, small group breakouts, participant feedback and simulation to teach the knowledge, skills and behavior changes needed to implement the checklist. In collaboration with the Ministry of Health and local hospital leadership, the course was delivered to 427 multi-disciplinary staff at 21 hospitals located in 19 of 22 regions of Madagascar between September 2015 and March 2016. We evaluated implementation at three to four months using questionnaires (with a 5-point Likert scale) and focus groups. Multivariate linear regression was used to test predictors of checklist utilization. Results: At three to four months, 65% of respondents reported always using the checklist, with another 13% using it in part. Participant’s years in practice, hospital size, or surgical volume did not predict checklist use. Checklist use was associated with counting instruments (p< 0.05), but not with verifying: patient identity, difficult intubation risk, risk of blood loss, prophylactic antibiotic administration, or counting needles and sponges. Conclusion: Use of a multi-disciplinary three-day course for checklist implementation resulted in 78% of participants using the checklist, at three months; and an increase in counting surgical instruments. Successful checklist implementation was not predicted by participant length of medical service, hospital size or surgical volume. If reproducible in other countries, widespread implementation in LMICs becomes a realistic possibility

Evaluation of a countrywide implementation of the world health organisation surgical safety checklist in Madagascar

<div><p>Background</p><p>The 2009 World Health Organisation (WHO) surgical safety checklist significantly reduces surgical mortality and morbidity (up to 47%). Yet in 2016, only 25% of East African anesthetists regularly use the checklist. Nationwide implementation of the checklist is reported in high-income countries, but in low- and middle-income countries (LMICs) reports of successful implementations are sparse, limited to single institutions and require intensive support. Since checklist use leads to the biggest improvements in outcomes in LMICs, methods of wide-scale implementation are needed. We hypothesized that, using a three-day course, successful wide-scale implementation of the checklist could be achieved, as measured by at least 50% compliance with six basic safety processes at three to four months. We also aimed to determine predictors for checklist utilization.</p><p>Materials and methods</p><p>Using a blended educational implementation strategy based on prior pilot studies we designed a three-day dynamic educational course to facilitate widespread implementation of the WHO checklist. The course utilized lectures, film, small group breakouts, participant feedback and simulation to teach the knowledge, skills and behavior changes needed to implement the checklist. In collaboration with the Ministry of Health and local hospital leadership, the course was delivered to 427 multi-disciplinary staff at 21 hospitals located in 19 of 22 regions of Madagascar between September 2015 and March 2016. We evaluated implementation at three to four months using questionnaires (with a 5-point Likert scale) and focus groups. Multivariate linear regression was used to test predictors of checklist utilization.</p><p>Results</p><p>At three to four months, 65% of respondents reported always using the checklist, with another 13% using it in part. Participant’s years in practice, hospital size, or surgical volume did not predict checklist use. Checklist use was associated with counting instruments (p< 0.05), but not with verifying: patient identity, difficult intubation risk, risk of blood loss, prophylactic antibiotic administration, or counting needles and sponges.</p><p>Conclusion</p><p>Use of a multi-disciplinary three-day course for checklist implementation resulted in 78% of participants using the checklist, at three months; and an increase in counting surgical instruments. Successful checklist implementation was not predicted by participant length of medical service, hospital size or surgical volume. If reproducible in other countries, widespread implementation in LMICs becomes a realistic possibility.</p></div

Frequency of self-reported use of the checklist and the six basic safety processes.

<p>Values given as numbers (percentage).</p

Outline of the three-day checklist training program.

<p>Outline of the three-day checklist training program.</p

Multivariate linear regression results with checklist use as the dependant variable.

<p>Multivariate linear regression results with checklist use as the dependant variable.</p