Compliance with the surgical safety checklist in Switzerland: an observational multicenter study based on self-reported data.

BACKGROUND Since publication of the surgical safety checklist by the WHO in 2009, it has been introduced in many hospitals. However, frequency and quality of surgical safety checklist use is often low probably limiting the effectiveness of the checklist in preventing patient harm. The focus of this study was to examine the current state of compliance with the surgical safety checklist in Switzerland and to evaluate how the data relates to international comparative data. METHODS Between November 2020 and March 2021 twelve hospitals with 15 sites collected for at least 200 surgical interventions each whether the three sections of the surgical safety checklist (Sign In, Team Time Out, Sign Out) have been applied. This data collection was part of a large quality improvement project focusing on measuring and improving compliance with the surgical safety checklist via peer observation and feedback. Descriptive statistics were used to analyze the data; chi-square tests were used to compare sub-samples. RESULTS The hospitals collected valid compliance data for 8622 surgical interventions. Mean compliance rate was 91% when distinguishing between the two categories applied (including partially applied) and not applied. In line with previous research, Sign In (93%) and Team Time Out (94%) sections have been applied more frequently than Sign Out (86%). All three surgical safety checklist sections have been applied in 79% of the surgical interventions, no sections in 1%. CONCLUSIONS The results of this study indicate that the overall application of the surgical safety checklist in Switzerland can be considered high, although the completeness, especially of the Sign Out section, could be improved. At present, it seems difficult to compare compliance rates from different studies as measurement methods and definitions of compliance vary widely. A systematization and homogenization of the methodology within, but also beyond, national borders is desirable for the future

Process and outcome evaluation of an organizational-level stress management intervention in Switzerland

This field study evaluates the process and outcome of an organizational-level stress management intervention (SMI) in eight companies, taking into account the lessons learned from previous evaluation research. It utilizes the RE-AIM evaluation framework to capture the Reach and Adoption of the intervention in the companies, the appraisal of the Implementation process and the project's Effectiveness and Maintenance with a range of qualitative and quantitative methods. It applies an adapted research design in the context of a field study involving entire organizations, retrospectively assigning study participants to comparison groups. The results of a longitudinal analysis (n = 1400) showed that the SMI had a positive impact on the participants' job demands and resources, when controlled for baseline levels. Qualitative data analysis revealed that the companies had built capacities for ongoing health promotion and showed what issues must be borne in mind when implementing such projects. The study also showed that participation in such interventions alone does not suffice to achieve the desired impact, but that the individual participants' appraisal of the intervention and the collective involvement of the teams must be further researched to fully understand how change occur

Development of a Generic Workshop Appraisal Scale (WASC) for Organizational Health Interventions and Evaluation

This study presents the development of a generic workshop appraisal scale (WASC) for the evaluation of organizational health interventions. Based on the session evaluation questionnaire (SEQ) by Stiles (1980), we developed a short, generic 10-item scale with pairs of adjectives, covering five facets: comprehensibility, relevance, novelty, activation, and valence. Our study is based on N = 499 employees from four organizations who participated in 41 workshops and filled out an evaluation questionnaire on-site. The questionnaire contained the newly developed WASC, as well as items capturing satisfaction with the developed output and outcome expectancies. Results from confirmative factor analysis confirmed the hypothesized five-factor structure of the WASC. The factor structure was found to be nearly invariant across the four organizations, a result that needs to be replicated in larger samples. Analysis of intra-class correlations indicated that 25% of the variance in workshop appraisal can be explained at workshop level. Hereby, perceived relevance and novelty exhibited lower amounts of shared variance, indicating that corresponding workshop appraisals are influenced more by individual factors and less by group dynamics. Furthermore, results from mediation analysis revealed that participants' workshop appraisals were significantly related to their outcome expectancies, and that this relationship was mediated by output satisfaction. Again, the facets showed differential effects: Relevance and comprehensibility seem to contribute most to the total effect on outcome expectancy, followed by activation, whereas valence and especially novelty play a minor role. Taken together, participants' workshop appraisals - together with output satisfaction and outcome expectancy - may be helpful for monitoring the implementation process and allow for corrective action if necessary

Training Situational Awareness for Patient Safety in a Room of Horrors: An Evaluation of a Low-Fidelity Simulation Method.

BACKGROUND To protect patients from potential hazards of hospitalization, health care professionals need an adequate situational awareness. The Room of Horrors is a simulation-based method to train situational awareness that is little used in Switzerland. OBJECTIVES This study aimed to evaluate (1) the performance of health care staff in identifying patient safety hazards, (2) the participants' subjective experiences, and (3) the group interactions in Rooms of Horrors. METHODS The study was conducted in 13 Swiss hospitals that implemented a Room of Horrors. Health care professionals participated as individuals or in groups and were asked to identify as many errors as possible within a certain time and to complete an evaluation questionnaire. Observations of group interactions were carried out in 8 hospitals. t Tests and χ2 tests were used to examine differences in performance between participants solving the task alone versus in groups. RESULTS Data of 959 health care professionals were included in the analysis. Single participants identified on average 4.7 of the 10 errors and additional 10 errors and hazards that were not part of the official scenario. However, they also overestimated their performance, with 58% feeling the errors to be easy to find. Group observations indicated that participants rarely reflected on possible consequences of the hazards for the patient or their daily work. Participants feedback to the method was very positive. CONCLUSIONS Our findings suggest that the Room of Horrors is a popular and effective method to raise situational awareness for patient safety issues among health care staff. More attention should be given to debriefing after the experience and to benefits of interprofessional trainings

The context, process, and outcome evaluation model for organisational health interventions

To facilitate evaluation of complex, organisational health interventions (OHIs), this paper aims at developing a context, process, and outcome (CPO) evaluation model. It builds on previous model developments in the field and advances them by clearly defining and relating generic evaluation categories for OHIs. Context is defined as the underlying frame that influences and is influenced by an OHI. It is further differentiated into the omnibus and discrete contexts. Process is differentiated into the implementation process, as the time-limited enactment of the original intervention plan, and the change process of individual and collective dynamics triggered by the implementation process. These processes lead to proximate, intermediate, and distal outcomes, as all results of the change process that are meaningful for various stakeholders. Research questions that might guide the evaluation of an OHI according to the CPO categories and a list of concrete themes/indicators and methods/sources applied within the evaluation of an OHI project at a hospital in Switzerland illustrate the model's applicability in structuring evaluations of complex OHIs. In conclusion, the model supplies a common language and a shared mental model for improving communication between researchers and company members and will improve the comparability and aggregation of evaluation study results

How Much and What Local Adaptation Is Acceptable? A Comparison of 24 Surgical Safety Checklists in Switzerland.

OBJECTIVES In 2009, the World Health Organization (WHO) published the WHO Surgical Safety Checklist, and 3 years later, the Swiss Patient Safety Foundation adapted it for Switzerland. Several meta-analyses and systematic reviews showed ambiguous results on the effectiveness of surgical checklists. Most of them assume that the study checklists are almost identical, but in fact they are quite heterogeneous due to adaptations to local settings. This study aims to investigate the extent to which the checklists currently used in Switzerland differ and to discuss the consequences of local adaptations. METHODS For the analysis, 24 checklists used in 18 Swiss hospitals are analyzed. First, general checklist characteristics are examined. Second, the checklist items are compared with the checklist items of the WHO and the Swiss Patient Safety Foundation. RESULTS The checklists contain a median of 34.5 items (range, 15-76). Compared with the checklists of WHO and Patient Safety Switzerland, which contain 12 and 21 process checks and 10 and 9 conversation prompts, respectively, the study checklists contain a median of 15.5 process checks (range, 3-25) and a median of 4 conversation prompts (range, 0-10). CONCLUSIONS There are major differences between the study checklists and the reference checklists that raise doubts about the comparability of checklists. More resources must be invested in proper checklist adaptions and better guidance on how to adapt safety tools such as the surgical safety checklist needed to local conditions. In any case, details of the checklists used need to be clearly described in studies on checklist effectiveness

A Quality Improvement Initiative Using Peer Audit and Feedback to Improve Compliance with the Surgical Safety Checklist.

BACKGROUND The surgical safety checklist (SSC) published by the WHO in 2009 is used as standard in surgery worldwide to reduce perioperative patient mortality. However, compliance with the SSC and quality of its application is often not satisfactory. Internal audits and feedbacks seem promising for improving SSC application. The purpose of this study is to investigate whether an intervention consisting of peer observation and immediate peer feedback can be implemented with high fidelity and acceptance. METHODS Data was obtained from a national pilot programme that was initiated in Switzerland in 2018 to measure and improve compliance with the SSC using peer audit and feedback. A total of 11 hospitals with 14 sites implemented the full intervention. Each hospital formed an interprofessional project team that should perform at least 30 observations with feedback on SSC application documented in an observation tool developed specifically for this programme. Since the SSCs of the study hospitals differ greatly regarding checklist items, for each of the three SSC sections standard items were defined: four at Sign In, five at Team Time Out, two at Sign Out. Frequency analyses were performed for initiation characteristics, SSC application at item-level, feedback characteristics and programme evaluation. RESULTS The 11 hospitals documented 715 valid observations and feedback on SSC application was provided for 79% of the observations. In 61% all team members stopped their work for the SSC application and in 71% the items were read off from the checklist (instead of recalled from memory). On average, 86% of the standard items were read out by the checklist coordinator, whilst the two items at Sign Out were read out only in 60% and 74%, respectively. Additional visual checks with another source (e.g., patient wristband) took place in only 41% and verbal confirmation of the items (by someone else other than the checklist coordinator) was obtained on an average of 76% across all three checklist sections. The surgical teams reacted positively in 64% to the peer feedback. CONCLUSION Both implementation fidelity and acceptability of the intervention were high-the present intervention seems suitable for regular monitoring of the quality of SSC application with internal resources. Peer observation facilitated identifying weaknesses regarding the SSC process and application at item-level. Across all hospitals, the Sign Out section in general, visual control for item checks and lack of work interruption of all team members during SSC application showed up as the main areas of improvement