Patient safety in medical residency training:Balancing bravery and checklists

Distributing responsibility for patient safety between individual professionals and organisational systems is a pressing issue in contemporary healthcare. This article draws on Habermas' distinction between 'lifeworld' and 'system' to explore patient-safety culture in medical residency training. Sociological accounts of medical training have indicated that applying systemic solutions in patient-safety training and practice may conflict with residents' needs. Residents would navigate safety systems to get their work done and safeguard learning opportunities, acting 'in between' the system and traditional processes of socialisation and learning on the job. Our ethnographic study reveals how residents seek to connect system and professional-based learning, and do them together in situated manners that evolve in the course of medical training. We reveal three themes that closely align with the residents' developmental process of maturing during training and on the job to become 'real' physicians: (1) coming to grips with the job; (2) working around safety procedures; and (3) moving on to independence. A more explicit focus on learning to deal with uncertainty may enable residents to become more skilled in balancing safety systems.</p

The Surgical Hazardous Attitudes Reflection Profile (SHARP) Instrument - A Prototype Study

OBJECTIVE: There is growing recognition that surgeons’ non-technical skills are crucial in guaranteeing optimal quality and safety of patient care. However, insight in relevant attitudes underlying these behavioral skills is lacking. Hazardous attitudes potentially cause risky behavior, which can result in medical errors and adverse events. A questionnaire offering surgeons insight in their attitudinal profile is still missing and would be instrumental in risk reduction. Therefore, the aim of this study is to develop a prototype of a reliable and valid instrument to measure hazardous attitudes among surgeons. DESIGN: To measure hazardous attitudes, a prototype of the Surgical Hazardous Attitudes Reflection Profile (SHARP) tool was designed using a mixed methods approach, consisting of (1) 2 focus group discussions, (2) a modified Delphi analysis, and (3) a survey followed by (4) statistical analysis of the psychometric properties. Statistical analysis included exploratory factor analysis with varimax rotation, calculation of internal consistency reliability coefficients, and interscale correlations. SETTING: Fourteen hospitals across the Netherlands were recruited to guarantee demographic variety and the inclusion of academic, tertiary, and general hospitals. PARTICIPANTS: Nineteen experts participated in the 2 focus groups, and 19 in the modified Delphi study. In total, 302 surgeons (54.1%) completed the SHARP. RESULTS: In total, 302 surgeons (54.1%) completed the SHARP. Exploratory factor analysis resulted in 6 subscales measuring attitude towards (1) authority (α = 0.78), (2) self-performance (α = 0.69), (3) performance feedback (α = 0.61), (4) own fitness to perform (α = 0.54), (5) uncertainty (α = 0.51), and (6) planned procedures (α = 0.48). CONCLUSIONS: This study resulted in a prototype instrument identifying 6 potential hazardous attitudes in surgeons. Attitudes towards “authority” and “self-performance” can now be validly and reliably measured. Further research is required to optimize the prototype version of the instrument and could usefully explore the plausible relations between hazardous attitudes and clinical outcomes

New Tools for Systematic Evaluation of Teaching Qualities of Medical Faculty: Results of an Ongoing Multi-Center Survey

Background: Tools for the evaluation, improvement and promotion of the teaching excellence of faculty remain elusive in residency settings. This study investigates (i) the reliability and validity of the data yielded by using two new instruments for evaluating the teaching qualities of medical faculty, (ii) the instruments' potential for differentiating between faculty, and (iii) the number of residents' evaluations needed per faculty to reliably use the instruments. Methods and Materials: Multicenter cross-sectional survey among 546 residents and 629 medical faculty representing 29 medical (non-surgical) specialty training programs in the Netherlands. Two instruments-one completed by residents and one by faculty-for measuring teaching qualities of faculty were developed. Statistical analyses included factor analysis, reliability and validity exploration using standard psychometric methods, calculation of the numbers of residents' evaluations needed per faculty to achieve reliable assessments and variance components and threshold analyses. Results: A total of 403 (73.8%) residents completed 3575 evaluations of 570 medical faculty while 494 (78.5%) faculty self-evaluated. In both instruments five composite-scales of faculty teaching qualities were detected with high internal consistency and reliability: learning climate (Cronbach's alpha of 0.85 for residents' instrument, 0.71 for self-evaluation instrument, professional attitude and behavior (0.84/0.75), communication of goals (0.90/0.84), evaluation of residents (0.91/0.81), and feedback (0.91/0.85). Faculty tended to evaluate themselves higher than did the residents. Up to a third of the total variance in various teaching qualities can be attributed to between-faculty differences. Some seven residents' evaluations per faculty are needed for assessments to attain a reliability level of 0.90. Conclusions: The instruments for evaluating teaching qualities of medical faculty appear to yield reliable and valid data. They are feasible for use in medical residencies, can detect between-faculty differences and supply potentially useful information for improving graduate medical educatio

Linking leadership development programs for physicians with organization-level outcomes:a realist review

Background: Hospitals invest in Leadership Development Programs (LDPs) for physicians, assuming they benefit the organization’s performance. Researchers have listed the advantages of LDPs, but knowledge of how and why organization-level outcomes are achieved is missing. Objective: To investigate how, why and under which circumstances LDPs for physicians can impact organization-level outcomes. Methods: We conducted a realist review, following the RAMESES guidelines. Scientific articles and grey literature published between January 2010 and March 2021 evaluating a leadership intervention for physicians in the hospital setting were considered for inclusion. The following databases were searched: Medline, PsycInfo, ERIC, Web of Science, and Academic Search Premier. Based on the included documents, we developed a LDP middle-range program theory (MRPT) consisting of Context-Mechanism-Outcome configurations (CMOs) describing how specific contexts (C) trigger certain mechanisms (M) to generate organization-level outcomes (O). Results: In total, 3904 titles and abstracts and, subsequently, 100 full-text documents were inspected; 38 documents with LDPs from multiple countries informed our MRPT. The MRPT includes five CMOs that describe how LDPs can impact the organization-level outcomes categories ‘culture’, ‘quality improvement’, and ‘the leadership pipeline’: 'Acquiring self-insight and people skills (CMO1)', 'Intentionally building professional networks (CMO2)', 'Supporting quality improvement projects (CMO3)', 'Tailored LDP content prepares physicians (CMO4)', and 'Valuing physician leaders and organizational commitment (CMO5)'. Culture was the outcome of CMO1 and CMO2, quality improvement of CMO2 and CMO3, and the leadership pipeline of CMO2, CMO4, and CMO5. These CMOs operated within an overarching context, the leadership ecosystem, that determined realizing and sustaining organization-level outcomes. Conclusions: LDPs benefit organization-level outcomes through multiple mechanisms. Creating the contexts to trigger these mechanisms depends on the resources invested in LDPs and adequately supporting physicians. LDP providers can use the presented MRPT to guide the development of LDPs when aiming for specific organization-level outcomes.</p

Systematic Evaluation of the Teaching Qualities of Obstetrics and Gynecology Faculty: Reliability and Validity of the SETQ Tools

BACKGROUND: The importance of effective clinical teaching for the quality of future patient care is globally understood. Due to recent changes in graduate medical education, new tools are needed to provide faculty with reliable and individualized feedback on their teaching qualities. This study validates two instruments underlying the System for Evaluation of Teaching Qualities (SETQ) aimed at measuring and improving the teaching qualities of obstetrics and gynecology faculty. METHODS AND FINDINGS: This cross-sectional multi-center questionnaire study was set in seven general teaching hospitals and two academic medical centers in the Netherlands. Seventy-seven residents and 114 faculty were invited to complete the SETQ instruments in the duration of one month from September 2008 to September 2009. To assess reliability and validity of the instruments, we used exploratory factor analysis, inter-item correlation, reliability coefficient alpha and inter-scale correlations. We also compared composite scales from factor analysis to global ratings. Finally, the number of residents' evaluations needed per faculty for reliable assessments was calculated. A total of 613 evaluations were completed by 66 residents (85.7% response rate). 99 faculty (86.8% response rate) participated in self-evaluation. Factor analysis yielded five scales with high reliability (Cronbach's alpha for residents' and faculty): learning climate (0.86 and 0.75), professional attitude (0.89 and 0.81), communication of learning goals (0.89 and 0.82), evaluation of residents (0.87 and 0.79) and feedback (0.87 and 0.86). Item-total, inter-scale and scale-global rating correlation coefficients were significant (P<0.01). Four to six residents' evaluations are needed per faculty (reliability coefficient 0.60-0.80). CONCLUSIONS: Both SETQ instruments were found reliable and valid for evaluating teaching qualities of obstetrics and gynecology faculty. Future research should examine improvement of teaching qualities when using SETQ

Good Clinical Teachers Likely to be Specialist Role Models: Results from a Multicenter Cross-Sectional Survey

Medical educational reform includes enhancing role modelling of clinical teachers. This requires faculty being aware of their role model status and performance. We developed the System for Evaluation of Teaching Qualities (SETQ) to generate individualized feedback on previously defined teaching qualities and role model status for faculty in (non) academic hospitals.(i) To examine whether teaching qualities of faculty were associated with their being seen as a specialist role model by residents, and (ii) to investigate whether those associations differed across residency years and specialties.Cross-sectional questionnaire survey amongst 549 Residents of 36 teaching programs in 15 hospitals in the Netherlands. The main outcome measure was faculty being seen as specialist role models by residents. Statistical analyses included (i) Pearson's correlation coefficients and (ii) multivariable logistic generalized estimating equations to assess the (adjusted) associations between each of five teaching qualities and 'being seen as a role model'.407 residents completed a total of 4123 evaluations of 662 faculty. All teaching qualities were positively correlated with 'being seen as a role model' with correlation coefficients ranging from 0.49 for 'evaluation of residents' to 0.64 for 'learning climate' (P<0.001). Faculty most likely to be seen as good role models were those rated highly on 'feedback' (odds ratio 2.91, 95% CI: 2.41-3.51), 'a professional attitude towards residents' (OR 2.70, 95% CI: 2.34-3.10) and 'creating a positive learning climate' (OR 2.45, 95% CI: 1.97-3.04). Results did not seem to vary much across residency years. The relative strength of associations between teaching qualities and being seen as a role model were more distinct when comparing specialties.Good clinical educators are more likely to be seen as specialist role models for most residents

The Teacher, the Physician and the Person: How Faculty's Teaching Performance Influences Their Role Modelling

OBJECTIVE: Previous studies identified different typologies of role models (as teacher/supervisor, physician and person) and explored which of faculty's characteristics could distinguish good role models. The aim of this study was to explore how and to which extent clinical faculty's teaching performance influences residents' evaluations of faculty's different role modelling statuses, especially across different specialties. METHODS: In a prospective multicenter multispecialty study of faculty's teaching performance, we used web-based questionnaires to gather empirical data from residents. The main outcome measures were the different typologies of role modelling. The predictors were faculty's overall teaching performance and faculty's teaching performance on specific domains of teaching. The data were analyzed using multilevel regression equations. RESULTS: In total 219 (69% response rate) residents filled out 2111 questionnaires about 423 (96% response rate) faculty. Faculty's overall teaching performance influenced all role model typologies (OR: from 8.0 to 166.2). For the specific domains of teaching, overall, all three role model typologies were strongly associated with "professional attitude towards residents" (OR: 3.28 for teacher/supervisor, 2.72 for physician and 7.20 for the person role). Further, the teacher/supervisor role was strongly associated with "feedback" and "learning climate" (OR: 3.23 and 2.70). However, the associations of the specific domains of teaching with faculty's role modelling varied widely across specialties. CONCLUSION: This study suggests that faculty can substantially enhance their role modelling by improving their teaching performance. The amount of influence that the specific domains of teaching have on role modelling differs across specialties

Evaluation of physicians' professional performance: An iterative development and validation study of multisource feedback instruments

Contains fulltext : 107798.pdf (publisher's version ) (Open Access)BACKGROUND: There is a global need to assess physicians' professional performance in actual clinical practice. Valid and reliable instruments are necessary to support these efforts. This study focuses on the reliability and validity, the influences of some sociodemographic biasing factors, associations between self and other evaluations, and the number of evaluations needed for reliable assessment of a physician based on the three instruments used for the multisource assessment of physicians' professional performance in the Netherlands. METHODS: This observational validation study of three instruments underlying multisource feedback (MSF) was set in 26 non-academic hospitals in the Netherlands. In total, 146 hospital-based physicians took part in the study. Each physician's professional performance was assessed by peers (physician colleagues), co-workers (including nurses, secretary assistants and other healthcare professionals) and patients. Physicians also completed a self-evaluation. Ratings of 864 peers, 894 co-workers and 1960 patients on MSF were available. We used principal components analysis and methods of classical test theory to evaluate the factor structure, reliability and validity of instruments. We used Pearson's correlation coefficient and linear mixed models to address other objectives. RESULTS: The peer, co-worker and patient instruments respectively had six factors, three factors and one factor with high internal consistencies (Cronbach's alpha 0.95 - 0.96). It appeared that only 2 percent of variance in the mean ratings could be attributed to biasing factors. Self-ratings were not correlated with peer, co-worker or patient ratings. However, ratings of peers, co-workers and patients were correlated. Five peer evaluations, five co-worker evaluations and 11 patient evaluations are required to achieve reliable results (reliability coefficient >/= 0.70). CONCLUSIONS: The study demonstrated that the three MSF instruments produced reliable and valid data for evaluating physicians' professional performance in the Netherlands. Scores from peers, co-workers and patients were not correlated with self-evaluations. Future research should examine improvement of performance when using MSF

Faculty's work engagement in patient care:impact on job crafting of the teacher tasks

Background: High levels of work engagement protect against burnout. This can be supported through the work environment and by faculty themselves when they try to improve their work environment. As a result, they can become more engaged and better performers. We studied the relationship between adaptations by physicians to improve their teaching work environment, known as job crafting, and their energy levels, or work engagement, in their work as care provider and teacher. Job crafting encompasses seeking social (i) and structural (ii) resources and challenges (iii) and avoiding hindrances (iv). Methods: We established a cross-sectional questionnaire survey in a cohort of physicians participating in classroom and clinical teaching. Job crafting and work engagement were measured separately for physicians' clinical and teaching activities. We analyzed our data using structural equation modelling controlling for age, gender, perceived levels of autonomy and participation in decision making. Results: 383 physicians were included. Physicians' work engagement for patient care was negatively associated with two job crafting behaviors in the teaching roles: seeking structural resources (classroom teaching: ß = - 0.220 [95% CI: -0.319 to - 0.129]; clinical teaching: ß = - 0.148 [95% CI: -0.255 to - 0.042]); seeking challenges (classroom teaching: ß = - 0.215 [95% CI: -0.317 to - 0.113]; clinical teaching:, ß = - 0.190 [95% CI: -0.319 to - 0.061]). Seeking social resources and avoiding hindrances were unaffected by physicians' work engagement for patient care. Conclusions: High engagement for teaching leads to job crafting in teaching. High engagement for patient care does not lead to job crafting in teaching