The Surgical Hazardous Attitudes Reflection Profile (SHARP) Instrument - A Prototype Study

OBJECTIVE: There is growing recognition that surgeons’ non-technical skills are crucial in guaranteeing optimal quality and safety of patient care. However, insight in relevant attitudes underlying these behavioral skills is lacking. Hazardous attitudes potentially cause risky behavior, which can result in medical errors and adverse events. A questionnaire offering surgeons insight in their attitudinal profile is still missing and would be instrumental in risk reduction. Therefore, the aim of this study is to develop a prototype of a reliable and valid instrument to measure hazardous attitudes among surgeons. DESIGN: To measure hazardous attitudes, a prototype of the Surgical Hazardous Attitudes Reflection Profile (SHARP) tool was designed using a mixed methods approach, consisting of (1) 2 focus group discussions, (2) a modified Delphi analysis, and (3) a survey followed by (4) statistical analysis of the psychometric properties. Statistical analysis included exploratory factor analysis with varimax rotation, calculation of internal consistency reliability coefficients, and interscale correlations. SETTING: Fourteen hospitals across the Netherlands were recruited to guarantee demographic variety and the inclusion of academic, tertiary, and general hospitals. PARTICIPANTS: Nineteen experts participated in the 2 focus groups, and 19 in the modified Delphi study. In total, 302 surgeons (54.1%) completed the SHARP. RESULTS: In total, 302 surgeons (54.1%) completed the SHARP. Exploratory factor analysis resulted in 6 subscales measuring attitude towards (1) authority (α = 0.78), (2) self-performance (α = 0.69), (3) performance feedback (α = 0.61), (4) own fitness to perform (α = 0.54), (5) uncertainty (α = 0.51), and (6) planned procedures (α = 0.48). CONCLUSIONS: This study resulted in a prototype instrument identifying 6 potential hazardous attitudes in surgeons. Attitudes towards “authority” and “self-performance” can now be validly and reliably measured. Further research is required to optimize the prototype version of the instrument and could usefully explore the plausible relations between hazardous attitudes and clinical outcomes

New Tools for Systematic Evaluation of Teaching Qualities of Medical Faculty: Results of an Ongoing Multi-Center Survey

Background: Tools for the evaluation, improvement and promotion of the teaching excellence of faculty remain elusive in residency settings. This study investigates (i) the reliability and validity of the data yielded by using two new instruments for evaluating the teaching qualities of medical faculty, (ii) the instruments' potential for differentiating between faculty, and (iii) the number of residents' evaluations needed per faculty to reliably use the instruments. Methods and Materials: Multicenter cross-sectional survey among 546 residents and 629 medical faculty representing 29 medical (non-surgical) specialty training programs in the Netherlands. Two instruments-one completed by residents and one by faculty-for measuring teaching qualities of faculty were developed. Statistical analyses included factor analysis, reliability and validity exploration using standard psychometric methods, calculation of the numbers of residents' evaluations needed per faculty to achieve reliable assessments and variance components and threshold analyses. Results: A total of 403 (73.8%) residents completed 3575 evaluations of 570 medical faculty while 494 (78.5%) faculty self-evaluated. In both instruments five composite-scales of faculty teaching qualities were detected with high internal consistency and reliability: learning climate (Cronbach's alpha of 0.85 for residents' instrument, 0.71 for self-evaluation instrument, professional attitude and behavior (0.84/0.75), communication of goals (0.90/0.84), evaluation of residents (0.91/0.81), and feedback (0.91/0.85). Faculty tended to evaluate themselves higher than did the residents. Up to a third of the total variance in various teaching qualities can be attributed to between-faculty differences. Some seven residents' evaluations per faculty are needed for assessments to attain a reliability level of 0.90. Conclusions: The instruments for evaluating teaching qualities of medical faculty appear to yield reliable and valid data. They are feasible for use in medical residencies, can detect between-faculty differences and supply potentially useful information for improving graduate medical educatio

Faculty's work engagement in patient care:impact on job crafting of the teacher tasks

Background: High levels of work engagement protect against burnout. This can be supported through the work environment and by faculty themselves when they try to improve their work environment. As a result, they can become more engaged and better performers. We studied the relationship between adaptations by physicians to improve their teaching work environment, known as job crafting, and their energy levels, or work engagement, in their work as care provider and teacher. Job crafting encompasses seeking social (i) and structural (ii) resources and challenges (iii) and avoiding hindrances (iv). Methods: We established a cross-sectional questionnaire survey in a cohort of physicians participating in classroom and clinical teaching. Job crafting and work engagement were measured separately for physicians' clinical and teaching activities. We analyzed our data using structural equation modelling controlling for age, gender, perceived levels of autonomy and participation in decision making. Results: 383 physicians were included. Physicians' work engagement for patient care was negatively associated with two job crafting behaviors in the teaching roles: seeking structural resources (classroom teaching: ß = - 0.220 [95% CI: -0.319 to - 0.129]; clinical teaching: ß = - 0.148 [95% CI: -0.255 to - 0.042]); seeking challenges (classroom teaching: ß = - 0.215 [95% CI: -0.317 to - 0.113]; clinical teaching:, ß = - 0.190 [95% CI: -0.319 to - 0.061]). Seeking social resources and avoiding hindrances were unaffected by physicians' work engagement for patient care. Conclusions: High engagement for teaching leads to job crafting in teaching. High engagement for patient care does not lead to job crafting in teaching

The Teacher, the Physician and the Person: How Faculty's Teaching Performance Influences Their Role Modelling

OBJECTIVE: Previous studies identified different typologies of role models (as teacher/supervisor, physician and person) and explored which of faculty's characteristics could distinguish good role models. The aim of this study was to explore how and to which extent clinical faculty's teaching performance influences residents' evaluations of faculty's different role modelling statuses, especially across different specialties. METHODS: In a prospective multicenter multispecialty study of faculty's teaching performance, we used web-based questionnaires to gather empirical data from residents. The main outcome measures were the different typologies of role modelling. The predictors were faculty's overall teaching performance and faculty's teaching performance on specific domains of teaching. The data were analyzed using multilevel regression equations. RESULTS: In total 219 (69% response rate) residents filled out 2111 questionnaires about 423 (96% response rate) faculty. Faculty's overall teaching performance influenced all role model typologies (OR: from 8.0 to 166.2). For the specific domains of teaching, overall, all three role model typologies were strongly associated with "professional attitude towards residents" (OR: 3.28 for teacher/supervisor, 2.72 for physician and 7.20 for the person role). Further, the teacher/supervisor role was strongly associated with "feedback" and "learning climate" (OR: 3.23 and 2.70). However, the associations of the specific domains of teaching with faculty's role modelling varied widely across specialties. CONCLUSION: This study suggests that faculty can substantially enhance their role modelling by improving their teaching performance. The amount of influence that the specific domains of teaching have on role modelling differs across specialties

Good Clinical Teachers Likely to be Specialist Role Models: Results from a Multicenter Cross-Sectional Survey

Medical educational reform includes enhancing role modelling of clinical teachers. This requires faculty being aware of their role model status and performance. We developed the System for Evaluation of Teaching Qualities (SETQ) to generate individualized feedback on previously defined teaching qualities and role model status for faculty in (non) academic hospitals.(i) To examine whether teaching qualities of faculty were associated with their being seen as a specialist role model by residents, and (ii) to investigate whether those associations differed across residency years and specialties.Cross-sectional questionnaire survey amongst 549 Residents of 36 teaching programs in 15 hospitals in the Netherlands. The main outcome measure was faculty being seen as specialist role models by residents. Statistical analyses included (i) Pearson's correlation coefficients and (ii) multivariable logistic generalized estimating equations to assess the (adjusted) associations between each of five teaching qualities and 'being seen as a role model'.407 residents completed a total of 4123 evaluations of 662 faculty. All teaching qualities were positively correlated with 'being seen as a role model' with correlation coefficients ranging from 0.49 for 'evaluation of residents' to 0.64 for 'learning climate' (P<0.001). Faculty most likely to be seen as good role models were those rated highly on 'feedback' (odds ratio 2.91, 95% CI: 2.41-3.51), 'a professional attitude towards residents' (OR 2.70, 95% CI: 2.34-3.10) and 'creating a positive learning climate' (OR 2.45, 95% CI: 1.97-3.04). Results did not seem to vary much across residency years. The relative strength of associations between teaching qualities and being seen as a role model were more distinct when comparing specialties.Good clinical educators are more likely to be seen as specialist role models for most residents

Physicians Report Barriers to Deliver Best Practice Care for Asplenic Patients: A Cross-Sectional Survey

Background: Current management of asplenic patients is not in compliance with best practice standards, such as defined by the British Committee for Standards in Haematology. To improve quality of care, factors inhibiting best practice care delivery need to be identified first. With this study, we aimed to identify and quantify physicians' barriers to adhere to best practice management of asplenic patients in the Netherlands. Methods and Principal Findings: A cross-sectional survey, preceded by multiple focus group discussions, was performed among Dutch physicians responsible for prevention of infections in asplenic patients, including specialists ( of Internal medicine and Surgery) and general practitioners (GPs). Forty seven GPs and seventy three hospital specialists returned the questionnaire, yielding response rates of 47% and 36,5% respectively. Physicians reported several barriers to deliver best practice. For both GPs and specialists, the most frequently listed barriers were: poor patient knowledge (> 80% of hospital specialists and GPs) and lack of clarity about which physician is responsible for the management of asplenic patients (50% of Internists, 46% of Surgeons, 55% of GPs). Both GPs and hospital specialists expressed to experience a lack of mutual trust: specialists were uncertain whether the GP would follow their advice given on patient discharge (33-59%), whereas half of GPs was not convinced that specialists' discharge letters contained the correct recommendations. Almost all physicians (> 90%) indicated that availability of a national guideline would improve adherence to best practice, especially if accessible online. Conclusion: This study showed that, in accordance with reports on international performance, care delivery for asplenic patients in the Netherlands is suboptimal. We identified and quantified perceived barriers by physicians that prevent adherence to post-splenectomy guidelines for the first time. Better transmural collaboration and better informed patients are likely to improve the quality of care of the asplenic patient population. A national, online-available guideline is urgently require

A systematic review of the effects of residency training on patient outcomes

<p>Abstract</p> <p>Background</p> <p>Residents are vital to the clinical workforce of today and tomorrow. Although in training to become specialists, they also provide much of the daily patient care. Residency training aims to prepare residents to provide a high quality of care. It is essential to assess the patient outcome aspects of residency training, to evaluate the effect or impact of global investments made in training programs. Therefore, we conducted a systematic review to evaluate the effects of relevant aspects of residency training on patient outcomes.</p> <p>Methods</p> <p>The literature was searched from December 2004 to February 2011 using MEDLINE, Cochrane, Embase and the Education Resources Information Center databases with terms related to residency training and (post) graduate medical education and patient outcomes, including mortality, morbidity, complications, length of stay and patient satisfaction. Included studies evaluated the impact of residency training on patient outcomes.</p> <p>Results</p> <p>Ninety-seven articles were included from 182 full-text articles of the initial 2,001 hits. All studies were of average or good quality and the majority had an observational study design.Ninety-six studies provided insight into the effect of 'the level of experience of residents' on patient outcomes during residency training. Within these studies, the start of the academic year was not without risk (five out of 19 studies), but individual progression of residents (seven studies) as well as progression through residency training (nine out of 10 studies) had a positive effect on patient outcomes. Compared with faculty, residents' care resulted mostly in similar patient outcomes when dedicated supervision and additional operation time were arranged for (34 out of 43 studies). After new, modified or improved training programs, patient outcomes remained unchanged or improved (16 out of 17 studies). Only one study focused on physicians' prior training site when assessing the quality of patient care. In this study, training programs were ranked by complication rates of their graduates, thus linking patient outcomes back to where physicians were trained.</p> <p>Conclusions</p> <p>The majority of studies included in this systematic review drew attention to the fact that patient care appears safe and of equal quality when delivered by residents. A minority of results pointed to some negative patient outcomes from the involvement of residents. Adequate supervision, room for extra operation time, and evaluation of and attention to the individual competence of residents throughout residency training could positively serve patient outcomes. Limited evidence is available on the effect of residency training on later practice. Both qualitative and quantitative research designs are needed to clarify which aspects of residency training best prepare doctors to deliver high quality care.</p

Factors influencing residents' evaluations of clinical faculty member teaching qualities and role model status

OBJECTIVES Evaluations of faculty members are widely used to identify excellent or substandard teaching performance. In order to enable such evaluations to be properly interpreted and used in faculty development, it is essential to understand the factors that influence resident doctors' (residents) evaluations of the teaching qualities of faculty members and their perceptions of faculty members as role-model specialists. METHODS We carried out a cross-sectional survey within a longitudinal study of the System for Evaluation of Teaching Qualities (SETQ) of clinical teachers. The study sample included 889 residents and 1014 faculty members in 61 teaching programmes spanning 22 specialties in 20 hospitals in the Netherlands. Main outcome measures included residents' (i) global and (ii) specific ratings of faculty member teaching qualities, and (iii) global ratings of faculty members as role-model specialists. Statistical analysis was conducted using adjusted multivariable logistic generalised estimating equations. RESULTS In total, 690 residents (77.6%) completed 6485 evaluations of 962 faculty members, 848 (83.6%) of whom also self-evaluated. More recently certified faculty members, those who had attended a teacher training programme, and those who spent more time teaching than seeing patients or conducting research were more likely to score highly on most teaching qualities. However, faculty members who had undergone teacher training were less likely to be seen as role models (odds ratio [OR] 0.72, 95% confidence interval [CI] 0.59-0.88). In addition, faculty members were evaluated slightly higher by male than female residents on core teaching domains and overall teaching quality, but were less likely to be seen as role models by male residents (OR 0.80, 95% CI 0.67-0.97). Lastly, faculty members had higher odds of receiving top scores in specific teaching domains from residents in the first 4 years of residency and were less likely to be considered as role models by more senior residents. CONCLUSIONS Younger faculty members who dedicated more time to teaching, had attended a teacher training programme, and were evaluated by male residents in the early years of residency were more likely to receive higher scores for teaching performanc