Differential diagnosis checklists reduce diagnostic error differentially: a randomized experiment

Introduction Wrong and missed diagnoses contribute substantially to medical error. Can a prompt to generate alternative diagnoses (prompt) or a differential diagnosis checklist (DDXC) increase diagnostic accuracy? How do these interventions affect the diagnostic process and self-monitoring? Methods Advanced medical students (N = 90) were randomly assigned to one of four conditions to complete six computer-based patient cases: group 1 (prompt) was instructed to write down all diagnoses they considered while acquiring diagnostic test results and to finally rank them. Groups 2 and 3 received the same instruction plus a list of 17 differential diagnoses for the chief complaint of the patient. For half of the cases, the DDXC contained the correct diagnosis (DDXC+), and for the other half, it did not (DDXC−; counterbalanced). Group 4 (control) was only instructed to indicate their final diagnosis. Mixed-effects models were used to analyse results. Results Students using a DDXC that contained the correct diagnosis had better diagnostic accuracy, mean (standard deviation), 0.75 (0.44), compared to controls without a checklist, 0.49 (0.50), P < 0.001, but those using a DDXC that did not contain the correct diagnosis did slightly worse, 0.43 (0.50), P = 0.602. The number and relevance of diagnostic tests acquired were not affected by condition, nor was self-monitoring. However, participants spent more time on a case in the DDXC−, 4:20 min (2:36), P ≤ 0.001, and DDXC+ condition, 3:52 min (2:09), than in the control condition, 2:59 min (1:44), P ≤ 0.001. Discussion Being provided a list of possible diagnoses improves diagnostic accuracy compared with a prompt to create a differential diagnosis list, if the provided list contains the correct diagnosis. However, being provided a diagnosis list without the correct diagnosis did not improve and might have slightly reduced diagnostic accuracy. Interventions neither affected information gathering nor self-monitoring

Accumulation of organotin compounds in the common whelk Buccinum undatum and the red whelk Neptunea antiqua in association with imposex

Several species of the subclass Prosobranchia are considered to be suitable organisms for monitoring long-term effects of triorganotin (TOT) compounds. This study utilized Buccinum undatum and Neptunea antiqua from the North Sea and the Irish Sea. Morphological alterations in the genital system (imposex phenomena), the histological structure of the gut, and the gonads were studied. TOT concentrations in soft body tissue and shells were determined. Females of both species displayed imposex phenomena (pseudohermaphroditism). The percentage of altered females per station ranged from 0 to 90% in B. undatum and from 0 to 29% in N. antiqua. Imposex index values in B. undatum reached 1.09 near Helgoland and 0.86 in N. antiqua sampled at 25 nautical miles from the Scottish northeast coast. Organotin compounds were detected in the soft bodies of snails from all stations. A chi-square analysis revealed a significant correlation between imposex stages and TOT concentrations in B. undatum but not in N. antiqua. Tributyltin (TBT) in B. undatum ranged from 1.0 to 15.9 ng g-1 wet weight (Irish east coast). TBT concentrations in N. antiqua were higher and ranged from 2.2 to 25.7 ng g-1. In both species, organotin compounds in the shells were below detection limits. Despite high TBT concentrations in soft tissues and the occurrence of imposex (offshore and inshore), female gonads were in good shape and no signs of limited reproductive capacity were found. Histological findings indicate that TBT does not contribute considerably to mortality in the common whelk

Do different response formats affect how test takers approach a clinical reasoning task? An experimental study on antecedents of diagnostic accuracy using a constructed response and a selected response format

Abstract The use of response formats in assessments of medical knowledge and clinical reasoning continues to be the focus of both research and debate. In this article, we report on an experimental study in which we address the question of how much list-type selected response formats and short-essay type constructed response formats are related to differences in how test takers approach clinical reasoning tasks. The design of this study was informed by a framework developed within cognitive psychology which stresses the importance of the interplay between two components of reasoning—self-monitoring and response inhibition—while solving a task or case. The results presented support the argument that different response formats are related to different processing behavior. Importantly, the pattern of how different factors are related to a correct response in both situations seem to be well in line with contemporary accounts of reasoning. Consequently, we argue that when designing assessments of clinical reasoning, it is crucial to tap into the different facets of this complex and important medical process

Differential diagnosis checklists reduce diagnostic error differentially: a randomized experiment

Introduction Wrong and missed diagnoses contribute substantially to medical error. Can a prompt to generate alternative diagnoses (prompt) or a differential diagnosis checklist (DDXC) increase diagnostic accuracy? How do these interventions affect the diagnostic process and self-monitoring? Methods Advanced medical students (N = 90) were randomly assigned to one of four conditions to complete six computer-based patient cases: Group 1 (prompt) was instructed to write down all diagnoses they considered while acquiring diagnostic test results, and to finally rank them. Groups 2 and 3 received the same instruction plus a list of 17 differential diagnoses for the chief complaint of the patient. For half of the cases, the DDXC contained the correct diagnosis (DDXC+) and for the other half, it did not (DDXC-; counterbalanced). Group 4 (control) was only instructed to indicate their final diagnosis. Mixed-effects models were used to analyze results. Results Students using a DDXC that contained the correct diagnosis had better diagnostic accuracy, mean (standard deviation), 0.75 (0.44), compared to controls without a checklist, 0.49 (0.50), P &lt; 0.001, but those using a DDXC that did not contain the correct diagnosis did slightly worse, 0.43 (0.50), P = 0.602. The number and relevance of diagnostic tests acquired were not affected by condition, nor was self-monitoring. However, participants spent more time on a case in the DDXC-, 4:20 minutes (2:36), P ≤ 0.001, and DDXC+ condition, 3:52 minutes (2:09), than in the control condition, 2:59 minutes (1:44), P ≤ 0.001. Discussion Being provided a list of possible diagnoses improves diagnostic accuracy compared with a prompt to create a differential diagnosis list, if the provided list contains the correct diagnosis. However, being provided a diagnosis list without the correct diagnosis did not improve and might have slightly reduced diagnostic accuracy. Interventions neither affected information gathering nor self-monitoring

Rating the quality of teamwork—a comparison of novice and expert ratings using the Team Emergency Assessment Measure (TEAM) in simulated emergencies

Background Training in teamwork behaviour improves technical resuscitation performance. However, its effect on patient outcome is less clear, partly because teamwork behaviour is difficult to measure. Furthermore, it is unknown who should evaluate it. In clinical practice, experts are obliged to participate in resuscitation efforts and are thus unavailable to assess teamwork quality. Consequently, we sought to determine if raters with little clinical experience and experts provide comparable evaluations of teamwork behaviour. Methods Novice and expert raters judged teamwork behaviour during 6 emergency medicine simulations using the Teamwork Emergency Assessment Measure (TEAM). Ratings of both groups were analysed descriptively and compared with U and t tests. We used a mixed effects model to identify the proportion of variance in TEAM scores attributable to rater status and other sources. Results Twelve raters evaluated 7 teams rotating through 6 cases, for a total of 84 observations. We found no significant difference between expert and novice ratings for 7 of the 11 items of the TEAM or in the sums of all item scores. Novices rated teamwork behaviour higher on 4 items and overall. Rater status accounted for 11.1% of the total variance in scores. Conclusions Experts’ and novices’ ratings were similarly distributed, implying that raters with limited experience can provide reliable data on teamwork behaviour. Novices show a consistent, but slightly more lenient rating behaviour. Clinical studies and real-life teams may thus employ novices using a structured observational tool such as TEAM to inform their performance review and improvement

Interprofessional Emergency Training Leads to Changes in the Workplace

Introduction: Preventable mistakes occur frequently and can lead to patient harm and death. The emergency department (ED) is notoriously prone to such errors, and evidence suggests that improving teamwork is a key aspect to reduce the rate of error in acute care settings. Only a few strategies are in place to train team skills and communication in interprofessional situations. Our goal was to conceptualize, implement, and evaluate a training module for students of three professions involved in emergency care. The objective was to sensitize participants to barriers for their team skills and communication across professional borders. Methods: We developed a longitudinal simulation-enhanced training format for interprofessional teams, consisting of final-year medical students, advanced trainees of emergency nursing and student paramedics. The training format consisted of several one-day training modules, which took place twice in 2016 and 2017. Each training module started with an introduction to share one’s roles, professional self-concepts, common misconceptions, and communication barriers. Next, we conducted different simulated cases. Each case consisted of a prehospital section (for paramedics and medical students), a handover (everyone), and an ED section (medical students and emergency nurses). After each training module, we assessed participants’ “Commitment to Change.” In this questionnaire, students were anonymously asked to state up to three changes that they wished to implement as a result of the course, as well as the strength of their commitment to these changes. Results: In total, 64 of 80 participants (80.0%) made at least one commitment to change after participating in the training modules. The total of 123 commitments was evenly distributed over four emerging categories: communication, behavior, knowledge and attitude. Roughly one third of behavior- and attitude-related commitments were directly related to interprofessional topics (e.g., “acknowledge other professions’ work”), and these were equally distributed among professions. At the two-month follow-up, 32 participants (50%) provided written feedback on their original commitments: 57 of 62 (91.9%) commitments were at least partly realized at the follow-up, and only five (8.1%) commitments lacked realization entirely.  Conclusion: A structured simulation-enhanced intervention was successful in promoting change to the practice of emergency care, while training teamwork and communication skills jointly.

The future of practical skills in undergraduate medical education – an explorative Delphi-Study

Background: 64% of young medical professionals in Germany do not feel adequately prepared for the practical requirements of the medical profession. The goal of “outcome-orientated training” is to structure medical curricula based on the skills needed when entering the workforce after completing undergraduate medical education, and thus to bridge the gap between the skills graduates have attained and those necessary for a career in the medical profession. Outcome frameworks (OFs) are used for this purpose. In preparation for developing the National Competence-Based Catalogue of Learning Objectives for Medicine (NKLM) – the German OF – the “Consensus Statement of Practical Skills in Undergraduate Medical Education” (which structures the teaching and acquisition of practical skills in Germany and which strongly influenced the “Clinical-Practical Skills” chapter of the NKLM) was published in 2011.It is not uncommon for at least a decade to elapse between the definition and implementation of an OF and the students’ graduation, which can further increase the gap between necessary and acquired skills. Thus, the purpose of this paper is to posit theses for future development in healthcare and to apply these theses to a current OF. Methodology: Partially structured interviews with experts were used to generate theses pertaining to general, future development in healthcare. These theses were assessed by physician experts based on the likelihood of implementation by the year 2025. The 288 learning goals of the consensus statement were assessed for their relevance for medical education in the interim. Results: 11 theses were generated for the development of medicine, and these theses were assessed and discussed by 738 experts. These theses include the increase in diseases associated with old age, the increasing significance of interprofessional cooperation, and the growing prevalence of telemedicine applications. Of the 288 learning goals of the consensus statement, 231 of the goals were assessed as relevant, and 57 were deemed irrelevant for the short-term future. Discussion: The theses on the future of healthcare, which were generated in this study and which were validated by numerous experts, provide indications of future developments of overall requirements for medical school graduates. For example, when applied to the content of the “Clinical-Practical Skills” NKLM chapter, they largely validate the future relevance of developing practical skills while also providing indications for their further development as applied to the consensus statement

Data from: The future of practical skills in undergraduate medical education – an explorative Delphi-Study

Background: 64% of young medical professionals in Germany do not feel adequately prepared for the practical requirements of the medical profession. The goal of “outcome-orientated training” is to structure medical curricula based on the skills needed when entering the workforce after completing undergraduate medical education, and thus to bridge the gap between the skills graduates have attained and those necessary for a career in the medical profession. Outcome frameworks (OFs) are used for this purpose. In preparation for developing the National Competence-Based Catalogue of Learning Objectives for Medicine (NKLM) – the German OF – the “Consensus Statement of Practical Skills in Undergraduate Medical Education” (which structures the teaching and acquisition of practical skills in Germany and which strongly influenced the “Clinical-Practical Skills” chapter of the NKLM) was published in 2011. It is not uncommon for at least a decade to elapse between the definition and implementation of an OF and the students’ graduation, which can further increase the gap between necessary and acquired skills. Thus, the purpose of this paper is to posit theses for future development in healthcare and to apply these theses to a current OF. Methodology: Partially structured interviews with experts were used to generate theses pertaining to general, future development in healthcare. These theses were assessed by physician experts based on the likelihood of implementation by the year 2025. The 288 learning goals of the consensus statement were assessed for their relevance for medical education in the interim. Results: 11 theses were generated for the development of medicine, and these theses were assessed and discussed by 738 experts. These theses include the increase in diseases associated with old age, the increasing significance of interprofessional cooperation, and the growing prevalence of telemedicine applications. Of the 288 learning goals of the consensus statement, 231 of the goals were assessed as relevant, and 57 were deemed irrelevant for the short-term future. Discussion: The theses on the future of healthcare, which were generated in this study and which were validated by numerous experts, provide indications of future developments of overall requirements for medical school graduates. For example, when applied to the content of the “Clinical-Practical Skills” NKLM chapter, they largely validate the future relevance of developing practical skills while also providing indications for their further development as applied to the consensus statement