Linear Versus Web-Style Layout of Computer Tutorials for Medical Student Learning of Radiograph Interpretation

Rationale and Objective:We sought to determine which is more effective in increasing skill in radiograph interpretation: a linear (PowerPoint-style) computer tutorial that locks the student into a fixed path through the material or a branched (Web-style) version that allows random access. Materials and Methods: We prepared a computer tutorial for learning how to interpret cervical spine radiographs. The tutorial has 66 screens including radiographs or graphics on almost every page and five unknown radiographs for the student to interpret. One version (linear) presents the material in a linear sequence with the unknown radiographs heading up "chapters" detailing an important aspect of the task. In the second (branched) version, the same 66 screens were accessed through hyperlinks in a frame beside the unknown radiographs. One hundred thirty-nine medical students at two sites participated in a randomized single-blinded controlled experiment. They interpreted cervical spine images as a pretest and then completed one of the two tutorial versions. Afterward, they did the same examination as a post-test. Results:The tutorial was successful, in both layouts, in improving the subjects' ability to interpret cervical spine radiograph images (effect size 2.1; 95% confidence interval 1.7-2.5). However, the layout did not make a difference to their gain in ability. Students in the linear group completed the tutorial in 17% less time (P < .001) but were slightly less likely to rate the tutorial as "valuable." Conclusion:For these novice learners, computer tutorial layout does not affect knowledge gain. Students may be more satisfied with the linear layout, but in time-pressured situations, the Web-style layout may be preferable because it is more efficient

Calibrating urgency: triage decision-making in a pediatric emergency department

Triage, the first step in the assessment of emergency department patients, occurs in a highly dynamic environment that functions under constraints of time, physical space, and patient needs that may exceed available resources. Through triage, patients are placed into one of a limited number of categories using a subset of diagnostic information. To facilitate this task and standardize the triage decision process, triage guidelines have been implemented. However, these protocols are interpreted differently by highly experienced (expert) nurses and less experienced (novice) nurses. This study investigates the process of triage; the factors that influence triage decision-making, and how the guidelines are used in the process. Using observations and semi-structured interviews of triage nurses, data was collected in the pediatric emergency department of a large Canadian teaching hospital. Results show that in emergency situations (1) triage decisions were often non-analytic and based on intuition, particularly with increasing expertise, and (2) guidelines were used differently by nurses during the triage process. These results suggest that explicit guideline information becomes internalized and implicitly used in emergency triage practice as nurses gain experience. Implications of these results for nursing education and training, and guideline development for emergency care are discussed

Using signal detection theory to model changes in serial learning of radiological image interpretation

Signal detection theory (SDT) parameters can describe a learner's ability to discriminate (d') normal from abnormal and the learner's criterion (λ) to under or overcall abnormalities. To examine the serial changes in SDT parameters with serial exposure to radiological cases. 46 participants were recruited for this study: 20 medical students (MED), 6 residents (RES), 12 fellows (FEL), 5 staff pediatric emergency physicians (PEM), and 3 staff radiologists (RAD). Each participant was presented with 234 randomly assigned ankle radiographs using a web-based application. Participants were given a clinical scenario and considered 3 views of the ankle. They classified each case as normal or abnormal. For abnormal cases, they specified the location of the abnormality. Immediate feedback included highlighting on the images and the official radiologist's report. The low experience group (MED, RES, FEL) showed steady improvement in discrimination ability with each case, while the high experience group (PEM, RAD) had higher and stable discrimination ability throughout the exercise. There was also a difference in the way the high and low experience groups balanced sensitivity and specificity (λ) with the low experience group tending to make more errors calling positive radiographs negative. This tendency was progressively less evident with each increase in expertise level. SDT metrics provide valuable insight on changes associated with learning radiograph interpretation, and may be used to design more effective instructional strategies for a given learner group

Linear Versus Web-Style Layout of Computer Tutorials for Medical Student Learning of Radiograph Interpretation

Rationale and Objective:We sought to determine which is more effective in increasing skill in radiograph interpretation: a linear (PowerPoint-style) computer tutorial that locks the student into a fixed path through the material or a branched (Web-style) version that allows random access. Materials and Methods: We prepared a computer tutorial for learning how to interpret cervical spine radiographs. The tutorial has 66 screens including radiographs or graphics on almost every page and five unknown radiographs for the student to interpret. One version (linear) presents the material in a linear sequence with the unknown radiographs heading up "chapters" detailing an important aspect of the task. In the second (branched) version, the same 66 screens were accessed through hyperlinks in a frame beside the unknown radiographs. One hundred thirty-nine medical students at two sites participated in a randomized single-blinded controlled experiment. They interpreted cervical spine images as a pretest and then completed one of the two tutorial versions. Afterward, they did the same examination as a post-test. Results:The tutorial was successful, in both layouts, in improving the subjects' ability to interpret cervical spine radiograph images (effect size 2.1; 95% confidence interval 1.7-2.5). However, the layout did not make a difference to their gain in ability. Students in the linear group completed the tutorial in 17% less time (P < .001) but were slightly less likely to rate the tutorial as "valuable." Conclusion:For these novice learners, computer tutorial layout does not affect knowledge gain. Students may be more satisfied with the linear layout, but in time-pressured situations, the Web-style layout may be preferable because it is more efficient

A survey of mindset theories of intelligence and medical error self-reporting among pediatric housestaff and faculty

Référence bibliographique : Rol, 107037Appartient à l’ensemble documentaire : Pho20RolImage de press

Reinforcing outpatient medical student learning using brief computer tutorials: the Patient-Teacher-Tutorial sequence

Background:At present, what students read after an outpatient encounter is largely left up to them. Our objective was to evaluate the education efficacy of a clinical education model in which the student moves through a sequence that includes immediately reinforcing their learning using a specifically designed computer tutorial. Methods: Prior to a 14-day Pediatric Emergency rotation, medical students completed pre-tests for two common pediatric topics: Oral Rehydration Solutions (ORS) and Fever Without Source (FWS). After encountering a patient with either FWS or a patient needing ORS, the student logged into a computer that randomly assigned them to either a) completing a relevant computer tutorial (e.g. FWS patient + FWS tutorial = "in sequence") or b) completing the non-relevant tutorial (e.g. FWS patient + ORS tutorial = "out of sequence"). At the end of their rotation, they were tested again on both topics. Our main outcome was post-test scores on a given tutorial topic, contrasted by whether done in- or out-of-sequence Results:Ninety-two students completed the study protocol with 41 in the 'in sequence' group. Pre-test scores did not differ significantly. Overall, doing a computer tutorial in sequence resulted in significantly greater post-test scores (z-score 1.1 (SD 0.70) in sequence vs. 0.52 (1.1) out-of-sequence; 95% CI for difference +0.16, +0.93). Students spent longer on the tutorials when they were done in sequence (12.1 min (SD 7.3) vs. 10.5 (6.5)) though the difference was not statistically significant (95% CI diff: -1.2 min, +4.5). Conclusion: Outpatient learning frameworks could be structured to take best advantage of the heightened learning potential created by patient encounters. We propose the Patient-Teacher-Tutorial sequence as a framework for organizing learning in outpatient clinical settings

A Pediatrics-Based Instrument for Assessing Resident Education in Evidence-Based Practice

Objective:The principles of evidence-based practice (EBP) are a mandated component of the pediatric residency curriculum; however, a pediatrics-based assessment tool validated with pediatric residents does not exist. Methods: We designed an assessment instrument composed of items in 4 categories: 1) demographics; 2) comfort level; 3) self-reported practice of EBP; and 4) EBP knowledge. This last section required participants to identify best evidence and most appropriate study design by using pediatric-based scenarios, develop searchable questions, and use existing published research to address diagnostic and treatment issues. Four groups completed the instrument: preclinical medical students (MS-2), incoming pediatric interns (PGY-1), incoming second- and third-year pediatric residents (PGY2-3), and expert tutors (expert). We determined internal consistency, interrater reliability, content validity, item difficulty, and construct validity. Results: Fifty-six subjects completed tests (MS-2, n = 13; PGY-1, n = 13; PGY2-3, n = 22; expert, n = 8). Internal reliability was good, with Cronbach's alpha = .80. Interrater reliability was high (kappa = 0.94). Items were free of floor or ceiling effects. Comfort level and self-reported practice of EBP increased with expertise level and prior EBP experience (P < .01). Scores on the knowledge section (out of 50 +/- SD) rose with training level (MS-2: 14.8 +/- 5.7; PGY-1: 22.2 +/- 3.4; PGY2-3: 31.7 +/- 6.1; experts: 43 +/- 4.0; P < .01). Scores also correlated with prior EBP education. Conclusions: We have developed a reliable and valid instrument to assess knowledge and skill in EBP taught to pediatric residents. This instrument can aid pediatric educators in monitoring the impact of the EBP curriculum

Interpretation difficulty of normal versus abnormal radiographs using a pediatric example

Background: Radiograph teaching files are usually dominated by abnormal cases, implying that normal radiographs are easier to interpret. Our main objective was to compare the interpretation difficulty of normal versus abnormal radiographs of a set of common pediatric radiographs.Methods: We developed a 234-item digital case bank of pediatric ankle radiographs, recruited a convenience sample of participants, and presented the cases to each participant who then classified the cases as normal or abnormal. We determined and contrasted the interpretation difficulty of the normal and abnormal x-rays items using Rasch Measurement Theory. We also identified case features that were associated with item difficulty.Results: 139 participants (86 medical students, 7 residents, 29 fellows, 5 emergency physicians, and 3 radiologists) rated a minimum of 50 cases each, which resulted in 16,535 total ratings. Abnormal cases were more difficult (+0.99 logits) than were normal ones (-0.58 logits), difference 1.57 logits (95% CI 1.2, 2.0), but there was considerable overlap in difficulty scores. Patient variables associated with a more difficult normal radiograph included younger patient age (β = -0.16, 95% CI -0.22, -0.10), history of distal fibular tenderness (β = 0.55, 95% CI 0.17, 0.93), and presence of a secondary ossification centre (β = 0.84, 95% CI 0.27, 1.41).Conclusions: While abnormal images were more difficult to interpret, normal images did show a range of interpretation difficulties. Including a significant proportion of normal cases may be of benefit to learners

Twelve tips for rapidly migrating to online learning during the COVID-19 pandemic

The COVID-19 pandemic has resulted in a massive adaptation in health professions education, with a shift from in-person learning activities to a sudden heavy reliance on internet-mediated education. Some health professions schools will have already had considerable educational technology and cultural infrastructure in place, making such a shift more of a different emphasis in provision. For others, this shift will have been a considerable dislocation for both educators and learners in the provision of education. To aid educators make this shift effectively, this 12 Tips article presents a compendium of key principles and practical recommendations that apply to the modalities that make up online learning. The emphasis is on design features that can be rapidly implemented and optimised for the current pandemic. Where applicable, we have pointed out how these short-term shifts can also be beneficial for the long-term integration of educational technology into the organisations' infrastructure. The need for adaptability on the part of educators and learners is an important over-arching theme. By demonstrating these core values of the health professions school in a time of crisis, the manner in which the shift to online learning is carried out sends its own important message to novice health professionals who are in the process of developing their professional identities as learners and as clinicians

Factors influencing medical student attrition and their implications in a large multi-center randomized education trial

Participant attrition may be a significant threat to the generalizability of the results of educational research studies if participants who do not persist in a study differ from those who do in ways that can affect the experimental outcomes. A multi-center trial of the efficacy of different computer-based instructional strategies gave us the opportunity to observe institutional and student factors linked to attrition from a study and the ways in which they altered the participation profile. The data is from a randomized controlled trial conducted at seven US medical schools investigating the educational impact of different instructional designs for computer-based learning modules for surgical clerks. All students undertaking their surgical clerkships at the participating schools were invited participate and those that consented were asked to complete five study measures during their surgery clerkship. Variations in study attrition rates were explored by institution and by participants' self-regulation, self-efficacy, perception of task value, and mastery goal orientation measured on entry to the study. Of the 1,363 invited participants 995 (73 %) consented to participate and provided baseline data. There was a significant drop in the rate of participation at each of the five study milestones with 902 (94 %) completing at least one of two module post-test, 799 (61 %) both module post-tests, 539 (36 %) the mid-rotation evaluation and 252 (25 %) the final evaluation. Attrition varied between institutions on survival analysis (p < 0.001). Small but statistically significant differences in self-regulation (p = 0.01), self-efficacy (p = 0.02) and task value (p = 0.04) were observed but not in mastery or performance goal orientation measures (p = NS). Study attrition was correlated with lower achievement on the National Board of Medical Examiners subject exam. The results of education trials should be interpreted with the understanding that students who persist may be somewhat more self-regulated, self-efficacious and higher achievers than their peers who drop out and as such do not represent the class as a whole