Repeated testing improves achievement in a blended learning approach for risk competence training of medical students: results of a randomized controlled trial

Background: Adequate estimation and communication of risks is a critical competence of physicians. Due to an evident lack of these competences, effective training addressing risk competence during medical education is needed. Test-enhanced learning has been shown to produce marked effects on achievements. This study aimed to investigate the effect of repeated tests implemented on top of a blended learning program for risk competence. Methods: We introduced a blended-learning curriculum for risk estimation and risk communication based on a set of operationalized learning objectives, which was integrated into a mandatory course “Evidence-based Medicine” for third-year students. A randomized controlled trial addressed the effect of repeated testing on achievement as measured by the students’ pre- and post-training score (nine multiple-choice items). Basic numeracy and statistical literacy were assessed at baseline. Analysis relied on descriptive statistics (histograms, box plots, scatter plots, and summary of descriptive measures), bootstrapped confidence intervals, analysis of covariance (ANCOVA), and effect sizes (Cohen’s d, r) based on adjusted means and standard deviations. Results: All of the 114 students enrolled in the course consented to take part in the study and were assigned to either the intervention or control group (both: n = 57) by balanced randomization. Five participants dropped out due to non-compliance (control: 4, intervention: 1). Both groups profited considerably from the program in general (Cohen’s d for overall pre vs. post scores: 2.61). Repeated testing yielded an additional positive effect: while the covariate (baseline score) exhibits no relation to the post-intervention score, F(1, 106) = 2.88, p > .05, there was a significant effect of the intervention (repeated tests scenario) on learning achievement, F(1106) = 12.72, p < .05, d = .94, r = .42 (95% CI: [.26, .57]). However, in the subgroup of participants with a high initial numeracy score no similar effect could be observed. Conclusion: Dedicated training can improve relevant components of risk competence of medical students. An already promising overall effect of the blended learning approach can be improved significantly by implementing a test-enhanced learning design, namely repeated testing. As students with a high initial numeracy score did not profit equally from repeated testing, target-group specific opt-out may be offered

Voluntary undergraduate technical skills training course to prepare students for clerkship assignment: tutees’ and tutors’ perspectives

BACKGROUND: Skills lab training has become a widespread tool in medical education, and nowadays, skills labs are ubiquitous among medical faculties across the world. An increasingly prevalent didactic approach in skills lab teaching is peer-assisted learning (PAL), which has been shown to be not only effective, but can be considered to be on a par with faculty staff-led training. The aim of the study is to determine whether voluntary preclinical skills teaching by peer tutors is a feasible method for preparing medical students for effective workplace learning in clerkships and to investigate both tutees’ and tutors’ attitudes towards such an intervention. METHODS: A voluntary clerkship preparation skills course was designed and delivered. N = 135 pre-clinical medical students visited the training sessions. N = 10 tutors were trained as skills-lab peer tutors. Voluntary clerkship preparation skills courses as well as tutor training were evaluated by acceptance ratings and pre-post self-assessment ratings. Furthermore, qualitative analyses of skills lab tutors’ attitudes towards the course were conducted following principles of grounded theory. RESULTS: Results show that a voluntary clerkship preparation skills course is in high demand, is highly accepted and leads to significant changes in self-assessment ratings. Regarding qualitative analysis of tutor statements, clerkship preparation skills courses were considered to be a helpful and necessary asset to preclinical medical education, which benefits from the tutors’ own clerkship experiences and a high standardization of training. Tutor training is also highly accepted and regarded as an indispensable tool for peer tutors. CONCLUSIONS: Our study shows that the demand for voluntary competence-oriented clerkship preparation is high, and a peer tutor-led skills course as well as tutor training is well accepted. The focused didactic approach for tutor training is perceived to be effective in preparing tutors for their teaching activity in this context. A prospective study design would be needed to substantiate the results objectively and confirm the effectiveness

Examiner effect on the objective structured clinical exam – a study at five medical schools

Background: The Objective Structured Clinical Examination (OSCE) is increasingly used at medical schools to assess practical competencies. To compare the outcomes of students at different medical schools, we introduced standardized OSCE stations with identical checklists. Methods: We investigated examiner bias at standardized OSCE stations for knee- and shoulder-joint examinations, which were implemented into the surgical OSCE at five different medical schools. The checklists for the assessment consisted of part A for knowledge and performance of the skill and part B for communication and interaction with the patient. At each medical faculty, one reference examiner also scored independently to the local examiner. The scores from both examiners were compared and analysed for inter-rater reliability and correlation with the level of clinical experience. Possible gender bias was also evaluated. Results: In part A of the checklist, local examiners graded students higher compared to the reference examiner; in part B of the checklist, there was no trend to the findings. The inter-rater reliability was weak, and the scoring correlated only weakly with the examiner’s level of experience. Female examiners rated generally higher, but male examiners scored significantly higher if the examinee was female. Conclusions: These findings of examiner effects, even in standardized situations, may influence outcome even when students perform equally well. Examiners need to be made aware of these biases prior to examining

Digital rectal examination skills: first training experiences, the motives and attitudes of standardized patients

Background: Physical clinical examination is a core clinical competence of medical doctors. In this regard, digital rectal examination (DRE) plays a central role in the detection of abnormalities of the anus and rectum. However, studies in undergraduate medical students as well as newly graduated doctors show that they are insufficiently prepared for performing DRE. Training units with Standardized Patients (SP) represent one method to deliver DRE skills. As yet, however, it is little known about SPs’ attitudes. Methods: This is a qualitative study using a grounded theory approach. Interviews were conducted with 4 standardized patients about their experiences before, during and after structured SP training to deliver DRE competencies to medical students. The resulting data were subjected to thematic content analysis. Results: Results show that SPs do not have any predominant motives for DRE program participation. They participate in the SP training sessions with relatively little prejudice and do not anticipate feeling highly vulnerable within teaching sessions with undergraduate medical students. Conclusions: The current study examined SPs’ motives, views, expectations and experiences regarding a DRE program during their first SP training experiences. The results enabled us to derive distinct action guidelines for the recruitment, informing and briefing of SPs who are willing to participate in a DRE program

Peer role-play and standardised patients in communication training: a comparative study on the student perspective on acceptability, realism, and perceived effect

<p>Abstract</p> <p>Background</p> <p>To assess the student perspective on acceptability, realism, and perceived effect of communication training with peer role play (RP) and standardised patients (SP).</p> <p>Methods</p> <p>69 prefinal year students from a large German medical faculty were randomly assigned to one of two groups receiving communication training with RP (N = 34) or SP (N = 35) in the course of their paediatric rotation. In both groups, training addressed major medical and communication problems encountered in the exploration and counselling of parents of sick children. Acceptability and realism of the training as well as perceived effects and applicability for future parent-physician encounters were assessed using six-point Likert scales.</p> <p>Results</p> <p>Both forms of training were highly accepted (RP 5.32 ± .41, SP 5.51 ± .44, n.s.; 6 = very good, 1 = very poor) and perceived to be highly realistic (RP 5.60 ± .38, SP 5.53 ± .36, n.s.; 6 = highly realistic, 1 = unrealistic). Regarding perceived effects, participation was seen to be significantly more worthwhile in the SP group (RP 5.17 ± .37, SP 5.50 ± .43; p < .003; 6 = totally agree, 1 = don't agree at all). Both training methods were perceived as useful for training communication skills (RP 5.01 ± .68, SP 5.34 ± .47; 6 = totally agree; 1 = don't agree at all) and were considered to be moderately applicable for future parent-physician encounters (RP 4.29 ± 1.08, SP 5.00 ± .89; 6 = well prepared, 1 = unprepared), with usefulness and applicability both being rated higher in the SP group (p < .032 and p < .009).</p> <p>Conclusions</p> <p>RP and SP represent comparably valuable tools for the training of specific communication skills from the student perspective. Both provide highly realistic training scenarios and warrant inclusion in medical curricula. Given the expense of SP, deciding which method to employ should be carefully weighed up. From the perspective of the students in our study, SP were seen as a more useful and more applicable tool than RP. We discuss the potential of RP to foster a greater empathic appreciation of the patient perspective.</p

Physician and Patient Predictors of Evidence-Based Prescribing in Heart Failure: A Multilevel Study

BACKGROUND: The management of patients with heart failure (HF) needs to account for changeable and complex individual clinical characteristics. The use of renin angiotensin system inhibitors (RAAS-I) to target doses is recommended by guidelines. But physicians seemingly do not sufficiently follow this recommendation, while little is known about the physician and patient predictors of adherence. METHODS: To examine the coherence of primary care (PC) physicians' knowledge and self-perceived competencies regarding RAAS-I with their respective prescribing behavior being related to patient-associated barriers. Cross-sectional follow-up study after a randomized medical educational intervention trial with a seven month observation period. PC physicians (n = 37) and patients with systolic HF (n = 168) from practices in Baden-Wuerttemberg. Measurements were knowledge (blueprint-based multiple choice test), self-perceived competencies (questionnaire on global confidence in the therapy and on frequency of use of RAAS-I), and patient variables (age, gender, NYHA functional status, blood pressure, potassium level, renal function). Prescribing was collected from the trials' documentation. The target variable consisted of ≥50% of recommended RAAS-I dosage being investigated by two-level logistic regression models. RESULTS: Patients (69% male, mean age 68.8 years) showed symptomatic and objectified left ventricular (NYHA II vs. III/IV: 51% vs. 49% and mean LVEF 33.3%) and renal (GFR<50%: 22%) impairment. Mean percentage of RAAS-I target dose was 47%, 59% of patients receiving ≥50%. Determinants of improved prescribing of RAAS-I were patient age (OR 0.95, CI 0.92-0.99, p = 0.01), physician's global self-confidence at follow-up (OR 1.09, CI 1.02-1.05, p = 0.01) and NYHA class (II vs. III/IV) (OR 0.63, CI 0.38-1.05, p = 0.08). CONCLUSIONS: A change in physician's confidence as a predictor of RAAS-I dose increase is a new finding that might reflect an intervention effect of improved physicians' intention and that might foster novel strategies to improve safe evidence-based prescribing. These should include targeting knowledge, attitudes and skills