9 research outputs found
Additional file 1: of Variability and dimensionality of students’ and supervisors’ mini-CEX scores in undergraduate medical clerkships – a multilevel factor analysis
Appendix. SAS code for the multilevel factor analysis, exemplified for clinical supervisors. (DOCX 19 kb
Systematic_Review_Library.enl
EndNote database of a systematic review on the educational impact of mini-clinical evaluation exercise (Mini-CEX) and direct observation of procedural skills (DOPS) and its association with implementatio
The educational impact of Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) and its association with implementation: A systematic review and meta-analysis
<div><p>Introduction</p><p>Mini Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) are used as formative assessments worldwide. Since an up-to-date comprehensive synthesis of the educational impact of Mini-CEX and DOPS is lacking, we performed a systematic review. Moreover, as the educational impact might be influenced by characteristics of the setting in which Mini-CEX and DOPS take place or their implementation status, we additionally investigated these potential influences.</p><p>Methods</p><p>We searched Scopus, Web of Science, and Ovid, including All Ovid Journals, Embase, ERIC, Ovid MEDLINE(R), and PsycINFO, for original research articles investigating the educational impact of Mini-CEX and DOPS on undergraduate and postgraduate trainees from all health professions, published in English or German from 1995 to 2016. Educational impact was operationalized and classified using Barr’s adaptation of Kirkpatrick’s four-level model. Where applicable, outcomes were pooled in meta-analyses, separately for Mini-CEX and DOPS. To examine potential influences, we used Fisher’s exact test for count data.</p><p>Results</p><p>We identified 26 articles demonstrating heterogeneous effects of Mini-CEX and DOPS on learners’ reactions (Kirkpatrick Level 1) and positive effects of Mini-CEX and DOPS on trainees’ performance (Kirkpatrick Level 2b; Mini-CEX: <i>standardized mean difference (SMD)</i> = 0.26, <i>p</i> = 0.014; DOPS: <i>SMD</i> = 3.33, <i>p</i><0.001). No studies were found on higher Kirkpatrick levels. Regarding potential influences, we found two implementation characteristics, “quality” and “participant responsiveness”, to be associated with the educational impact.</p><p>Conclusions</p><p>Despite the limited evidence, the meta-analyses demonstrated positive effects of Mini-CEX and DOPS on trainee performance. Additionally, we revealed implementation characteristics to be associated with the educational impact. Hence, we assume that considering implementation characteristics could increase the educational impact of Mini-CEX and DOPS.</p></div
Numbers of studies with low, medium, and high educational impact on Kirkpatrick level 1, separately for Mini-CEX and DOPS.
<p>Numbers of studies with low, medium, and high educational impact on Kirkpatrick level 1, separately for Mini-CEX and DOPS.</p
Cross table visualizing the association between participant responsiveness and educational impact.
<p>Cross table visualizing the association between participant responsiveness and educational impact.</p
Flow diagram of search results according to the PRISMA statement.
<p><i>From</i>: Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group (2009). <i>P</i>referred <i>R</i>eporting <i>I</i>terns for <i>S</i>ystematic Reviews and <i>M</i>eta-<i>A</i>nalyses: The PRISMA Statement. PLoS Med 6(7): e1000097. doi:<a href="https://doi.org/10.1371/journal.pmed1000097" target="_blank">10.1371/journal.pmed1000097</a>. <b>For more information, visit</b><a href="https://www.prisma-statement.org" target="_blank">www.prisma-statement.org</a>.</p
Cross table visualizing the association between quality and educational impact.
<p>Cross table visualizing the association between quality and educational impact.</p
Random-effects meta-analyses on the effects of Mini-CEX or DOPS compared with no intervention on trainee performance.
<p>Positive numbers favor Mini-CEX/DOPS. Abbreviation used: <i>SMD (standardized mean difference)</i>.</p
Additional file 1 of Impact of familiarity with the format of the exam on performance in the OSCE of undergraduate medical students – an interventional study
Additional file 1: Supplemental Table 1. OSCE subspecialties and main checklist items