Development and Integration of DOPS as Formative Tests in Head and Neck Ultrasound Education : Proof of Concept Study for Exploration of Perceptions

In Germany, progress assessments in head and neck ultrasonography training have been carried out mainly theoretically and lack standardisation. Thus, quality assurance and comparisons between certified courses from various course providers are difficult. This study aimed to develop and integrate a direct observation of procedural skills (DOPS) in head and neck ultrasound education and explore the perceptions of both participants and examiners. Five DOPS tests oriented towards assessing basic skills were developed for certified head and neck ultrasound courses on national standards. DOPS tests were completed by 76 participants from basic and advanced ultrasound courses (n = 168 documented DOPS tests) and evaluated using a 7-point Likert scale. Ten examiners performed and evaluated the DOPS after detailed training. The variables of “general aspects” (6.0 Scale Points (SP) vs. 5.9 SP; p = 0.71), “test atmosphere” (6.3 SP vs. 6.4 SP; p = 0.92), and “test task setting” (6.2 SP vs. 5.9 SP; p = 0.12) were positively evaluated by all participants and examiners. There were no significant differences between a basic and advanced course in relation to the overall results of DOPS tests (p = 0.81). Regardless of the courses, there were significant differences in the total number of points achieved between individual DOPS tests. DOPS tests are accepted by participants and examiners as an assessment tool in head and neck ultrasound education. In view of the trend toward “competence-based” teaching, this type of test format should be applied and validated in the future

Development and Integration of DOPS as Formative Tests in Head and Neck Ultrasound Education: Proof of Concept Study for Exploration of Perceptions

In Germany, progress assessments in head and neck ultrasonography training have been carried out mainly theoretically and lack standardisation. Thus, quality assurance and comparisons between certified courses from various course providers are difficult. This study aimed to develop and integrate a direct observation of procedural skills (DOPS) in head and neck ultrasound education and explore the perceptions of both participants and examiners. Five DOPS tests oriented towards assessing basic skills were developed for certified head and neck ultrasound courses on national standards. DOPS tests were completed by 76 participants from basic and advanced ultrasound courses (n = 168 documented DOPS tests) and evaluated using a 7-point Likert scale. Ten examiners performed and evaluated the DOPS after detailed training. The variables of “general aspects” (6.0 Scale Points (SP) vs. 5.9 SP; p = 0.71), “test atmosphere” (6.3 SP vs. 6.4 SP; p = 0.92), and “test task setting” (6.2 SP vs. 5.9 SP; p = 0.12) were positively evaluated by all participants and examiners. There were no significant differences between a basic and advanced course in relation to the overall results of DOPS tests (p = 0.81). Regardless of the courses, there were significant differences in the total number of points achieved between individual DOPS tests. DOPS tests are accepted by participants and examiners as an assessment tool in head and neck ultrasound education. In view of the trend toward “competence-based” teaching, this type of test format should be applied and validated in the future

Long-Term Effectiveness and Sustainability of Integrating Peer-Assisted Ultrasound Courses into Medical School—A Prospective Study

Introduction: Ultrasound diagnostics is an important examination method in everyday clinical practice, but student education is often inadequate for acquiring sufficient basic skills. Individual universities have therefore started integrating (extra)curricular training concepts into medical education. This study aimed to evaluate sustainable skills development through participation in peer-assisted ultrasound courses. Methods: From 2017, students in the clinical part of medical school could opt for extracurricular peer-assisted ultrasound courses. Depending on the format (10-week course/2-day compact course) these comprised 20 teaching units focusing on abdominal and emergency ultrasonography. Students attending compulsory workshops at the start of their practical year were enrolled in this study, allowing for a comparison between the study group (attended ultrasound course) and the control group (did not attend ultrasound course). Competency from two out of four practical exams (subjects: “aorta”, “gallbladder”, “kidney” and “lung”) was measured, and a theory test on the same subject areas (“pathology recognition”) was administered. Additional questions concerned biographical data, subjective competency assessment (7-point Likert scale), and “attitude to ultrasound training in the curriculum”. Results: Analysis included 302 participants in total. Ultrasound courses had been attended on average 2.5 years earlier (10-week course) and 12 months earlier (2-day compact course), respectively. The study group (n = 141) achieved significantly better results than the control group (n = 161) in the long-term follow-up. This applies both to practical exams (p p p p < 0.01) ultrasound skills. Conclusions: Peer-assisted ultrasound courses can sustainably increase both theoretical and practical competency of medical students. This highlights the potential and need for standardised implementation of ultrasound courses in the medical education curriculum