Student evaluation of an OSCE in paediatrics at the University of the West Indies, Jamaica

BACKGROUND: The Faculty of Medical Sciences, University of the West Indies first implemented the Objective Structured Clinical Examination (OSCE) in the final MB Examination in Medicine and Therapeutics during the 2000–2001 academic year. Simultaneously, the Child Health Department initiated faculty and student training, and instituted the OSCE as an assessment instrument during the Child Health (Paediatric) clerkship in year 5. The study set out to explore student acceptance of the OSCE as part of an evaluation of the Child Health clerkship. METHODS: A self-administered questionnaire was completed by successive groups of students immediately after the OSCE at the end of each clerkship rotation. Main outcome measures were student perception of examination attributes, which included the quality of instructions and organisation, the quality of performance, authenticity and transparency of the process, and usefulness of the OSCE as an assessment instrument compared to other formats. RESULTS: There was overwhelming acceptance of the OSCE in Child Health with respect to the comprehensiveness (90%), transparency (87%), fairness (70%) and authenticity of the required tasks (58–78%). However, students felt that it was a strong anxiety-producing experience. And concerns were expressed regarding the ambiguity of some questions and inadequacy of time for expected tasks. CONCLUSION: Student feedback was invaluable in influencing faculty teaching, curriculum direction and appreciation of student opinion. Further psychometric evaluation will strengthen the development of the OSCE

Design and Effectiveness of a Required Pre-Clinical Simulation-based Curriculum for Fundamental Clinical Skills and Procedures

For more than 20 years, medical literature has increasingly documented the need for students to learn, practice and demonstrate competence in basic clinical knowledge and skills. In 2001, the Louisiana State University Health Science Centers (LSUHSC) School of Medicine – New Orleans replaced its traditional Introduction in to Clinical Medicine (ICM) course with the Science and Practice of Medicine (SPM) course. The main component within the SPM course is the Clinical Skills Lab (CSL). The CSL teaches 30 plus skills to all pre-clinical medical students (Years 1 and 2). Since 2002, an annual longitudinal evaluation questionnaire was distributed to all medical students targeting the skills taught in the CSL. Students were asked to rate their self- confidence (Dreyfus and Likert-type) and estimate the number of times each clinical skill was performed (clinically/non-clinically). Of the 30 plus skills taught, 8 were selected for further evaluation. An analysis was performed on the eight skills selected to determine the effectiveness of the CSL. All students that participated in the CSL reported a significant improvement in self-confidence and in number performed in the clinically/non-clinically setting when compared to students that did not experience the CSL. For example, without CSL training, the percentage of students reported at the end of their second year self-perceived expertise as “novice” ranged from 21.4% (CPR) to 84.7% (GU catheterization). Students who completed the two-years CSL, only 7.8% rated their self-perceived expertise at the end of the second year as “novice” and 18.8% for GU catheterization. The CSL design is not to replace real clinical patient experiences. It's to provide early exposure, medial knowledge, professionalism and opportunity to practice skills in a patient free environment

How well do second-year students learn physical diagnosis? Observational study of an objective structured clinical examination (OSCE)

BACKGROUND: Little is known about using the Objective Structured Clinical Examination (OSCE) in physical diagnosis courses. The purpose of this study was to describe student performance on an OSCE in a physical diagnosis course. METHODS: Cross-sectional study at Harvard Medical School, 1997–1999, for 489 second-year students. RESULTS: Average total OSCE score was 57% (range 39–75%). Among clinical skills, students scored highest on patient interaction (72%), followed by examination technique (65%), abnormality identification (62%), history-taking (60%), patient presentation (60%), physical examination knowledge (47%), and differential diagnosis (40%) (p < .0001). Among 16 OSCE stations, scores ranged from 70% for arthritis to 29% for calf pain (p < .0001). Teaching sites accounted for larger adjusted differences in station scores, up to 28%, than in skill scores (9%) (p < .0001). CONCLUSIONS: Students scored higher on interpersonal and technical skills than on interpretive or integrative skills. Station scores identified specific content that needs improved teaching

Study protocol: the registrar clinical encounters in training (ReCEnT) study

Patient encounters are the core learning activity of Australian general practice (family practice) training. Exposure to patient demographics and presentations may vary from one general practice registrar (vocational trainee) to another. This can affect comprehensiveness of training. Currently, there is no mechanism to systematically capture the content of GP registrar consultations. The aim of the Registrar Clinical Encounters in Training (ReCEnT) study is to document longitudinally the nature and associations of consultation-based clinical and educational experiences of general practice registrars. This is an ongoing prospective multi-site cohort study of general practice registrars' consultations, entailing paper-based recording of consultation data. The study setting is general practices affiliated with three geographically-based Australian general practice regional training providers. Registrars record details of 60 consecutive consultations. Data collected includes registrar demographics, details of the consultation, patient demographics, reasons for encounter and problems managed. Problems managed are coded with the International Classification of Primary Care (second edition) classification system. Additionally, registrars record educational factors related to the encounter. The study will follow the clinical exposure of each registrar six-monthly over the 18 months to two years (full-time equivalent) of their general practice training program. The study will provide data on a range of factors (patient, registrar and consultation factors). This data will be used to inform a range of educational decisions as well as being used to answer educational research questions. We plan to use ReCEnT as a formative assessment tool for registrars and help identify and address educational needs. The study will facilitate program evaluation by the participating training providers and thus improve articulation of educational programs with practice experience. From the research point of view it will address an evidence gap - the in-practice clinical and educational experience of general practice trainees, determinants of these experiences, and the determinants of registrars' patterns of practice (for example, prescribing practice) over the course of their training