The fairness, predictive validity and acceptability of multiple mini interview in an internationally diverse student population--a mixed methods study

BACKGROUND: International medical students, those attending medical school outside of their country of citizenship, account for a growing proportion of medical undergraduates worldwide. This study aimed to establish the fairness, predictive validity and acceptability of Multiple Mini Interview (MMI) in an internationally diverse student population. METHODS: This was an explanatory sequential, mixed methods study. All students in First Year Medicine, National University of Ireland Galway 2012 were eligible to sit a previously validated 10 station MMI. Quantitative data comprised: demographics, selection tool scores and First Year Assessment scores. Qualitative data comprised separate focus groups with MMI Assessors, EU and Non-EU students. RESULTS: 109 students participated (45% of class). Of this 41.3% (n = 45) were Non-EU and 35.8% (n = 39) did not have English as first language. Age, gender and socioeconomic class did not impact on MMI scores. Non-EU students and those for whom English was not a first language achieved significantly lower scores on MMI than their EU and English speaking counterparts (difference in mean 11.9% and 12.2% respectively, P<0.001). MMI score was associated with English language proficiency (IELTS) (r = 0.5, P<0.01). Correlations emerged between First Year results and IELTS (r = 0.44; p = 0.006; n = 38) and EU school exit exam (r = 0.52; p<0.001; n = 56). MMI predicted EU student OSCE performance (r = 0.27; p = 0.03; n = 64). In the analysis of focus group data two overarching themes emerged: Authenticity and Cultural Awareness. MMI was considered a highly authentic assessment that offered a deeper understanding of the applicant than traditional tools, with an immediate relevance to clinical practice. Cultural specificity of some stations and English language proficiency were seen to disadvantage international students. Recommendations included cultural awareness training for MMI assessors, designing and piloting culturally neutral stations, lengthening station duration and providing high quality advance information to candidates. CONCLUSION: MMI is a welcome addition to assessment armamentarium for selection, particularly with regard to stakeholder acceptability. Understanding the mediating and moderating influences for differences in performance of international candidates is essential to ensure that MMI complies with the metrics of good assessment practice and principles of both distributive and procedural justice for all applicants, irrespective of nationality and cultural background

Relevance of anatomy to medical education and clinical practice: perspectives of medical students, clinicians, and educators

Introduction: Against a backdrop of ever-changing diagnostic and treatment modalities, stakeholder perceptions (medical students, clinicians, anatomy educators) are crucial for the design of an anatomy curriculum which fulfils the criteria required for safe medical practice. This study compared perceptions of students, practising clinicians, and anatomy educators with respect to the relevance of anatomy education to medicine. Methods: A quantitative survey was administered to undergraduate entry (n = 352) and graduate entry students (n = 219) at two Irish medical schools, recently graduated Irish clinicians (n = 146), and anatomy educators based in Irish and British medical schools (n = 30). Areas addressed included the association of anatomy with medical education and clinical practice, mode of instruction, and curriculum duration. Results: Graduate-entry students were less likely to associate anatomy with the development of professionalism, teamwork skills, or improved awareness of ethics in medicine. Clinicians highlighted the challenge of tailoring anatomy education to increase student readiness to function effectively in a clinical role. Anatomy educators indicated dissatisfaction with the time available for anatomy within medical curricula, and were equivocal about whether curriculum content should be responsive to societal feedback. Conclusions: The group differences identified in the current study highlight areas and requirements which medical education curriculum developers should be sensitive to when designing anatomy courses

Convergence and translation: attitudes to inter-professional learning and teaching of creative problem-solving among medical and engineering students and staff

Background: Healthcare worldwide needs translation of basic ideas from engineering into the clinic. Consequently, there is increasing demand for graduates equipped with the knowledge and skills to apply interdisciplinary medicine/engineering approaches to the development of novel solutions for healthcare. The literature provides little guidance regarding barriers to, and facilitators of, effective interdisciplinary learning for engineering and medical students in a team-based project context. Methods: A quantitative survey was distributed to engineering and medical students and staff in two universities, one in Ireland and one in Belgium, to chart knowledge and practice in interdisciplinary learning and teaching, and of the teaching of innovation. Results: We report important differences for staff and students between the disciplines regarding attitudes towards, and perceptions of, the relevance of interdisciplinary learning opportunities, and the role of creativity and innovation. There was agreement across groups concerning preferred learning, instructional styles, and module content. Medical students showed greater resistance to the use of structured creativity tools and interdisciplinary teams. Conclusions: The results of this international survey will help to define the optimal learning conditions under which undergraduate engineering and medicine students can learn to consider the diverse factors which determine the success or failure of a healthcare engineering solution

Data from: Medical school selection criteria as predictors of medical student empathy: a cross-sectional study of medical students, Ireland

Objectives: To determine whether performance in any of the HPAT sections, most specifically the interpersonal understanding section, correlates with self-reported empathy levels in medical students. Setting: The study was conducted in University College Cork, Ireland. Participants: 290 students participated in the study. Matching HPAT scores were available for 263 students. All male and female undergraduate students were invited to participate. Post graduate and international students were excluded. Primary and secondary outcome measures: HPAT-Ireland and JSPE scores were compared including subsection analysis. Comparisons were made between groups such as gender and year of programme. Results : A total of 290 students participated. Males scored significantly higher than females for total HPAT-Ireland [U = 7329, z = -2.04, p 0.05]. There was no effect of programme year on JSPE scores [all p >0.05]. Conclusion : The introduction of the HPAT–Ireland test was partly designed to identify students with strong interpersonal skills. A significant finding of this study is that JSPE values did not correlate with HPAT-Ireland scores. This study suggests no clear link between scores on a selection test, the HPAT-Ireland, which is designed to assess several skill domains including interpersonal skills, and scores on a psychometric measure of empathy, at any point during medical education

Data from: Medical school selection criteria as predictors of medical student empathy: a cross-sectional study of medical students, Ireland

Objectives: To determine whether performance in any of the HPAT sections, most specifically the interpersonal understanding section, correlates with self-reported empathy levels in medical students. Setting: The study was conducted in University College Cork, Ireland. Participants: 290 students participated in the study. Matching HPAT scores were available for 263 students. All male and female undergraduate students were invited to participate. Post graduate and international students were excluded. Primary and secondary outcome measures: HPAT-Ireland and JSPE scores were compared including subsection analysis. Comparisons were made between groups such as gender and year of programme. Results : A total of 290 students participated. Males scored significantly higher than females for total HPAT-Ireland [U = 7329, z = -2.04, p 0.05]. There was no effect of programme year on JSPE scores [all p >0.05]. Conclusion : The introduction of the HPAT–Ireland test was partly designed to identify students with strong interpersonal skills. A significant finding of this study is that JSPE values did not correlate with HPAT-Ireland scores. This study suggests no clear link between scores on a selection test, the HPAT-Ireland, which is designed to assess several skill domains including interpersonal skills, and scores on a psychometric measure of empathy, at any point during medical education

Irish medical students' understanding of the intern year

Upon completion of medical school in Ireland, graduates must make the transition to becoming interns. The transition into the intern year may be described as challenging as graduates assume clinical responsibilities. Historically, a survey of interns in 1996 found that 91% felt unprepared for their role. However, recent surveys in 2012 have demonstrated that this is changing with preparedness rates reaching 52%. This can be partially explained by multiple initiatives at the local and national level. Our study aimed evaluate medical student understanding of the intern year and associated factors. An online, cross-sectional survey was sent out to all Irish medical students in 2013 and included questions regarding their understanding of the intern year. Two thousand, two hundred and forty-eight students responded, with 1224 (55.4%) of students agreeing or strongly agreeing that they had a good understanding of what the intern year entails. This rose to 485 (73.7%) among senior medical students. Of junior medical students, 260 (42.8%) indicated they understood what the intern year, compared to 479 (48.7%) of intermediate medical students. Initiatives to continue improving preparedness for the intern year are essential in ensuring a smooth and less stressful transition into the medical workforce