Effectiveness of short, personalised student assistantships: an evaluative study across eight London hospitals

Objectives: Student assistantships are recommended to prepare medical graduates for clinical practice. Traditionally, assistantships have consisted of longer placements, often up to 15 weeks. However, within the constraints of the final year, medical schools need to carefully balance the time required for specialty placements, assessments and the risk of student burnout. We set out to evaluate the effectiveness of shorter, personalised student assistantships. Design: An evaluative study on the changes in final year student confidence in preparedness for practice after a 3-week assistantship with defined learning objectives and learning needs assessment. Setting: Eight hospitals affiliated with Imperial College School of Medicine. Outcomes: Student confidence in 10 learning outcomes including organising ward rounds, documentation, communication with colleagues, communication with patients and relatives, patient handover, practical procedures, patient management, acute care, prioritisation and out-of-hours clinical work. Results: Two hundred and twenty final year medical students took part in the student assistantship, of whom 208 completed both the pre-assistantship and post-assistantship confidence rating questionnaires (95% completion rate). After the assistantship, 169 (81%) students expressed increased confidence levels in one or more learning objectives. For each individual learning objective, there was a significant change in the proportion of students who agreed or strongly agreed after the assistantship (p<0.0001). Conclusion: Overall, the focused 3-week, personalised student assistantships led to significant improvement across all learning objectives related to preparedness for practice. The use of the pre-assistantship confidence rating questionnaire allowed students to identify and target areas of learning needs during their assistantship

Clinical prioritisation questions: A novel assessment tool to encourage tolerance of uncertainty?

Uncertainty is a common and increasingly acknowledged problem in clinical practice. Current single best answer (SBA) style assessments test areas where there is one correct answer, and as the approach to assessment impacts on the approach to learning, these exams may poorly prepare our future doctors to handle uncertainty. We therefore, need to modify our approach to assessment to emphasize reasoning and introduce the possibility of more than one ‘correct’ answer. We have developed clinical prioritization questions (CPQs), a novel formative assessment tool in which students prioritize possible responses in order of likelihood. This assessment format was piloted with a group of medical students and evaluated in comparison with the more traditional SBA question format in a team-based learning setting. Students reported that they felt ongoing use would help improve their tolerance of uncertainty (p < 0.01). Furthermore, over 80% of students felt that CPQs were more reflective of real-life clinical practice. Group based discussions were significantly longer when answering CPQs (p < 0.01), suggesting they may promote richer discourse. CPQs may have a role in formative assessment to help equip students with the skills to cope with ambiguity and strengthen clinical reasoning and decision-making. Institutions may find them more practical to implement compared with other clinical reasoning assessment tools

Exploring the feasibility of using very short answer questions (VSAQs) in team-based learning (TBL)

Copyright © 2021 The Authors. Background: Team-based learning (TBL) currently relies on single best answer questions (SBAQs) to provide immediate feedback. Very short answer questions (VSAQs) are a reliable and discriminatory alternative that encourage learners to use more authentic clinical reasoning strategies compared to SBAQs. However, the challenge of marking VSAQs has limited their integration into TBL; we therefore explored the feasibility of VSAQs within a TBL session. Methods: An online platform was developed to allow immediate marking of VSAQs during the TBL sessions. As part of the readiness assurance process, students completed VSAQs and SBAQs, which were marked in real time. Results: Instructors were able to mark all VSAQs during the individual readiness assurance test (iRAT), which facilitated the provision of immediate feedback during the team readiness assurance test (tRAT). The mean time to mark five VSAQs was 422 seconds (SD 73 seconds). For VSAQs, the number of attempts to reach the correct answer ranged from 1 to 38, compared to 1 to 4 for SBAQs. In total, 71.6% of students agreed that using VSAQs in TBL helped to emphasise group discussions. Discussion: The wide range of attempts at, and students’ perspectives of VSAQs are suggestive of their positive impact on student discussion during TBL. We demonstrate how new technology allows VSAQs to be feasibly integrated into TBL with the potential to enrich group discussions.Nanyang Technological University's EdeX learning and teaching project grant

A minute of your time: The impact of survey recruitment method and interview location on the value of travel time

Web-based stated preference (SP) surveys are widely used to estimate values of travel time (VTT) for cost–benefit analysis, often with internet panels as the source of recruitment. The recruitment method could potentially bias the results because (1) those who frequently participate in surveys may have a lower opportunity cost of time and (2) people who answer the survey at home or in the office may answer differently because the choice situation is less salient to them. In this paper, we investigate both mechanisms using data from a VTT choice experiment study where respondents were recruited from an internet panel, an alternative email register or on-board/on the station. Within all three groups, some complete the survey while making an actual trip. We find that respondents who were recruited from the internet panel or report being members of a panel have a significantly lower VTT, suggesting that internet panels are less representative in this respect compared to other recruitment methods. We also find that those who answer while traveling have a higher VTT, possibly because the benefits of saving travel time are more salient to them than to those who answer while not traveling

Assessment of factual recall and higher-order cognitive domains in an open-book medical school examination

Open-book examinations (OBEs) will likely become increasingly important assessment tools. We investigated how access to open-book resources affected questions testing factual recall, which might be easy to look-up, versus questions testing higher-order cognitive domains. Few studies have investigated OBEs using modern Internet resources or as summative assessments. We compared performance on an examination conducted as a traditional closed-book exam (CBE) in 2019 (N = 320) and a remote OBE with free access to Internet resources in 2020 (N = 337) due to COVID-19. This summative, end-of-year assessment focused on basic science for second-year medical students. We categorized questions by Bloom’s taxonomy (‘Remember’, versus ‘Understand/Apply’). We predicted higher performance on the OBE, driven by higher performance on ‘Remember’ questions. We used an item-centric analysis by using performance per item over all examinees as the outcome variable in logistic regression, with terms ‘Open-Book, ‘Bloom Category’ and their interaction. Performance was higher on OBE questions than CBE questions (OR 2.2, 95% CI: 2.14–2.39), and higher on ‘Remember’ than ‘Understand/Apply’ questions (OR 1.13, 95% CI: 1.09–1.19). The difference in performance between ‘Remember’ and ‘Understand/Apply’ questions was greater in the OBE than the CBE (‘Open-Book’ * ‘Bloom Category’ interaction: OR 1.2, 95% CI: 1.19–1.37). Access to open-book resources had a greater effect on performance on factual recall questions than higher-order questions, though performance was higher in the OBE overall. OBE design must consider how searching for information affects performance, particularly on questions measuring different domains of knowledge

Knowledge Attainment and Engagement Among Medical Students: A Comparison of Three Forms of Online Learning

Ashlyn A Stackhouse,1,&ast; Damir Rafi,1,&ast; Risheka Walls,1,2 Rebecca V Dodd,1 Kerry Badger,1 Daniel J Davies,1 Celia A Brown,3 Adrian Cowell,1 Karim Meeran,1 Omid Halse,1 James Kinross,4 Martin Lupton,1 Elizabeth A Hughes,5 Amir H Sam1 1Imperial College School of Medicine, Imperial College London, London, UK; 2Imperial College Healthcare NHS Trust, London, UK; 3Warwick Medical School, Department of Medicine, Warwick, UK; 4Department of Surgery and Cancer, Imperial College London, London, UK; 5Health Education England, London, UK&ast;These authors contributed equally to this workCorrespondence: Amir H Sam, Imperial College London, Charing Cross Campus, Reynolds Building, St Dunstan’s Road, London, W6 8RP, UK, Tel +442075895111, Email [email protected]: This study compared knowledge attainment and student enjoyment and engagement between clinical case vignette, patient-testimony videos and mixed reality (MR) teaching via the Microsoft HoloLens 2, all delivered remotely to third year medical students. The feasibility of conducting MR teaching on a large scale was also assessed.Setting & Participants: Medical students in Year 3 at Imperial College London participated in three online teaching sessions, one in each format. All students were expected to attend these scheduled teaching sessions and to complete the formative assessment. Inclusion of their data used as part of the research trial was optional.Primary and Secondary Outcome Measures: The primary outcome measure was performance on a formative assessment, which served to compare knowledge attainment between three forms of online learning. Moreover, we aimed to explore student engagement with each form of learning via a questionnaire, and also feasibility of applying MR as a teaching tool on a large scale. Comparisons between performances on the formative assessment between the three groups were investigated using a repeated measures two-way ANOVA. Engagement and enjoyment were also analysed in the same manner.Results: A total of 252 students participated in the study. Knowledge attainment of students using MR was comparable with the other two methods. Participants reported higher enjoyment and engagement (p< 0.001) for the case vignette method, compared with MR and video-based teaching. There was no difference in enjoyment or engagement ratings between MR and the video-based methods.Conclusion: This study demonstrated that the implementation of MR is an effective, acceptable, and feasible way of teaching clinical medicine to undergraduate students on a large scale. However, case-based tutorials were found to be favoured most by students. Future work could further explore the best uses for MR teaching within the medical curriculum.Keywords: medical education, augmented reality, online learnin

Commonalities and Variations in Understanding Doctoral Supervision in Two Australian Universities: A Collaborative Autoethnography and an Interdisciplinary, Phenomenographic Case Study

Rossi, DM ORCiD: 0000-0002-5093-6443This chapter reports selected elements of a broader collaborative autoethnography and an exploratory case study involving a Doctor of Philosophy candidate and her three doctoral supervisors who, as participant–researchers, examined the commonalities and differences in the meanings that we assigned to the idea(l) of “supervision”. Guided by our defined boundaries for a collaborative autoethnographic case study, we examined our respective conceptions of supervision through phenomenographic means, utilising data from interviews conducted with each of the authors individually to explicate our varied understandings of supervision. The analysis elicited three distinct categories of description – doctoral supervision as a relational endeavour, as a pedagogical commitment and as reciprocal growth – and an outcome space centred on the holistic development and self-actualisation of doctoral students and their supervisors alike