How well do UK assistantships equip medical students for graduate practice? Think EPAs

The goal of better medical student preparation for clinical practice drives curricular initiatives worldwide. Learning theory underpins Entrustable Professional Activities (EPAs) as a means of safe transition to independent practice. Regulators mandate senior assistantships to improve practice readiness. It is important to know whether meaningful EPAs occur in assistantships, and with what impact. Final year students at one UK medical school kept learning logs and audio-diaries for six one-week periods during a year-long assistantship. Further data were also obtained through interviewing participants when students and after three months as junior doctors. This was combined with data from new doctors from 17 other UK schools. Realist methods explored what worked for whom and why. 32 medical students and 70 junior doctors participated. All assistantship students reported engaging with EPAs but gaps in the types of EPAs undertaken exist, with level of entrustment and frequency of access depending on the context. Engagement is enhanced by integration into the team and shared understanding of what constitutes legitimate activities. Improving the shared understanding between student and supervisor of what constitutes important assistantship activity may result in an increase in the amount and/or quality of EPAs achieved

Enhancing authenticity, diagnosticity and equivalence (AD-Equiv) in multicentre OSCE exams in health professionals education: protocol for a complex intervention study

Introduction: Objective structured clinical exams (OSCEs) are a cornerstone of assessing the competence of trainee healthcare professionals, but have been criticised for (1) lacking authenticity, (2) variability in examiners’ judgements which can challenge assessment equivalence and (3) for limited diagnosticity of trainees’ focal strengths and weaknesses. In response, this study aims to investigate whether (1) sharing integrated-task OSCE stations across institutions can increase perceived authenticity, while (2) enhancing assessment equivalence by enabling comparison of the standard of examiners’ judgements between institutions using a novel methodology (video-based score comparison and adjustment (VESCA)) and (3) exploring the potential to develop more diagnostic signals from data on students’ performances. Methods and analysis: The study will use a complex intervention design, developing, implementing and sharing an integrated-task (research) OSCE across four UK medical schools. It will use VESCA to compare examiner scoring differences between groups of examiners and different sites, while studying how, why and for whom the shared OSCE and VESCA operate across participating schools. Quantitative analysis will use Many Facet Rasch Modelling to compare the influence of different examiners groups and sites on students’ scores, while the operation of the two interventions (shared integrated task OSCEs; VESCA) will be studied through the theory-driven method of Realist evaluation. Further exploratory analyses will examine diagnostic performance signals within data. Ethics and dissemination: The study will be extra to usual course requirements and all participation will be voluntary. We will uphold principles of informed consent, the right to withdraw, confidentiality with pseudonymity and strict data security. The study has received ethical approval from Keele University Research Ethics Committee. Findings will be academically published and will contribute to good practice guidance on (1) the use of VESCA and (2) sharing and use of integrated-task OSCE stations

‘I want the student to write my prescription’

What problems were addressed?Competence in prescribing is a core clinical skill required by all newly graduated doctors. Despite this, new doctors report relatively low levels of confidence in their prescribing skills and errors have been identified in approximately 8% of the prescriptions they write. Currently, in the UK, medical students are legally prohibited from prescribing for patients in the workplace. Therefore, their prescribing practice is usually limited to making suggestions about suitable drugs or to prescribing in the simulated learning environment. A core condition for clinical workplace learning is supported participation. Here, students integrate their knowledge and skills to build practical competence and the positive state of mind required for independent practice

Real-time situation awareness in critical illness management:adapting the situation-present assessment method to clinical simulation

Background Situation awareness (SA) is a human factor of critical importance to patient safety. Simulation training aims to examine and debrief human factors; however, SA cannot be directly observed. This has led to the development of SA measurement tools. The Situation Present Assessment Method (SPAM) measures SA in real-time without the need to pause the scenario. The SPAM process involves the delivery of queries to the participant who must answer them accurately and quickly. The latency between the query being asked and answer being received represents SA. Method Two query delivery procedures are described in the literature: query delivery by telephone and in person. These procedures were piloted in simulation teaching with final-year medical students. The scenarios were videotaped and reviewed by the investigators to evaluate each procedure. Our evaluation of the existing SPAM procedures led us to adapt the method by developing a bespoke application, which delivers queries via a personal digital assistant (PDA), calculates the latency data and presents it to the instructor. Results Presented by telephone, queries tended to disrupt the ‘flow’ of the simulation. The ‘in person’ procedure was not disruptive; however, participants found it difficult to distinguish queries from other dialogue. The PDA represented a compromise between these two techniques: generating data without disrupting the scenario. Conclusions The use of SPAM is feasible in clinical simulation. By using handheld technology, SA data are made available to the instructor for use in debrief; this expands the utility of SPAM to the field of medical education

How do medical schools influence their students’ career choices? A realist evaluation

IntroductionThe career choices of medical graduates vary widely between medical schools in the UK and elsewhere and are generally not well matched with societal needs. Research has found that experiences in medical school including formal, informal and hidden curricula are important influences. We conducted a realist evaluation of how and why these various social conditions in medical school influence career thinking.MethodsWe interviewed junior doctors at the point of applying for speciality training. We selected purposively for a range of career choices. Participants were asked to describe points during their medical training when they had considered career options and how their thinking had been influenced by their context. Interview transcripts were coded for context-mechanism-outcome (CMO) configurations to test initial theories of how career decisions are made.ResultsA total of 26 junior doctors from 12 UK medical schools participated. We found 14 recurring CMO configurations in the data which explained influences on career choice occurring during medical school.DiscussionOur initial theories about career decision-making were refined as follows: It involves a process of testing for fit of potential careers. This process is asymmetric with multiple experiences needed before deciding a career fits (‘easing in’) but sometimes only a single negative experience needed for a choice to be ruled out. Developing a preference for a speciality aligns with Person-Environment-Fit decision theories. Ruling out a potential career can however be a less thought-through process than rationality-based decision theories would suggest. Testing for fit is facilitated by longer and more authentic undergraduate placements, allocation of and successful completion of tasks, being treated as part of the team and enthusiastic role models. Informal career guidance is more influential than formal. We suggest some implications for medical school programmes

How well do UK assistantships equip medical students for graduate practice? Think EPAs.

The goal of better medical student preparation for clinical practice drives curricular initiatives worldwide. Learning theory underpins Entrustable Professional Activities (EPAs) as a means of safe transition to independent practice. Regulators mandate senior assistantships to improve practice readiness. It is important to know whether meaningful EPAs occur in assistantships, and with what impact. Final year students at one UK medical school kept learning logs and audio-diaries for six one-week periods during a year-long assistantship. Further data were also obtained through interviewing participants when students and after three months as junior doctors. This was combined with data from new doctors from 17 other UK schools. Realist methods explored what worked for whom and why. 32 medical students and 70 junior doctors participated. All assistantship students reported engaging with EPAs but gaps in the types of EPAs undertaken exist, with level of entrustment and frequency of access depending on the context. Engagement is enhanced by integration into the team and shared understanding of what constitutes legitimate activities. Improving the shared understanding between student and supervisor of what constitutes important assistantship activity may result in an increase in the amount and/or quality of EPAs achieved. [Abstract copyright: © 2023. The Author(s).

‘What do we do, doctor?’ Transitions of identity and responsibility: a narrative analysis

Transitioning from student to doctor is notoriously challenging. Newly qualified doctors feel required to make decisions before owning their new identity. It is essential to understand how responsibility relates to identity formation to improve transitions for doctors and patients. This multiphase ethnographic study explores realities of transition through anticipatory, lived and reflective stages. We utilised Labov’s narrative framework (Labov in J Narrat Life Hist 7(1–4):395–415, 1997) to conduct in-depth analysis of complex relationships between changes in responsibility and development of professional identity. Our objective was to understand how these concepts interact. Newly qualified doctors acclimatise to their role requirements through participatory experience, perceived as a series of challenges, told as stories of adventure or quest. Rules of interaction within clinical teams were complex, context dependent and rarely explicit. Students, newly qualified and supervising doctors felt tensions around whether responsibility should be grasped or conferred. Perceived clinical necessity was a common determinant of responsibility rather than planned learning. Identity formation was chronologically mismatched to accepting responsibility. We provide a rich illumination of the complex relationship between responsibility and identity pre, during, and post-transition to qualified doctor: the two are inherently intertwined, each generating the other through successful actions in practice. This suggests successful transition requires a supported period of identity reconciliation during which responsibility may feel burdensome. During this, there is a fine line between too much and too little responsibility: seemingly innocuous assumptions can have a significant impact. More effort is needed to facilitate behaviours that delegate authority to the transitioning learner whilst maintaining true oversight

A realist evaluation of how, why and when Objective Structured Clinical Exams (OSCEs) are experienced as an authentic assessment of clinical preparedness

Introduction: Whilst rarely researched, the authenticity with which Objective Structured Clinical Exams (OSCEs) simulate practice is arguably critical to making valid judgements about candidates’ preparedness to progress in their training. We studied how and why an OSCE gave rise to different experiences of authenticity for different participants under different circumstances.Methods: We used Realist evaluation, collecting data through interviews/ focus groups from participants across four UK medical schools who participated in an OSCE which aimed to enhance authenticity.Results: Several features of OSCE stations (realistic, complex, complete cases, sufficient time, autonomy, props, guidelines, limited examiner interaction etc) combined to enable students to project into their future roles, judge and integrate information, consider their actions and act naturally. When this occurred, their performances felt like an authentic representation of their clinical practice. This didn’t work all the time: focusing on unavoidable differences with practice, incongruous features, anxiety and preoccupation with examiners’ expectations sometimes disrupted immersion, producing inauthenticity.Conclusions: The perception of authenticity in OSCEs appears to originate from an interaction of station design with individual preferences and contextual expectations. Whilst tentatively suggesting ways to promote authenticity, more understanding is needed of candidates’ interaction with simulation and scenario immersion in summative assessment

A realist evaluation of how, why and when objective structured clinical exams (OSCEs) are experienced as an authentic assessment of clinical preparedness

Introduction: Whilst rarely researched, the authenticity with which Objective Structured Clinical Exams (OSCEs) simulate practice is arguably critical to making valid judgements about candidates’ preparedness to progress in their training. We studied how and why an OSCE gave rise to different experiences of authenticity for different participants under different circumstances. Methods: We used Realist evaluation, collecting data through interviews/focus groups from participants across four UK medical schools who participated in an OSCE which aimed to enhance authenticity. Results: Several features of OSCE stations (realistic, complex, complete cases, sufficient time, autonomy, props, guidelines, limited examiner interaction etc) combined to enable students to project into their future roles, judge and integrate information, consider their actions and act naturally. When this occurred, their performances felt like an authentic representation of their clinical practice. This didn’t work all the time: focusing on unavoidable differences with practice, incongruous features, anxiety and preoccupation with examiners’ expectations sometimes disrupted immersion, producing inauthenticity. Conclusions: The perception of authenticity in OSCEs appears to originate from an interaction of station design with individual preferences and contextual expectations. Whilst tentatively suggesting ways to promote authenticity, more understanding is needed of candidates’ interaction with simulation and scenario immersion in summative assessment