Crisis, change and the future for teaching and learning in general practice

Objectives: The aim of this study was to explore the decisions and decision-making strategies employed by academic GPs tasked with adapting the delivery of undergraduate general practice education curricula to virtual platforms during the Covid-19 pandemic. We sought to investigate how their experiences of this adaptation might influence the development of future curricula. Methods: Recognising our 'insider' positions and constructivist paradigm preferences, we approached the study from a constructivist grounded theory (CGT) perspective and participants participated in semi-structured interviews. Results: Nine participants from three university GP departments in Ireland described the transition to online delivery of the curriculum as a 'response approach'. Participants described seeking collaboration both within and between institutions. The value and limitations of student feedback as a driver for change differed between participants and recognised the impact of limited social engagement between peers on social determinants of learning. Participants with prior experience in e-learning were inclined to recommend some level of continuation. Two institutions plan to continue to incorporate aspects of blended learning. Conclusion and implications: All participants recognised a level of value (efficiency, social engagement and continuity) in online learning, they were less clear on the specific educational value and impact of this (e.g. on knowledge, skills and attributes). We need to consider which elements of undergraduate education can be delivered effectively online. Maintaining the socio-cultural learning environment is of critical importance but must be balanced by efficient, informed and strategic educational design.</p

‘Wii-habilitation’ and robotic exoskeletons: technology in physiotherapy

For mobility-impaired patients, gait retraining is an integral part of the rehabilitation programme. Manual assisted body weight support treadmill training (BWSTT) has been a major focus of research and is considered one of the primary methods of gait retraining. In recent years the focus of research has shifted to robotic assisted treadmill training, which is as efficacious as manual assisted BWSTT but is considered more cost-effective with respect to personnel and labour. The Lokomat® is a machine that provides robotic assisted treadmill training by means of a robotic gait orthosis, body weight support system and treadmill. Manufactured by Hocoma in Switzerland, it has been the subject of intense media attention since it was introduced to the US in 2001. Similar attention has been given to the Nintendo Wii™ gaming system for its potential role in rehabilitation. Although not specifically designed for use in the medical arena, the Nintendo Wii™ has been linked with functional rehabilitation benefits in a variety of patient groups. The aim of this paper is to review the clinical applications of the Lokomat® and Nintendo Wii™, and to provide an analysis of the advantages and disadvantages associated with each as a physiotherapy modality in rehabilitation. </p

Profiling postgraduate workplace-based assessment implementation in Ireland: a retrospective cohort study

In 2010, workplace-based assessment (WBA) was formally integrated as a method of formative trainee assessment into 29 basic and higher specialist medical training (BST/HST) programmes in six postgraduate training bodies in Ireland. The aim of this study is to explore how WBA is being implemented and to examine if WBA is being used formatively as originally intended. A retrospective cohort study was conducted and approved by the institution's Research Ethics Committee. A profile of WBA requirements was obtained from 29 training programme curricula. A data extraction tool was developed to extract anonymous data, including written feedback and timing of assessments, from Year 1 and 2 trainee ePortfolios in 2012-2013. Data were independently quality assessed and compared to the reference standard number of assessments mandated annually where relevant. All 29 training programmes mandated the inclusion of at least one case-based discussion (max = 5; range 1-5). All except two non-clinical programmes (93 %) required at least two mini-Clinical Evaluation Exercise assessments per year and Direct Observation of Procedural Skills assessments were mandated in 27 training programmes over the course of the programme. WBA data were extracted from 50 % of randomly selected BST ePortfolios in four programmes (n = 142) and 70 % of HST ePortfolios (n = 115) in 21 programmes registered for 2012-2013. Four programmes did not have an eligible trainee for that academic year. In total, 1142 WBAs were analysed. A total of 164 trainees (63.8 %) had completed at least one WBA. The average number of WBAs completed by HST trainees was 7.75 (SD 5.8; 95 % CI 6.5-8.9; range 1-34). BST trainees completed an average of 6.1 assessments (SD 9.3; 95 % CI 4.01-8.19; range 1-76). Feedback-of varied length and quality-was provided on 44.9 % of assessments. The majority of WBAs were completed in the second half of the year. There is significant heterogeneity with respect to the frequency and quality of feedback provided during WBAs. The completion of WBAs later in the year may limit available time for feedback, performance improvement and re-evaluation. This study sets the scene for further work to explore the value of formative assessment in postgraduate medical education.In 2010, workplace-based assessment (WBA) was formally integrated as a method of formative trainee assessment into 29 basic and higher specialist medical training (BST/HST) programmes in six postgraduate training bodies in Ireland. The aim of this study is to explore how WBA is being implemented and to examine if WBA is being used formatively as originally intended. A retrospective cohort study was conducted and approved by the institution's Research Ethics Committee. A profile of WBA requirements was obtained from 29 training programme curricula. A data extraction tool was developed to extract anonymous data, including written feedback and timing of assessments, from Year 1 and 2 trainee ePortfolios in 2012-2013. Data were independently quality assessed and compared to the reference standard number of assessments mandated annually where relevant. All 29 training programmes mandated the inclusion of at least one case-based discussion (max = 5; range 1-5). All except two non-clinical programmes (93 %) required at least two mini-Clinical Evaluation Exercise assessments per year and Direct Observation of Procedural Skills assessments were mandated in 27 training programmes over the course of the programme. WBA data were extracted from 50 % of randomly selected BST ePortfolios in four programmes (n = 142) and 70 % of HST ePortfolios (n = 115) in 21 programmes registered for 2012-2013. Four programmes did not have an eligible trainee for that academic year. In total, 1142 WBAs were analysed. A total of 164 trainees (63.8 %) had completed at least one WBA. The average number of WBAs completed by HST trainees was 7.75 (SD 5.8; 95 % CI 6.5-8.9; range 1-34). BST trainees completed an average of 6.1 assessments (SD 9.3; 95 % CI 4.01-8.19; range 1-76). Feedback-of varied length and quality-was provided on 44.9 % of assessments. The majority of WBAs were completed in the second half of the year. There is significant heterogeneity with respect to the frequency and quality of feedback provided during WBAs. The completion of WBAs later in the year may limit available time for feedback, performance improvement and re-evaluation. This study sets the scene for further work to explore the value of formative assessment in postgraduate medical education

A BEME (Best Evidence in Medical Education) systematic review of the use of workplace-based assessment in identifying and remediating poor performance among postgraduate medical trainees

Background: Workplace-based assessments were designed to facilitate observation and structure feedback on the performance of trainees in real-time clinical settings and scenarios. Research in workplace-based assessments has primarily centred on understanding psychometric qualities and performance improvement impacts of trainees generally. An area that is far less understood is the use of workplace-based assessments for trainees who may not be performing at expected or desired standards, referred to within the literature as trainees ‘in difficulty’ or ‘underperforming’. In healthcare systems that increasingly depend on service provided by junior doctors, early detection (and remediation) of poor performance is essential. However, barriers to successful implementation of workplace-based assessments (WBAs) in this context include a misunderstanding of the use and purpose of these formative assessment tools. This review aims to explore the impact - or effectiveness - of workplace-based assessment on the identification of poor performance and to determine those conditions that support and enable detection, i.e. whether by routine or targeted use where poor performance is suspected. The review also aims to explore what effect (if any) the use of WBA may have on remediation or on changing clinical practice. The personal impact of the detection of poor performance on trainees and/or trainers may also be explored. Methods/design: Using BEME (Best Evidence in Medical Education) Collaboration review guidelines, nine databases will be searched for English-language records. Studies examining interventions for workplace-based assessment either routinely or in relation to poor performance will be included. Independent agreement (kappa .80) will be achieved using a randomly selected set of records prior to commencement of screening and data extraction using a BEME coding sheet modified as applicable (Buckley et al., Med Teach 31:282-98, 2009) as this has been used in previous WBA systematic reviews (Miller and Archer, BMJ doi:10.1136/bmj.c5064, 2010) allowing for more rigorous comparisons with the published literature. Educational outcomes will be evaluated using Kirkpatrick’s framework of educational outcomes using Barr’s adaptations (Barr et al., Evaluations of interprofessional education; a United Kingdom review of health and social care, 2000) for medical education research. Discussion: Our study will contribute to an ongoing international debate regarding the applicability of workplace-based assessments as a meaningful formative assessment approach within the context of postgraduate medical education. Systematic review registration: The review has been registered by the BEME Collaboration www.bemecollaboration.org