Beyond xMOOCs in healthcare education : study of the feasibility in integrating virtual patient systems and MOOC platforms

Background. Massive Open Online Courses (MOOCs) are an emerging trend in online learning. However, their technology is not yet completely adjusted to the needs of healthcare education. Integration of Virtual Patients within MOOCs to increase interactivity and foster clinical reasoning skills training, has been discussed in the past, but not verified by a practical implementation.Objective. To investigate the technical feasibility of integrating MOOCs with Virtual Patients for the purpose of enabling further research into the potential pedagogical benefits of this approach.Methods. We selected OpenEdx and Open Labyrinth as representative constituents of a MOOC platform and Virtual Patient system integration. Based upon our prior experience we selected the most fundamental technical requirement to address. Grounded in the available literature we identified an e-learning standard to guide the integration. We attempted to demonstrate the feasibility of the integration by designing a “proof-of-concept” prototype. The resulting pilot implementation was subject of verification by two test cases.Results. A Single Sign-On mechanism connecting Open Labyrinth with OpenEdx and based on the IMS LTI standard was successfully implemented and verified.Conclusion. We investigated the technical perspective of integrating Virtual Patients with MOOCs. By addressing this crucial technical requirement we set a base for future research on the educational benefits of using virtual patients in MOOCs. This provides new opportunities for integrating specialized software in healthcare education at massive scale

MOOC learners' engagement with two variants of virtual patients : a randomised trial

Introduction: Massive Open Online Courses (MOOCs) are an increasingly popular form of education in health professional education. VPs have been introduced in MOOCs to increase interactivity. There is a lack of research in understanding the reasons behind high dropout rates in MOOCs. We explored how learners interact with VPs and compared the significance of different VP designs on dropout rates. Methods: RCT of 378 participants split into two groups to interact with two VPs using different design: branching and linear. Data on node progression and VP attempts was analysed using descriptive and quantitative analysis. Results: Eight groups of learner interaction patterns were identified. The majority of learners completed the VP in a linear path in one attempt. A significant number either completed the case in a loop path in one attempt, completed in a linear path in multiple attempts or dropped out without attempting the case. VP design has a significant effect on dropout rates of learners. There is a higher dropout rate from a branched VP compared to linear VP. Discussion: Prior research showed that branched VPs are more engaging and promote greater learning compared to linear VPs. However, our results indicate that branched VPs had greater dropout compared to VPs that require less time to be solved. Conclusions: We conclude that branching had a negative effect on completion of the VP activity in the MOOC. Moreover, we believe that more complex VPs require more effort on task and this might not be a design that facilitates the interaction in a MOOC audience, where the participants might wish to acquire the basic medical knowledge offered by the course

Virtual patients in a behavioral medicine massive open online course (MOOC) : a case-based analysis of technical capacity and user navigation pathways

BACKGROUND: Massive open online courses (MOOCs) have been criticized for focusing on presentation of short video clip lectures and asking theoretical multiple-choice questions. A potential way of vitalizing these educational activities in the health sciences is to introduce virtual patients. Experiences from such extensions in MOOCs have not previously been reported in the literature. OBJECTIVE: This study analyzes technical challenges and solutions for offering virtual patients in health-related MOOCs and describes patterns of virtual patient use in one such course. Our aims are to reduce the technical uncertainty related to these extensions, point to aspects that could be optimized for a better learner experience, and raise prospective research questions by describing indicators of virtual patient use on a massive scale. METHODS: The Behavioral Medicine MOOC was offered by Karolinska Institutet, a medical university, on the EdX platform in the autumn of 2014. Course content was enhanced by two virtual patient scenarios presented in the OpenLabyrinth system and hosted on the VPH-Share cloud infrastructure. We analyzed web server and session logs and a participant satisfaction survey. Navigation pathways were summarized using a visual analytics tool developed for the purpose of this study. RESULTS: The number of course enrollments reached 19,236. At the official closing date, 2317 participants (12.1% of total enrollment) had declared completing the first virtual patient assignment and 1640 (8.5%) participants confirmed completion of the second virtual patient assignment. Peak activity involved 359 user sessions per day. The OpenLabyrinth system, deployed on four virtual servers, coped well with the workload. Participant survey respondents (n=479) regarded the activity as a helpful exercise in the course (83.1%). Technical challenges reported involved poor or restricted access to videos in certain areas of the world and occasional problems with lost sessions. The visual analyses of user pathways display the parts of virtual patient scenarios that elicited less interest and may have been perceived as nonchallenging options. Analyzing the user navigation pathways allowed us to detect indications of both surface and deep approaches to the content material among the MOOC participants. CONCLUSIONS: This study reported on first inclusion of virtual patients in a MOOC. It adds to the body of knowledge by demonstrating how a biomedical cloud provider service can ensure technical capacity and flexible design of a virtual patient platform on a massive scale. The study also presents a new way of analyzing the use of branched virtual patients by visualization of user navigation pathways. Suggestions are offered on improvements to the design of virtual patients in MOOCs

Knowledge transfer of eLearning objects: Lessons learned from an intercontinental capacity building project

Background Effective knowledge transfer of eLearning objects can hasten the adoption and dissemination of technology in teaching and learning. However, challenges exist which hinder inter-organisational knowledge transfer, particularly across continents. The ACoRD project aimed to transfer knowledge on digital learning development from UK/EU (provider) to Malaysian (receiver) higher education institutions (HEIs). This study explores the challenges encountered during the knowledge transfer process and lessons learned. Methods This is a qualitative study involving both the knowledge providers and receivers in focus group discussions (n = 25). Four focus group discussions were conducted in the early (n = 2) and mid-phase (n = 2) of the project by trained qualitative researchers using a topic guide designed to explore experiences and activities representing knowledge transfer in multi-institutional and multi-cultural settings. The interviews were audio-recorded, transcribed verbatim, and checked. The transcripts were analysed using thematic analysis. Results Five main themes emerged from this qualitative study: mismatched expectations between providers and receivers; acquiring new knowledge beyond the professional "comfort zone"; challenges in cascading newly acquired knowledge to colleagues and management; individual and organisational cultural differences; and disruption of knowledge transfer during the COVID-19 pandemic. Conclusion This study highlights the need to create a conducive platform to facilitate continuous, timely and bi-directional needs assessment and feedback; this should be done in the early phase of the knowledge transfer process. The challenges and strategies identified in this study could guide more effective knowledge transfer between organisations and countries.publishedVersio

Virtual Patient Simulations in Health Professions Education: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration.

BACKGROUND: Virtual patients are interactive digital simulations of clinical scenarios for the purpose of health professions education. There is no current collated evidence on the effectiveness of this form of education. OBJECTIVE: The goal of this study was to evaluate the effectiveness of virtual patients compared with traditional education, blended with traditional education, compared with other types of digital education, and design variants of virtual patients in health professions education. The outcomes of interest were knowledge, skills, attitudes, and satisfaction. METHODS: We performed a systematic review on the effectiveness of virtual patient simulations in pre- and postregistration health professions education following Cochrane methodology. We searched 7 databases from the year 1990 up to September 2018. No language restrictions were applied. We included randomized controlled trials and cluster randomized trials. We independently selected studies, extracted data, and assessed risk of bias and then compared the information in pairs. We contacted study authors for additional information if necessary. All pooled analyses were based on random-effects models. RESULTS: A total of 51 trials involving 4696 participants met our inclusion criteria. Furthermore, 25 studies compared virtual patients with traditional education, 11 studies investigated virtual patients as blended learning, 5 studies compared virtual patients with different forms of digital education, and 10 studies compared different design variants. The pooled analysis of studies comparing the effect of virtual patients to traditional education showed similar results for knowledge (standardized mean difference [SMD]=0.11, 95% CI -0.17 to 0.39, I2=74%, n=927) and favored virtual patients for skills (SMD=0.90, 95% CI 0.49 to 1.32, I2=88%, n=897). Studies measuring attitudes and satisfaction predominantly used surveys with item-by-item comparison. Trials comparing virtual patients with different forms of digital education and design variants were not numerous enough to give clear recommendations. Several methodological limitations in the included studies and heterogeneity contributed to a generally low quality of evidence. CONCLUSIONS: Low to modest and mixed evidence suggests that when compared with traditional education, virtual patients can more effectively improve skills, and at least as effectively improve knowledge. The skills that improved were clinical reasoning, procedural skills, and a mix of procedural and team skills. We found evidence of effectiveness in both high-income and low- and middle-income countries, demonstrating the global applicability of virtual patients. Further research should explore the utility of different design variants of virtual patients

Prioritising topics for developing e-learning resources in healthcare curricula: A comparison between students and educators using a modified Delphi survey

Background Engaging students in the e-learning development process enhances the effective implementation of e-learning, however, students’ priority on the topics for e-learning may differ from that of the educators. This study aims to compare the differences between the students and their educators in prioritising the topics in three healthcare curricula for reusable e-learning object (RLO) development. Method A modified Delphi study was conducted among students and educators from University Malaya (UM), Universiti Putra Malaysia (UPM) and Taylor’s University (TU) on three undergraduate programmes. In Round 1, participants were asked to select the topics from the respective syllabi to be developed into RLOs. Priority ranking was determined by using frequencies and proportions. The first quartile of the prioritised topics was included in Round 2 survey, which the participants were asked to rate the level of priority of each topic using a 5-point Likert scale. The mean score of the topics was compared between students and educators. Result A total of 43 educators and 377 students participated in this study. For UM and TU Pharmacy, there was a mismatch in the prioritised topics between the students and educators. For UPM, both the educators and students have prioritised the same topics in both rounds. To harmonise the prioritisation of topics between students and educators for UM and TU Pharmacy, the topics with a higher mean score by both the students and educators were prioritised. Conclusion The mismatch in prioritised topics between students and educators uncovered factors that might influence the prioritisation process. This study highlighted the importance of conducting needs assessment at the beginning of eLearning resources development