Development and implementation of a novel Web-based gaming application to enhance emergency medical technician knowledge in low- and middle-income countries

Background: Increasing access to high-quality emergency and prehospital care is an important priority in low- and middle-income countries (LMICs). However, ensuring that emergency medical technicians (EMTs) maintain their clinical knowledge and proficiency with procedural skills is challenging, as continuing education requirements are still being introduced, and clinical instructional efforts need strengthening. We describe the development and implementation of an innovative asynchronous learning tool for EMTs in the form of a Web-based trivia game. Methods: Over 500 case-based multiple-choice questions (covering 10 essential prehospital content areas) were created by experts in prehospital education, piloted with EMT educators from LMICs, and delivered to EMTs through a Web-based quiz game platform over a 12-week period. We enrolled 252 participants from nine countries. Results: Thirty-two participants (12.7%) completed the entire 12-week game. Participants who completed the game were administered a survey with a 100% response rate. Ninety-three percent of participants used their mobile phone to access the game. Overall, participants reported that the interface was easy to use (93.8% agreed or strongly agreed), the game improved their knowledge (100% agreed or strongly agreed), and they felt better prepared for their jobs (100% agreed or strongly agreed). The primary motivators for participation were improving patient care (37.5%) and being recognized on the game\u27s leaderboard (31.3%). All participants reported that they would engage in the game again (43.8% agreed and 56.3% strongly agreed) and would recommend the game to their colleagues (34.4% agreed and 65.6% strongly agreed). Conclusions: In conclusion, a quiz game targeting EMT learners from LMICs was viewed as accessible and effective by participants. Future efforts should focus on increasing retention and trialing languages in addition to English

Non-transport after prehospital naloxone administration is associated with higher risk of subsequent non-fatal overdose

Objective U.S. opioid overdoses increased nearly six-fold from 1999 to 2018, and greater than 1% of all EMS encounters now involve naloxone administration. While treat and release protocols may have low short-term mortality, the risk of subsequent non-fatal overdoses is not known. This study compares the risk of repeat overdose encounters between patients transported to an emergency department (ED) and those who refused transport after prehospital naloxone administration. Methods All EMS charts within a large single-tier fire-based urban EMS system between January 1 and August 31, 2018 were reviewed if either naloxone administration or a clinical impression related to opioid overdose was documented. Charts were excluded if there was no documented evidence of an opioid toxidrome (respiratory depression or altered mental status), if there was another clear explanation for the symptoms (e.g., hypoglycemia), or if naloxone was not administered. Ten percent of charts were reviewed by a second author to assess reliability. Cox regression (survival analysis) was used to estimate the risk of a subsequent EMS encounter with naloxone administration following an index encounter with naloxone administration. Results Of 2143 charts reviewed, 1311 unique patients with 1600 overdose encounters involving naloxone administration were identified. Inter-rater reliability for chart inclusion was strong [κ = 0.83 (95% CI 0.72-0.90)]. Police/bystanders administered naloxone in 208/1600 (13.0%) encounters. A substantial proportion of encounters resulted in transport refusal (674/1600, 42.1%). The final Cox model included only refusal vs. acceptance of transport to an ED during the index EMS encounter. Patient age, gender, and naloxone administration prior to EMS arrival were not statistically significant in univariate or multivariable analyses, nor were they significant confounders. Refusal of transport was associated with a hazard ratio of 1.66 (95% CI 1.23-2.23) for subsequent EMS encounters with naloxone administration. Conclusions Non-transport after prehospital naloxone administration is associated with an increased risk of subsequent non-fatal overdose requiring EMS intervention. Limitations include the use of a single EMS agency as patients may have had uncaptured overdose encounters in neighboring municipalities. Keywords: EMS (emergency medical services); drug overdose; naloxone; treatment refusal

The revised Approved Instructional Resources score:An improved quality evaluation tool for online educational resources

BACKGROUND: Free Open-Access Medical education (FOAM) use among residents continues to rise. However, it often lacks quality assurance processes and residents receive little guidance on quality assessment. The Academic Life in Emergency Medicine Approved Instructional Resources tool (AAT) was created for FOAM appraisal by and for expert educators and has demonstrated validity in this context. It has yet to be evaluated in other populations.OBJECTIVES: We assessed the AAT's usability in a diverse population of practicing emergency medicine (EM) physicians, residents, and medical students; solicited feedback; and developed a revised tool.METHODS: As part of the Medical Education Translational Resources: Impact and Quality (METRIQ) study, we recruited medical students, EM residents, and EM attendings to evaluate five FOAM posts with the AAT and provide quantitative and qualitative feedback via an online survey. Two independent analysts performed a qualitative thematic analysis with discrepancies resolved through discussion and negotiated consensus. This analysis informed development of an initial revised AAT, which was then further refined after pilot testing among the author group. The final tool was reassessed for reliability.RESULTS: Of 330 recruited international participants, 309 completed all ratings. The Best Evidence in Emergency Medicine (BEEM) score was the component most frequently reported as difficult to use. Several themes emerged from the qualitative analysis: for ease of use-understandable, logically structured, concise, and aligned with educational value. Limitations include deviation from questionnaire best practices, validity concerns, and challenges assessing evidence-based medicine. Themes supporting its use include evaluative utility and usability. The author group pilot tested the initial revised AAT, revealing a total score average measure intraclass correlation coefficient (ICC) of moderate reliability (ICC = 0.68, 95% confidence interval [CI] = 0 to 0.962). The final AAT's average measure ICC was 0.88 (95% CI = 0.77 to 0.95).CONCLUSIONS: We developed the final revised AAT from usability feedback. The new score has significantly increased usability, but will need to be reassessed for reliability in a broad population.</p

The Social Media Index as an Indicator of Quality for Emergency Medicine Blogs: A METRIQ Study

Study objective: Online educational resources such as blogs are increasingly used for education by emergency medicine clinicians. The Social Media Index was developed to quantify their relative impact. The Medical Education Translational Resources: Indicators of Quality (METRIQ) study was conducted in part to determine the association between the Social Media Index score and quality as measured by gestalt and previously derived quality instruments. Methods: Ten blogs were randomly selected from a list of emergency medicine and critical care Web sites. The 2 most recent clinically oriented blog posts published on these blogs were evaluated with gestalt, the Academic Life in Emergency Medicine Approved Instructional Resources (ALiEM AIR) score, and the METRIQ-8 score. Volunteer raters (including medical students, emergency medicine residents, and emergency medicine attending physicians) were identified with a multimodal recruitment methodology. The Social Media Index was calculated in February 2016, November 2016, April 2017, and December 2017. Pearson's correlations were calculated between the Social Media Index and the average rater gestalt, ALiEM AIR score, and METRIQ-8 score. Results: A total of 309 of 330 raters completed all ratings (93.6%). The Social Media Index correlated moderately to strongly with the mean rater gestalt ratings (range 0.69 to 0.76) and moderately with the mean rater ALiEM AIR score (range 0.55 to 0.61) and METRIQ-8 score (range 0.53 to 0.57) during the month of the blog post's selection and for 2 years after. Conclusion: The Social Media Index's correlation with multiple quality evaluation instruments over time supports the hypothesis that it is associated with overall Web site quality. It can play a role in guiding individuals to high-quality resources that can be reviewed with critical appraisal techniques