Assessing the validity of using serious game technology to analyze physician decision making

Background: Physician non-compliance with clinical practice guidelines remains a critical barrier to high quality care. Serious games (using gaming technology for serious purposes) have emerged as a method of studying physician decision making. However, little is known about their validity. Methods: We created a serious game and evaluated its construct validity. We used the decision context of trauma triage in the Emergency Department of non-trauma centers, given widely accepted guidelines that recommend the transfer of severely injured patients to trauma centers. We designed cases with the premise that the representativeness heuristic influences triage (i.e. physicians make transfer decisions based on archetypes of severely injured patients rather than guidelines). We randomized a convenience sample of emergency medicine physicians to a control or cognitive load arm, and compared performance (disposition decisions, number of orders entered, time spent per case). We hypothesized that cognitive load would increase the use of heuristics, increasing the transfer of representative cases and decreasing the transfer of non-representative cases. Findings: We recruited 209 physicians, of whom 168 (79%) began and 142 (68%) completed the task. Physicians transferred 31% of severely injured patients during the game, consistent with rates of transfer for severely injured patients in practice. They entered the same average number of orders in both arms (control (C): 10.9 [SD 4.8] vs. cognitive load (CL):10.7 [SD 5.6], p = 0.74), despite spending less time per case in the control arm (C: 9.7 [SD 7.1] vs. CL: 11.7 [SD 6.7] minutes, p<0.01). Physicians were equally likely to transfer representative cases in the two arms (C: 45% vs. CL: 34%, p = 0.20), but were more likely to transfer non-representative cases in the control arm (C: 38% vs. CL: 26%, p = 0.03). Conclusions: We found that physicians made decisions consistent with actual practice, that we could manipulate cognitive load, and that load increased the use of heuristics, as predicted by cognitive theory. © 2014 Mohan et al

Reasons Why Emergency Department Providers Do Not Rely on the Pneumonia Severity Index to Determine the Initial Site of Treatment for Patients with Pneumonia

Background. Many emergency department (ED) providers do not follow guideline recommendations for the use of the pneumonia severity index (PSI) to determine the initial site of treatment for patients with community-acquired pneumonia (CAP). We identified the reasons why ED providers hospitalize low-risk patients or manage higher-risk patients as outpatients. Methods. As a part of a trial to implement a PSI-based guideline for the initial site of treatment of patients with CAP, we analyzed data for patients managed at 12 EDs allocated to a high-intensity guideline implementation strategy study arm. The guideline recommended outpatient care for low-risk patients (nonhypoxemic patients with a PSI risk classification of I, II, or III) and hospitalization for higher-risk patients (hypoxemic patients or patients with a PSI risk classification of IV or V). We asked providers who made guideline-discordant decisions on site of treatment to detail the reasons for nonadherence to guideline recommendations. Results. There were 1,306 patients with CAP (689 low-risk patients and 617 higher-risk patients). Among these patients, physicians admitted 258 (37.4%) of 689 low-risk patients and treated 20 (3.2%) of 617 higher-risk patients as outpatients. The most commonly reported reasons for admitting low-risk patients were the presence of a comorbid illness (178 [71.5%] of 249 patients); a laboratory value, vital sign, or symptom that precluded ED discharge (73 patients [29.3%]); or a recommendation from a primary care or a consulting physician (48 patients [19.3%]). Higher-risk patients were most often treated as outpatients because of a recommendation by a primary care or consulting physician (6 [40.0%] of 15 patients). Conclusion. ED providers hospitalize many low-risk patients with CAP, most frequently for a comorbid illness. Although higher-risk patients are infrequently treated as outpatients, this decision is often based on the request of an involved physicia

Prehospital Systolic Blood Pressure Thresholds: A Community‐based Outcomes Study

Objectives Emergency medical services (EMS) personnel commonly use systolic blood pressure ( sBP ) to triage and treat acutely ill patients. The definition of prehospital hypotension and its associated outcomes are poorly defined. The authors sought to determine the discrimination of prehospital sBP thresholds for 30‐day mortality and to compare patient classification by best‐performing thresholds to traditional cutoffs. Methods In a community‐based cohort of adult, nontrauma, noncardiac arrest patients transported by EMS between 2002 and 2006, entries to state hospital discharge data and death certificates were linked. Prehospital sBP thresholds between 40 and 140 mm Hg in derivation ( n =  132,624) and validation ( n =  22,020) cohorts and their discrimination for 30‐day mortality, were examined. Cutoffs were evaluated using the 0/1 distance, Youden index, and adjusted Z‐statistics from multivariable logistic regression models. Results In the derivation cohort, 1,594 (1.2%) died within 24 hours, 7,404 (6%) were critically ill during hospitalization, and 6,888 (5%) died within 30 days. The area under the receiver operating characteristic (ROC) curve for sBP was 0.60 (95% confidence interval [CI] = 0.59, 0.61) for 30‐day mortality and 0.64 (95% CI = 0.62 0.66) for 24‐hour mortality. The 0/1 distance, Youden index, and adjusted Z‐statistics found best‐performing sBP thresholds between 110 and 120 mm Hg. When compared to an sBP ≤ 90 mm Hg, a cutoff of 110 mm Hg would identify 17% ( n =  137) more deaths at 30 days, while overtriaging four times as many survivors. Conclusions Prehospital sBP is a modest discriminator of clinical outcomes, yet no threshold avoids substantial misclassification of 30‐day mortality among noninjured patients. Resumen Los Umbrales de la Presión Arterial Sistólica Prehospitalaria: Un Estudio de Base Comunitaria Acerca de la Evolución de los Pacientes Objetivos El personal de los sistemas de emergencias médicas ( SEM ) usa frecuentemente la presión arterial sistólica ( PAS ) para clasificar y tratar a los pacientes agudos. Las definiciones de hipotensión prehospitalaria y sus resultados asociados están pobremente definidos. Se determinó la discriminación de los umbrales de PAS prehospitalaria para la mortalidad a los 30 días, y se comparó la clasificación del paciente por los mejores umbrales con los puntos de corte tradicionales. Metodología Estudio de cohorte de base comunitaria de pacientes adultos no traumatológicos ni con paradas cardiorrespiratorias transportados por los SEM entre 2002 y 2006, cuyas historias estaban vinculadas con los datos de alta hospitalaria y los certificados de mortalidad. Se examinaron los umbrales de PAS prehospitalaria entre 40 mm Hg y 140 mm Hg en las cohortes de derivación ( n =  132.624), y validación ( n =  22,020), y su discriminación para la mortalidad a los 30 días. Los puntos de corte se evaluaron usando la distancia 0/1, el índice de Youden y los estadísticos Z ajustados de los modelos de regresión logística multivariable. Resultados: En la cohorte de derivación, 1.594 (1,2%) fallecieron en las primeras 24 horas, 7.404 (6%) estuvieron críticamente enfermos durante el ingreso y 6.888 (5%) fallecieron en los 30 primeros días. El área bajo la curva de la ROC para PAS fue 0,60 ( IC 95% = 0,59–0,61) para la mortalidad a los 30 días y 0,64 ( IC 95% = 0,62–0,66) para la mortalidad a las 24 horas. La distancia 0/1, el índice de Youden y las estadísticas Z ajustadas hallaronque los mejores umbrales de PAS estaban entre 110 y 120 mm Hg. Cuando se comparó con una PAS ≤ 90 mm Hg, un punto de corte de 110 mm Hg identificaría un 17% ( n =  137) más de muertes a los 30 días, mientras que sobreclasificaría cuatro veces más a los supervivientes. Conclusiones La presión arterial sistólica es un discriminador modesto de resultados clínicos. No obstante, ningún umbral evita una mala clasificación de la mortalidad a los 30 días entre los pacientes no traumatológicos.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/98303/1/acem12142-sup-0002-DataSupplementS2_FigS1.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/98303/2/acem12142-sup-0007-DataSupplementS7_FigS4.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/98303/3/acem12142-sup-0006-DataSupplementS6_FigS3.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/98303/4/acem12142-sup-0009-DataSupplementS9_TableS3.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/98303/5/acem12142-sup-0003-DataSupplementS3.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/98303/6/acem12142-sup-0008-DataSupplementS8_TableS2.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/98303/7/acem12142-sup-0004-DataSupplementS4_TableS1.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/98303/8/acem12142-sup-0001-DataSupplementS1.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/98303/9/acem12142.pd

The effect of surveillance and appreciative inquiry on puerperal infections : a longitudinal cohort study in India

Peer reviewedPublisher PD

Network analysis of team communication in a busy emergency department

Background: The Emergency Department (ED) is consistently described as a high-risk environment for patients and clinicians that demands colleagues quickly work together as a cohesive group. Communication between nurses, physicians, and other ED clinicians is complex and difficult to track. A clear understanding of communications in the ED is lacking, which has a potentially negative impact on the design and effectiveness of interventions to improve communications. We sought to use Social Network Analysis (SNA) to characterize communication between clinicians in the ED. Methods. Over three-months, we surveyed to solicit the communication relationships between clinicians at one urban academic ED across all shifts. We abstracted survey responses into matrices, calculated three standard SNA measures (network density, network centralization, and in-degree centrality), and presented findings stratified by night/day shift and over time. Results: We received surveys from 82% of eligible participants and identified wide variation in the magnitude of communication cohesion (density) and concentration of communication between clinicians (centralization) by day/night shift and over time. We also identified variation in in-degree centrality (a measure of power/influence) by day/night shift and over time. Conclusions: We show that SNA measurement techniques provide a comprehensive view of ED communication patterns. Our use of SNA revealed that frequency of communication as a measure of interdependencies between ED clinicians varies by day/night shift and over time. © 2013 Patterson et al.; licensee BioMed Central Ltd

Bench-to-bedside review: The evaluation of complex interventions in critical care

Complex interventions, such as the introduction of medical emergency teams or an early goal-directed therapy protocol, are developed from a number of components that may act both independently and inter-dependently. There is an emerging body of literature advocating the use of integrated complex interventions to optimise the treatment of critically ill patients. As with any other treatment, complex interventions should undergo careful evaluation prior to widespread introduction into clinical practice. During the development of an international collaboration of researchers investigating protocol-based approaches to the resuscitation of patients with severe sepsis, we examined the specific issues related to the evaluation of complex interventions. This review outlines some of these issues. The issues specific to trials of complex interventions that require particular attention include determining an appropriate study population and defining current treatments and outcomes in that population, defining the study intervention and the treatment to be used in the control group, and deploying the intervention in a standardised manner. The context in which the research takes place, including existing staffing levels and existing protocols and procedures, is crucial. We also discuss specific details of trial execution, in particular randomization, blinded outcome adjudication and analysis of the results, which are key to avoiding bias in the design and interpretation of such trials

Differences in designations of observation care in US freestanding children's hospitals: Are they virtual or real?

OBJECTIVE: To characterize practices related to observation care and to examine the current models of pediatric observation medicine in US children's hospitals. DESIGN: We utilized 2 web‐based surveys to examine observation care in the 42 hospitals participating in the Pediatric Health Information System database. We obtained information regarding the designation of observation status, including the criteria used to admit patients into observation. From hospitals reporting the use of observation status, we requested specific details relating to the structures of observation care and the processes of care for observation patients following emergency department treatment. RESULTS: A total of 37 hospitals responded to Survey 1, and 20 hospitals responded to Survey 2. Designated observation units were present in only 12 of 31 (39%) hospitals that report observation patient data to the Pediatric Health Information System. Observation status was variably defined in terms of duration of treatment and prespecified criteria. Observation periods were limited to <48 hours in 24 of 31 (77%) hospitals. Hospitals reported that various standards were used by different payers to determine observation status reimbursement. Observation care was delivered in a variety of settings. Most hospitals indicated that there were no differences in the clinical care delivered to virtual observation status patients when compared with other inpatients. CONCLUSIONS: Observation is a variably applied patient status, defined differently by individual hospitals. Consistency in the designation of patients under observation status among hospitals and payers may be necessary to compare quality outcomes and costs, as well as optimize models of pediatric observation care. Journal of Hospital Medicine 2012;. © 2011 Society of Hospital Medicine.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/91108/1/949_ftp.pd

Enhancement of CURB65 score with proadrenomedullin (CURB65-A) for outcome prediction in lower respiratory tract infections: Derivation of a clinical algorithm

Proadrenomedullin (ProADM) confers additional prognostic information to established clinical risk scores in lower respiratory tract infections (LRTI). We aimed to derive a practical algorithm combining the CURB65 score with ProADM-levels in patients with community-acquired pneumonia (CAP) and non-CAP-LRTI