Quality and Publication of Emergency Medicine Trials Registered in ClinicalTrials.gov

Introduction: Promoting emergency medicine (EM) clinical trials research remains a priority. To characterize the status of clinical EM research, this study assessed trial quality, funding source, and publication of EM clinical trials and compared EM and non-EM trials on these key metrics. We also examined the volume of EM trials and their subspecialty areas.Methods: We abstracted data from ClinicalTrials.gov (February 2000 - September 2013) and used individual study National Clinical Trial numbers to identify published trials (January 2007 - September 2016). We used descriptive statistics and chi-square tests to examine study characteristics by EM and non-EM status, and Kaplan-Meier curves and log-rank tests to compare time to publication of completed EM and non-EM studies.Results: We found 638 interventional EM trials and 59,512 non-EM interventional trials conducted in the United States between February 2000 and September 2013, registered on ClinicalTrials.gov. EM studies were significantly less likely than non-EM studies to be National Institutes of Health-funded or to evaluate a drug or biologic. However, EM studies had significantly larger sample sizes, and were significantly more likely to use randomization and blinding. Overall, 34.3% of EM and 26.0% of non-EM studies were published in peer-reviewed journals. By subspecialty, more EM trials concerned medical/surgical and psychiatric/neurological conditions than trauma.Conclusion: Although EM studies were less likely to have received federal or industry funding, and the EM portfolio consisted of only 638 trials over the 14-year study period, the quality of EM trials surpassed that of non-EM trials, based on indices such as randomization and blinding. This novel finding bodes well for the future of clinical EM research, as does the higher proportion of published EM than non-EM trials. Our study also revealed that trauma studies were under-represented among EM studies. Periodic assessment of EM trials with the metrics used here could provide an informative and valuable longitudinal view of progress in clinical EM research

Extracting information from the text of electronic medical records to improve case detection: a systematic review

Background: Electronic medical records (EMRs) are revolutionizing health-related research. One key issue for study quality is the accurate identification of patients with the condition of interest. Information in EMRs can be entered as structured codes or unstructured free text. The majority of research studies have used only coded parts of EMRs for case-detection, which may bias findings, miss cases, and reduce study quality. This review examines whether incorporating information from text into case-detection algorithms can improve research quality. Methods: A systematic search returned 9659 papers, 67 of which reported on the extraction of information from free text of EMRs with the stated purpose of detecting cases of a named clinical condition. Methods for extracting information from text and the technical accuracy of case-detection algorithms were reviewed. Results: Studies mainly used US hospital-based EMRs, and extracted information from text for 41 conditions using keyword searches, rule-based algorithms, and machine learning methods. There was no clear difference in case-detection algorithm accuracy between rule-based and machine learning methods of extraction. Inclusion of information from text resulted in a significant improvement in algorithm sensitivity and area under the receiver operating characteristic in comparison to codes alone (median sensitivity 78% (codes + text) vs 62% (codes), P = .03; median area under the receiver operating characteristic 95% (codes + text) vs 88% (codes), P = .025). Conclusions: Text in EMRs is accessible, especially with open source information extraction algorithms, and significantly improves case detection when combined with codes. More harmonization of reporting within EMR studies is needed, particularly standardized reporting of algorithm accuracy metrics like positive predictive value (precision) and sensitivity (recall)

Modeling Big Medical Survival Data Using Decision Tree Analysis with Apache Spark

In many medical studies, an outcome of interest is not only whether an event occurred, but when an event occurred; and an example of this is Alzheimer’s disease (AD). Identifying patients with Mild Cognitive Impairment (MCI) who are likely to develop Alzheimer’s disease (AD) is highly important for AD treatment. Previous studies suggest that not all MCI patients will convert to AD. Massive amounts of data from longitudinal and extensive studies on thousands of Alzheimer’s patients have been generated. Building a computational model that can predict conversion form MCI to AD can be highly beneficial for early intervention and treatment planning for AD. This work presents a big data model that contains machine-learning techniques to determine the level of AD in a participant and predict the time of conversion to AD. The proposed framework considers one of the widely used screening assessment for detecting cognitive impairment called Montreal Cognitive Assessment (MoCA). MoCA data set was collected from different centers and integrated into our large data framework storage using a Hadoop Data File System (HDFS); the data was then analyzed using an Apache Spark framework. The accuracy of the proposed framework was compared with a semi-parametric Cox survival analysis model

Characterization of neurophysiologic and neurocognitive biomarkers for use in genomic and clinical outcome studies of schizophrenia.

BackgroundEndophenotypes are quantitative, laboratory-based measures representing intermediate links in the pathways between genetic variation and the clinical expression of a disorder. Ideal endophenotypes exhibit deficits in patients, are stable over time and across shifts in psychopathology, and are suitable for repeat testing. Unfortunately, many leading candidate endophenotypes in schizophrenia have not been fully characterized simultaneously in large cohorts of patients and controls across these properties. The objectives of this study were to characterize the extent to which widely-used neurophysiological and neurocognitive endophenotypes are: 1) associated with schizophrenia, 2) stable over time, independent of state-related changes, and 3) free of potential practice/maturation or differential attrition effects in schizophrenia patients (SZ) and nonpsychiatric comparison subjects (NCS). Stability of clinical and functional measures was also assessed.MethodsParticipants (SZ n = 341; NCS n = 205) completed a battery of neurophysiological (MMN, P3a, P50 and N100 indices, PPI, startle habituation, antisaccade), neurocognitive (WRAT-3 Reading, LNS-forward, LNS-reorder, WCST-64, CVLT-II). In addition, patients were rated on clinical symptom severity as well as functional capacity and status measures (GAF, UPSA, SOF). 223 subjects (SZ n = 163; NCS n = 58) returned for retesting after 1 year.ResultsMost neurophysiological and neurocognitive measures exhibited medium-to-large deficits in schizophrenia, moderate-to-substantial stability across the retest interval, and were independent of fluctuations in clinical status. Clinical symptoms and functional measures also exhibited substantial stability. A Longitudinal Endophenotype Ranking System (LERS) was created to rank neurophysiological and neurocognitive biomarkers according to their effect sizes across endophenotype criteria.ConclusionsThe majority of neurophysiological and neurocognitive measures exhibited deficits in patients, stability over a 1-year interval and did not demonstrate practice or time effects supporting their use as endophenotypes in neural substrate and genomic studies. These measures hold promise for informing the "gene-to-phene gap" in schizophrenia research

Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling

A well-established notion in cognitive neuroscience proposes that multiple brain systems contribute to choice behaviour. These include: (1) a model-free system that uses values cached from the outcome history of alternative actions, and (2) a model-based system that considers action outcomes and the transition structure of the environment. The widespread use of this distinction, across a range of applications, renders it important to index their distinct influences with high reliability. Here we consider the two-stage task, widely considered as a gold standard measure for the contribution of model-based and model-free systems to human choice. We tested the internal/temporal stability of measures from this task, including those estimated via an established computational model, as well as an extended model using drift-diffusion. Drift-diffusion modeling suggested that both choice in the first stage, and RTs in the second stage, are directly affected by a model-based/free trade-off parameter. Both parameter recovery and the stability of model-based estimates were poor but improved substantially when both choice and RT were used (compared to choice only), and when more trials (than conventionally used in research practice) were included in our analysis. The findings have implications for interpretation of past and future studies based on the use of the two-stage task, as well as for characterising the contribution of model-based processes to choice behaviour