Automation of a problem list using natural language processing

BACKGROUND: The medical problem list is an important part of the electronic medical record in development in our institution. To serve the functions it is designed for, the problem list has to be as accurate and timely as possible. However, the current problem list is usually incomplete and inaccurate, and is often totally unused. To alleviate this issue, we are building an environment where the problem list can be easily and effectively maintained. METHODS: For this project, 80 medical problems were selected for their frequency of use in our future clinical field of evaluation (cardiovascular). We have developed an Automated Problem List system composed of two main components: a background and a foreground application. The background application uses Natural Language Processing (NLP) to harvest potential problem list entries from the list of 80 targeted problems detected in the multiple free-text electronic documents available in our electronic medical record. These proposed medical problems drive the foreground application designed for management of the problem list. Within this application, the extracted problems are proposed to the physicians for addition to the official problem list. RESULTS: The set of 80 targeted medical problems selected for this project covered about 5% of all possible diagnoses coded in ICD-9-CM in our study population (cardiovascular adult inpatients), but about 64% of all instances of these coded diagnoses. The system contains algorithms to detect first document sections, then sentences within these sections, and finally potential problems within the sentences. The initial evaluation of the section and sentence detection algorithms demonstrated a sensitivity and positive predictive value of 100% when detecting sections, and a sensitivity of 89% and a positive predictive value of 94% when detecting sentences. CONCLUSION: The global aim of our project is to automate the process of creating and maintaining a problem list for hospitalized patients and thereby help to guarantee the timeliness, accuracy and completeness of this information

Doctor of Philosophy

dissertationThe use of the various complementary and alternative medicine (CAM) modalities for the management of chronic illnesses is widespread, and still on the rise. Unfortunately, tools to support consumers in seeking information on the efficacy of these treatments are sparse and incomplete. The goals of this work were to understand CAM information needs in acquiring CAM information, assess currently available information resources, and investigate informatics methods to provide a foundation for the development of CAM information resources. This dissertation consists of four studies. The first was a quantitative study that aimed to assess the feasibility of delivering CAM-drug interaction information through a web-based application. This study resulted in an 85% participation rate and 33% of those patients reported the use of CAMs that had potential interactions with their conventional treatments. The next study aimed to assess online CAM information resources that provide information on drug-herb interactions to consumers. None of the sites scored high on the combination of completeness and accuracy and all sites were beyond the recommended reading level per the US Department of Health and Human Services. The third study investigated information-seeking behaviors for CAM information using an existing cohort of cancer survivors. The study showed that patients in the cohort continued to use CAM well into survivorship. Patients felt very much on their own in dealing with issues outside of direct treatment, which often resulted in a search for options and CAM use. Finally, a study was conducted to investigate two methods to semi-automatically extract CAM treatment relations from the biomedical literature. The methods rely on a database (SemMedDB) of semantic relations extracted from PubMed abstracts. This study demonstrated that SemMedDB can be used to reduce manual efforts, but review of the extracted sentences is still necessary due to a low mean precision of 23.7% and 26.4%. In summary, this dissertation provided greater insight into consumer information needs for CAM. Our findings provide an opportunity to leverage existing resources to improve the information-seeking experience for consumers through high-quality online tools, potentially moving them beyond the reliance on anecdotal evidence in the decision-making process for CAM

A clinician-mediated, longitudinal tracking system for the follow-up of clinical results

Thesis (S.M.)--Harvard-MIT Division of Health Sciences and Technology, 2005.Includes bibliographical references (p. 36-37).Failure to follow-up on abnormal tests is a common clinical concern comprising the quality of care. Although many clinicians track their patient follow-up by scheduling follow-up visits or by leaving physical reminders, most feel that automated, computerized systems to track abnormal test results would be useful. While existing clinical decision support systems and computerized clinical reminders focus on providing assistance with choosing the appropriate follow-up management, they fail by not tracking that follow-up effectively. We believe that clinicians do not want suggestions how to manage their patients, but instead want help tracking follow-up results once they have decided the management plan. We believe that a well-designed system can successfully track this follow-up and only require a small amount of information and time from the clinician. We have designed and implemented a complete tracking system including 1) an authoring tool to define tracking guidelines, 2) a query tool to search electronic medical records and identify patients without follow-up, and 3) a clinical tool to send reminders to clinicians and allow them to easily choose the follow-up management. Our tracking system has made improvements on previous reminder systems by 1) using our unique risk-management guideline model that more closely mirrors, yet does not attempt to replicate, the clinical decision process, 2) our use of massive population-based queries for tracking all patients simultaneously, and 3) our longitudinal approach that documents all steps in the patient follow-up cycle. With these developments, we are able to track 450 million pieces of clinical data for 1.8 million patients daily.(cont.) Keyword follow-up tracking; reminder system; preventive medicine; computerized medical record system; practice guidelines; clinical decision support systemby Daniel Todd Rosenthal.S.M

Methods to Facilitate the Capture, Use, and Reuse of Structured and Unstructured Clinical Data.

Electronic health records (EHRs) have great potential to improve quality of care and to support clinical and translational research. While EHRs are being increasingly implemented in U.S. hospitals and clinics, their anticipated benefits have been largely unachieved or underachieved. Among many factors, tedious documentation requirements and the lack of effective information retrieval tools to access and reuse data are two key reasons accounting for this deficiency. In this dissertation, I describe my research on developing novel methods to facilitate the capture, use, and reuse of both structured and unstructured clinical data. Specifically, I develop a framework to investigate potential issues in this research topic, with a focus on three significant challenges. The first challenge is structured data entry (SDE), which can be facilitated by four effective strategies based on my systematic review. I further propose a multi-strategy model to guide the development of future SDE applications. In the follow-up study, I focus on workflow integration and evaluate the feasibility of using EHR audit trail logs for clinical workflow analysis. The second challenge is the use of clinical narratives, which can be supported by my innovative information retrieval (IR) technique called “semantically-based query recommendation (SBQR)”. My user experiment shows that SBQR can help improve the perceived performance of a medical IR system, and may work better on search tasks with average difficulty. The third challenge involves reusing EHR data as a reference standard to benchmark the quality of other health-related information. My study assesses the readability of trial descriptions on ClinicalTrials.gov and found that trial descriptions are very hard to read, even harder than clinical notes. My dissertation has several contributions. First, it conducts pioneer studies with innovative methods to improve the capture, use, and reuse of clinical data. Second, my dissertation provides successful examples for investigators who would like to conduct interdisciplinary research in the field of health informatics. Third, the framework of my research can be a great tool to generate future research agenda in clinical documentation and EHRs. I will continue exploring innovative and effective methods to maximize the value of EHRs.PHDInformationUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/135845/1/tzuyu_1.pd

Early recognition of multiple sclerosis using natural language processing of the electronic health record

Background Diagnostic accuracy might be improved by algorithms that searched patients’ clinical notes in the electronic health record (EHR) for signs and symptoms of diseases such as multiple sclerosis (MS). The focus this study was to determine if patients with MS could be identified from their clinical notes prior to the initial recognition by their healthcare providers. Methods An MS-enriched cohort of patients with well-established MS (n = 165) and controls (n = 545), was generated from the adult outpatient clinic. A random sample cohort was generated from randomly selected patients (n = 2289) from the same adult outpatient clinic, some of whom had MS (n = 16). Patients’ notes were extracted from the data warehouse and signs and symptoms mapped to UMLS terms using MedLEE. Approximately 1000 MS-related terms occurred significantly more frequently in MS patients’ notes than controls’. Synonymous terms were manually clustered into 50 buckets and used as classification features. Patients were classified as MS or not using Naïve Bayes classification. Results Classification of patients known to have MS using notes of the MS-enriched cohort entered after the initial ICD9[MS] code yielded an ROC AUC, sensitivity, and specificity of 0.90 [0.87-0.93], 0.75[0.66-0.82], and 0.91 [0.87-0.93], respectively. Similar classification accuracy was achieved using the notes from the random sample cohort. Classification of patients not yet known to have MS using notes of the MS-enriched cohort entered before the initial ICD9[MS] documentation identified 40% [23–59%] as having MS. Manual review of the EHR of 45 patients of the random sample cohort classified as having MS but lacking an ICD9[MS] code identified four who might have unrecognized MS. Conclusions Diagnostic accuracy might be improved by mining patients’ clinical notes for signs and symptoms of specific diseases using NLP. Using this approach, we identified patients with MS early in the course of their disease which could potentially shorten the time to diagnosis. This approach could also be applied to other diseases often missed by primary care providers such as cancer. Whether implementing computerized diagnostic support ultimately shortens the time from earliest symptoms to formal recognition of the disease remains to be seen

Supporting Clinical Decision Making in Cancer Care Delivery

Background: Cancer treatment and management require complicated clinical decision making to provide the highest quality of care for an individual patient. This is facilitated in part with ever-increasing availability of medications and treatments but hindered due to barriers such as access to care, cost of medications, clinician knowledge, and patient preferences or clinical factors. Although guidelines for cancer treatment and many symptoms have been developed to inform clinical practice, implementation of these guidelines into practice is often delayed or does not occur. Informatics-based approaches, such as clinical decision support, may be an effective tool to improve guideline implementation by delivering patient-specific and evidence-based knowledge to the clinician at the point of care to allow shared decision making with a patient and their family. The large amount of data in the electronic health record can be utilized to develop, evaluate, and implement automated approaches; however, the quality of the data must first be examined and evaluated. Methods: This dissertation addresses gaps the literature about clinical decision making for cancer care delivery. Specifically, following an introduction and review of the literature for relevant topics to this dissertation, the researcher presents three studies. In Study One, the researcher explores the use of clinical decision support in cancer therapeutic decision making by conducting a systematic review of the literature. In Study Two, the researcher conducts a quantitative study to describe the rate of guideline concordant care provided for prevention of acute chemotherapy-induced nausea and vomiting (CINV) and to identify predictors of receiving guideline concordant care. In Study Three, the researcher conducts a mixed-methods study to evaluate the completeness, concordance, and heterogeneity of clinician documentation of CINV. The final chapter of this dissertation is comprised of key findings of each study, the strengths and limitations, clinical and research implications, and future research. Results: In Study One, the systematic review, the researcher identified ten studies that prospectively studied clinical decision support systems or tools in a cancer setting to guide therapeutic decision making. There was variability in these studies, including study design, outcomes measured, and results. There was a trend toward benefit, both in process and patient-specific outcomes. Importantly, few studies were integrated into the electronic health record. In Study Two, of 180 patients age 26 years or less, 36% received guideline concordant care as defined by pediatric or adult guidelines, as appropriate. Factors associated with receiving guideline concordant care included receiving a cisplatin-based regimen, being treated in adult oncology compared to pediatric oncology, and solid tumor diagnosis. In Study Three, of the 127 patient records reviewed for the documentation of chemotherapy-induced nausea and vomiting, 75% had prescriber assessment documented and 58% had nursing assessment documented. Of those who had documented assessments by both prescriber and nurse, 72% were in agreement of the presence/absence of chemotherapy-induced nausea and vomiting. After mapping the concept through the United Medical Language System and developing a post-coordinated expression to identify chemotherapy-induced nausea and vomiting in the text, 85% of prescriber documentation and 100% of nurse documentation could be correctly categorized as present/absent. Further descriptors of the symptoms, such as severity or temporality, however, were infrequently reported. Conclusion: In summary, this dissertation provides new knowledge about decision making in cancer care delivery. Specifically, in Study One the researcher describes that clinical decision support, one potential implementation strategy to improve guideline concordant care, is understudied or under published but a promising potential intervention. In Study Two, I identified factors that were associated with receipt of guideline concordant care for CINV, and these should be further explored to develop interventions. Finally, in Study Three, I report on the limitations of the data quality of CINV documentation in the electronic health record. Future work should focus on validating these results on a multi-institutional level

Computer-interpretable guidelines using GLIF with Windows workflow foundation

Modern medicine is increasingly using evidence based medicine (EBM). EBM has become an integral part of medical training and ultimately on practice. Davis et al. [6] describe the “clinical care gap” where actual day-to-day clinical practice differs from EBC, leading to poor outcomes. This thesis researches the GLIF specification and implements the foundation for a GLIF based guideline system using Windows Workflow Foundation 4.0. There exists no public domain computer implementable guideline system. The guideline system developed allows a guideline implementer to create a guideline visually using certain medical related tasks, and to test and debug them before implementation. Chapter 5 of this thesis shows how to implement a guideline called Group A Streptococcal Disease Surveillance Protocol for Ontario Hospitals which is of fundamental importance for Ontario hospitals. The workflow approach allows developers to create custom tasks should the need arise. The Workflow Foundation provides a powerful set of base classes to implement clinical guidelines.Master's These

Computerization of workflows, guidelines and care pathways: a review of implementation challenges for process-oriented health information systems

There is a need to integrate the various theoretical frameworks and formalisms for modeling clinical guidelines, workflows, and pathways, in order to move beyond providing support for individual clinical decisions and toward the provision of process-oriented, patient-centered, health information systems (HIS). In this review, we analyze the challenges in developing process-oriented HIS that formally model guidelines, workflows, and care pathways. A qualitative meta-synthesis was performed on studies published in English between 1995 and 2010 that addressed the modeling process and reported the exposition of a new methodology, model, system implementation, or system architecture. Thematic analysis, principal component analysis (PCA) and data visualisation techniques were used to identify and cluster the underlying implementation ‘challenge’ themes. One hundred and eight relevant studies were selected for review. Twenty-five underlying ‘challenge’ themes were identified. These were clustered into 10 distinct groups, from which a conceptual model of the implementation process was developed. We found that the development of systems supporting individual clinical decisions is evolving toward the implementation of adaptable care pathways on the semantic web, incorporating formal, clinical, and organizational ontologies, and the use of workflow management systems. These architectures now need to be implemented and evaluated on a wider scale within clinical settings