Structural indicators for effective quality assurance of snomed ct

The Standardized Nomenclature of Medicine -- Clinical Terms (SNOMED CT -- further abbreviated as SCT) has been endorsed as a premier clinical terminology by many national and international organizations. The US Government has chosen SCT to play a significant role in its initiative to promote Electronic Health Record (EH R) country-wide. However, there is evidence suggesting that, at the moment, SCT is not optimally modeled for its intended use by healthcare practitioners. There is a need to perform quality assurance (QA) of SCT to help expedite its use as a reference terminology for clinical purposes as planned for EH R use. The central theme of this dissertation is to define a group-based auditing methodology to effectively identify concepts of SCT that require QA. As such, similarity sets are introduced which are groups of concepts that are lexically identical except for one word. Concepts in a similarity set are expected to be modeled in a consistent way. If not, the set is considered to be inconsistent and submitted for review by an auditor. Initial studies found 38% of such sets to be inconsistent. The effectiveness of these sets is further improved through the use of three structural indicators. Using such indicators as the number of parents, relationships and role groups, up to 70% of the similarity sets and 32.6% of the concepts are found to exhibit inconsistencies. Furthermore, positional similarity sets, which are similarity sets with the same position of the differing word in the concept’s terms, are introduced to improve the likelihood of finding errors at the concept level. This strictness in the position of the differing word increases the lexical similarity between the concepts of a set thereby increasing the contrast between lexical similarities and modeling differences. This increase in contrast increases the likelihood of finding inconsistencies. The effectiveness of positional similarity sets in finding inconsistencies is further improved by using the same three structural indicators as discussed above in the generation of these sets. An analysis of 50 sample sets with differences in the number of relationships reveal 41.6% of the concepts to be inconsistent. Moreover, a study is performed to fully automate the process of suggesting attributes to enhance the modeling of SCT concepts using positional similarity sets. A technique is also used to automatically suggest the corresponding target values. An analysis of 50 sample concepts show that, of the 103 suggested attributes, 67 are manually confirmed to be correct. Finally, a study is conducted to examine the readiness of SCT problem list (PL) to support meaningful use of EHR. The results show that the concepts in PL suffer from the same issues as general SCT concepts, although to a slightly lesser extent, and do require further QA efforts. To support such efforts, structural indicators in the form of the number of parents and the number of words are shown to be effective in ferreting out potentially problematic concepts in which QA efforts should be focused. A structural indicator to find concepts with synonymy problems is also presented by finding pairs of SCT concepts that map to the same UMLS concept

Master of Science

thesisLack of information is a serious concern for clinicians. Information resources can address this problem, leading to improvements in decision making and patient outcomes. Genomics is an information-rich domain where searching for information can be complex. For example, most physicians agree that pharmacogenomics can be used to improve the quality of care, and there is evidence that many patients harbor actionable pharmacogenomic variation. However, surveys have shown that physicians feel their knowledge of pharmacogenomics to be inadequate. This represents an information need. A natural approach to meet this need is to provide context-aware access to the precise information needed. The Health Level 7 Context-Aware Knowledge Retrieval Standard, a.k.a the Infobutton, offers a modality to deliver context-aware knowledge into electronic health record (EHR) systems. OpenInfobutton is a reference implementation of this standard that offers an open-source instantiation. In this thesis, we aimed to provide insight into pharmacogenomics information needs and an automated mechanism for addressing these needs. Such work can aid the design of tools that support clinical decisions in genomics

Identifying Health Facilities outside the Enterprise: Challenges and Strategies for Supporting Health Reform and Meaningful Use

Objective: To support collation of data for disability determination, we sought to accurately identify facilities where care was delivered across multiple, independent hospitals and clinics. Methods: Data from various institutions' electronic health records were merged and delivered as continuity of care documents to the United States Social Security Administration (SSA). Results: Electronic records for nearly 8000 disability claimants were exchanged with SSA. Due to the lack of standard nomenclature for identifying the facilities in which patients received the care documented in the electronic records, SSA could not match the information received with information provided by disability claimants. Facility identifiers were generated arbitrarily by health care systems and therefore could not be mapped to the existing international standards. Discussion: We propose strategies for improving facility identification in electronic health records to support improved tracking of a patient's care between providers to better serve clinical care delivery, disability determination, health reform and meaningful use. Conclusion: Accurately identifying the facilities where health care is delivered to patients is important to a number of major health reform and improvement efforts underway in many nations. A standardized nomenclature for identifying health care facilities is needed to improve tracking of care and linking of electronic health records

Using structural and semantic methodologies to enhance biomedical terminologies

Biomedical terminologies and ontologies underlie various Health Information Systems (HISs), Electronic Health Record (EHR) Systems, Health Information Exchanges (HIEs) and health administrative systems. Moreover, the proliferation of interdisciplinary research efforts in the biomedical field is fueling the need to overcome terminological barriers when integrating knowledge from different fields into a unified research project. Therefore well-developed and well-maintained terminologies are in high demand. Most of the biomedical terminologies are large and complex, which makes it impossible for human experts to manually detect and correct all errors and inconsistencies. Automated and semi-automated Quality Assurance methodologies that focus on areas that are more likely to contain errors and inconsistencies are therefore important. In this dissertation, structural and semantic methodologies are used to enhance biomedical terminologies. The dissertation work is divided into three major parts. The first part consists of structural auditing techniques for the Semantic Network of the Unified Medical Language System (UMLS), which serves as a vocabulary knowledge base for biomedical research in various applications. Research techniques are presented on how to automatically identify and prevent erroneous semantic type assignments to concepts. The Web-based adviseEditor system is introduced to help UMLS editors to make correct multiple semantic type assignments to concepts. It is made available to the National Library of Medicine for future use in maintaining the UMLS. The second part of this dissertation is on how to enhance the conceptual content of SNOMED CT by methods of semantic harmonization. By 2015, SNOMED will become the standard terminology for EH R encoding of diagnoses and problem lists. In order to enrich the semantics and coverage of SNOMED CT for clinical and research applications, the problem of semantic harmonization between SNOMED CT and six reference terminologies is approached by 1) comparing the vertical density of SNOM ED CT with the reference terminologies to find potential concepts for export and import; and 2) categorizing the relationships between structurally congruent concepts from pairs of terminologies, with SNOMED CT being one terminology in the pair. Six kinds of configurations are observed, e.g., alternative classifications, and suggested synonyms. For each configuration, a corresponding solution is presented for enhancing one or both of the terminologies. The third part applies Quality Assurance techniques based on “Abstraction Networks” to biomedical ontologies in BioPortal. The National Center for Biomedical Ontology provides B ioPortal as a repository of over 350 biomedical ontologies covering a wide range of domains. It is extremely difficult to design a new Quality Assurance methodology for each ontology in BioPortal. Fortunately, groups of ontologies in BioPortal share common structural features. Thus, they can be grouped into families based on combinations of these features. A uniform Quality Assurance methodology design for each family will achieve improved efficiency, which is critical with the limited Quality Assurance resources available to most ontology curators. In this dissertation, a family-based framework covering 186 BioPortal ontologies and accompanying Quality Assurance methods based on abstraction networks are presented to tackle this problem

Doctor of Philosophy

dissertationThe problem of information transfer between healthcare sectors and across the continuum of care was examined using a mixed methods approach. These methods include qualitative interviews, retrospective case reviews and an informatic gap analysis. Findings and conclusions are reported for each study. Qualitative interviews were conducted with 16 healthcare representatives from 4 disciplines (medicine, pharmacy, nursing, and social work) and 3 healthcare sectors (hospital, skilled nursing care and community care). Three key themes from a Joint Cognitive Systems theoretical model were used to examine qualitative findings. Agreement on cross-sector care goals is neither defined nor made explicit and in some instances working at cross purposes. Care goals and information paradigms change as patients move from hospitalbased crisis stabilization, diagnosis and treatment to a postdischarge care to home or skilled nursing recovery, function restoration, or end of life support. Control of the transfer process is variable across institutions with little feedback and feed-forward. Lack of knowledge, competency and information tracking threatens sector interdependencies with suspicion and distrust. Sixty-three patients discharged between 2006 and 2008 from hospitals to skilled nursing facilities were randomly selected and reviewed. Most notably missing are discharge summaries (30%), nursing assessments or notes (17%), and social work documents (25%). Advanced directives or living wills necessary for end of life support were present in only 6% of the cases. The presence of information on activities of daily living (ADLs), other disabling conditions, and nutrition was associated with positive outcomes at the 0.001, 0.04 and 0.08levels. Consistent geriatric information transfer across the continuum is needed for relevant care management. An interoperability gap analysis conducted on the LINC (Linking Information Necessary for Care) transfer form determined its interoperability to be the semantic level 0. Detailed Clinical Models representing care management processes are challenged by the lack of consensus in terminology standards across sectors. Construction of information transfer solutions compliant with the Centers of Medicare and Medicaid Services (CMS) Stage 2 meaningful use criteria must address syntactic and semantic standards, map sector terminologies within care management processes, and account for the lack of standard terminologies in allied health domains

Front-Line Physicians' Satisfaction with Information Systems in Hospitals

Day-to-day operations management in hospital units is difficult due to continuously varying situations, several actors involved and a vast number of information systems in use. The aim of this study was to describe front-line physicians' satisfaction with existing information systems needed to support the day-to-day operations management in hospitals. A cross-sectional survey was used and data chosen with stratified random sampling were collected in nine hospitals. Data were analyzed with descriptive and inferential statistical methods. The response rate was 65 % (n = 111). The physicians reported that information systems support their decision making to some extent, but they do not improve access to information nor are they tailored for physicians. The respondents also reported that they need to use several information systems to support decision making and that they would prefer one information system to access important information. Improved information access would better support physicians' decision making and has the potential to improve the quality of decisions and speed up the decision making process.Peer reviewe

Issues of the adoption of HIT related standards at the decision-making stage of six tertiary healthcare organisations in Saudi Arabia

Due to interoperability barriers between clinical information systems, healthcare organisations are facing potential limitations with regard to acquiring the benefits such systems offer; in particular, in terms of reducing the cost of medical services. However, to achieve the level of interoperability required to reduce these problems, a high degree of consensus is required regarding health data standards. Although such standards essentially constitute a solution to the interoperability barriers mentioned above, the level of adoption of these standards remains frustratingly low. One reason for this is that health data standards are an authoritative field in which marketplace mechanisms do not work owing to the fact that health data standards developed for a particular market cannot, in general, be applied in other markets without modification. Many countries have launched national initiatives to develop and promote national health data standards but, although certain authors have mapped the landscape of the standardisation process for health data in some countries, these studies have failed to explain why the healthcare organisations seem unwilling to adopt those standards. In addressing this gap in the literature, a conceptual model of the adoption process of HIT related standards at the decision-making stage in healthcare organisations is proposed in this research. This model was based on two predominant theories regarding IT related standards in the IS field: Rogers paradigm (1995) and the economics of standards theory. In addition, the twenty one constructs of this model resulted from a comprehensive set of factors derived from the related literature; these were then grouped in accordance with the Technology-Organisation Environment (TOE), a well-known taxonomy within innovation adoption studies in the IS field. Moving from a conceptual to an empirical position, an interpretive, exploratory, multiple-case study methodology was conducted in Saudi Arabia to examine the proposed model. The empirical qualitative evidence gained necessitated some revision to be made to the proposed model. One factor was abandoned, four were modified and eight new factors were added. This consistent empirical model makes a novel contribution at two levels. First, with regard to the body of knowledge in the IS area, this model offers an in-depth understanding of the adoption process of HIT related standards which the literature still lacks. It also examines the applicability of IS theories in a new area which allows others to relate their experiences to those reported. Secondly, this model can be used by decision makers in the healthcare sector, particularly those in developing countries, as a guideline while planning for the adoption of health data standards

Doctor of Philosophy

DissertationHealth information technology (HIT) in conjunction with quality improvement (QI) methodologies can promote higher quality care at lower costs. Unfortunately, most inpatient hospital settings have been slow to adopt HIT and QI methodologies. Successful adoption requires close attention to workflow. Workflow is the sequence of tasks, processes, and the set of people or resources needed for those tasks that are necessary to accomplish a given goal. Assessing the impact on workflow is an important component of determining whether a HIT implementation will be successful, but little research has been conducted on the impact of eMeasure (electronic performance measure) implementation on workflow. One solution to addressing implementation challenges such as the lack of attention to workflow is an implementation toolkit. An implementation toolkit is an assembly of instruments such as checklists, forms, and planning documents. We developed an initial eMeasure Implementation Toolkit for the heart failure (HF) eMeasure to allow QI and information technology (IT) professionals and their team to assess the impact of implementation on workflow. During the development phase of the toolkit, we undertook a literature review to determine the components of the toolkit. We conducted stakeholder interviews with HIT and QI key informants and subject matter experts (SMEs) at the US Department of Veteran Affairs (VA). Key informants provided a broad understanding about the context of workflow during eMeasure implementation. Based on snowball sampling, we also interviewed other SMEs based on the recommendations of the key informants who suggested tools and provided information essential to the toolkit development. The second phase involved evaluation of the toolkit for relevance and clarity, by experts in non-VA settings. The experts evaluated the sections of the toolkit that contained the tools, via a survey. The final toolkit provides a distinct set of resources and tools, which were iteratively developed during the research and available to users in a single source document. The research methodology provided a strong unified overarching implementation framework in the form of the Promoting Action on Research Implementation in Health Services (PARIHS) model in combination with a sociotechnical model of HIT that strengthened the overall design of the study

Automatic Generation of Personalized Recommendations in eCoaching

Denne avhandlingen omhandler eCoaching for personlig livsstilsstøtte i sanntid ved bruk av informasjons- og kommunikasjonsteknologi. Utfordringen er å designe, utvikle og teknisk evaluere en prototyp av en intelligent eCoach som automatisk genererer personlige og evidensbaserte anbefalinger til en bedre livsstil. Den utviklede løsningen er fokusert på forbedring av fysisk aktivitet. Prototypen bruker bærbare medisinske aktivitetssensorer. De innsamlede data blir semantisk representert og kunstig intelligente algoritmer genererer automatisk meningsfulle, personlige og kontekstbaserte anbefalinger for mindre stillesittende tid. Oppgaven bruker den veletablerte designvitenskapelige forskningsmetodikken for å utvikle teoretiske grunnlag og praktiske implementeringer. Samlet sett fokuserer denne forskningen på teknologisk verifisering snarere enn klinisk evaluering.publishedVersio

A Learning Health System for Radiation Oncology

The proposed research aims to address the challenges faced by clinical data science researchers in radiation oncology accessing, integrating, and analyzing heterogeneous data from various sources. The research presents a scalable intelligent infrastructure, called the Health Information Gateway and Exchange (HINGE), which captures and structures data from multiple sources into a knowledge base with semantically interlinked entities. This infrastructure enables researchers to mine novel associations and gather relevant knowledge for personalized clinical outcomes. The dissertation discusses the design framework and implementation of HINGE, which abstracts structured data from treatment planning systems, treatment management systems, and electronic health records. It utilizes disease-specific smart templates for capturing clinical information in a discrete manner. HINGE performs data extraction, aggregation, and quality and outcome assessment functions automatically, connecting seamlessly with local IT/medical infrastructure. Furthermore, the research presents a knowledge graph-based approach to map radiotherapy data to an ontology-based data repository using FAIR (Findable, Accessible, Interoperable, Reusable) concepts. This approach ensures that the data is easily discoverable and accessible for clinical decision support systems. The dissertation explores the ETL (Extract, Transform, Load) process, data model frameworks, ontologies, and provides a real-world clinical use case for this data mapping. To improve the efficiency of retrieving information from large clinical datasets, a search engine based on ontology-based keyword searching and synonym-based term matching tool was developed. The hierarchical nature of ontologies is leveraged to retrieve patient records based on parent and children classes. Additionally, patient similarity analysis is conducted using vector embedding models (Word2Vec, Doc2Vec, GloVe, and FastText) to identify similar patients based on text corpus creation methods. Results from the analysis using these models are presented. The implementation of a learning health system for predicting radiation pneumonitis following stereotactic body radiotherapy is also discussed. 3D convolutional neural networks (CNNs) are utilized with radiographic and dosimetric datasets to predict the likelihood of radiation pneumonitis. DenseNet-121 and ResNet-50 models are employed for this study, along with integrated gradient techniques to identify salient regions within the input 3D image dataset. The predictive performance of the 3D CNN models is evaluated based on clinical outcomes. Overall, the proposed Learning Health System provides a comprehensive solution for capturing, integrating, and analyzing heterogeneous data in a knowledge base. It offers researchers the ability to extract valuable insights and associations from diverse sources, ultimately leading to improved clinical outcomes. This work can serve as a model for implementing LHS in other medical specialties, advancing personalized and data-driven medicine