69 research outputs found

    How to interact with medical terminologies? Formative usability evaluations comparing three approaches for supporting the use of MedDRA by pharmacovigilance specialists

    Get PDF
    Background: Medical terminologies are commonly used in medicine. For instance, to answer a pharmacovigilance question, pharmacovigilance specialists (PVS) search in a pharmacovigilance database for reports in relation to a given drug. To do that, they first need to identify all MedDRA terms that might have been used to code an adverse reaction in the database, but terms may be numerous and difficult to select as they may belong to different parts of the hierarchy. In previous studies, three tools have been developed to help PVS identify and group all relevant MedDRA terms using three different approaches: forms, structured query-builder, and icons. Yet, a poor usability of the tools may increase PVS' workload and reduce their performance. This study aims to evaluate, compare and improve the three tools during two rounds of formative usability evaluation. Methods: First, a cognitive walkthrough was performed. Based on the design recommendations obtained from this evaluation, designers made modifications to their tools to improve usability. Once this re-engineering phase completed, six PVS took part in a usability test: difficulties, errors and verbalizations during their interaction with the three tools were collected. Their satisfaction was measured through the System Usability Scale. The design recommendations issued from the tests were used to adapt the tools. Results: All tools had usability problems related to the lack of guidance in the graphical user interface (e.g., unintuitive labels). In two tools, the use of the SNOMED CT to find MedDRA terms hampered their use because French PVS were not used to it. For the most obvious and common terms, the icons-based interface would appear to be more useful. For the less frequently used MedDRA terms or those distributed in different parts of the hierarchy, the structured query-builder would be preferable thanks to its great power and flexibility. The form-based tool seems to be a compromise. Conclusion: These evaluations made it possible to identify the strengths of each tool but also their weaknesses to address them before further evaluation. Next step is to assess the acceptability of tools and the expressiveness of their results to help identify and group MedDRA terms

    SNOMED CT standard ontology based on the ontology for general medical science

    Get PDF
    Background: Systematized Nomenclature of Medicine—Clinical Terms (SNOMED CT, hereafter abbreviated SCT) is acomprehensive medical terminology used for standardizing the storage, retrieval, and exchange of electronic healthdata. Some efforts have been made to capture the contents of SCT as Web Ontology Language (OWL), but theseefforts have been hampered by the size and complexity of SCT. Method: Our proposal here is to develop an upper-level ontology and to use it as the basis for defining the termsin SCT in a way that will support quality assurance of SCT, for example, by allowing consistency checks ofdefinitions and the identification and elimination of redundancies in the SCT vocabulary. Our proposed upper-levelSCT ontology (SCTO) is based on the Ontology for General Medical Science (OGMS). Results: The SCTO is implemented in OWL 2, to support automatic inference and consistency checking. Theapproach will allow integration of SCT data with data annotated using Open Biomedical Ontologies (OBO) Foundryontologies, since the use of OGMS will ensure consistency with the Basic Formal Ontology, which is the top-levelontology of the OBO Foundry. Currently, the SCTO contains 304 classes, 28 properties, 2400 axioms, and 1555annotations. It is publicly available through the bioportal athttp://bioportal.bioontology.org/ontologies/SCTO/. Conclusion: The resulting ontology can enhance the semantics of clinical decision support systems and semanticinteroperability among distributed electronic health records. In addition, the populated ontology can be used forthe automation of mobile health applications

    Terminology Services: Standard Terminologies to Control Medical Vocabulary. “Words are Not What they Say but What they Mean”

    Get PDF
    Data entry is an obstacle for the usability of electronic health records (EHR) applications and the acceptance of physicians, who prefer to document using “free text”. Natural language is huge and very rich in details but at the same time is ambiguous; it has great dependence on context and uses jargon and acronyms. Healthcare Information Systems should capture clinical data in a structured and preferably coded format. This is crucial for data exchange between health information systems, epidemiological analysis, quality and research, clinical decision support systems, administrative functions, etc. In order to address this point, numerous terminological systems for the systematic recording of clinical data have been developed. These systems interrelate concepts of a particular domain and provide reference to related terms and possible definitions and codes. The purpose of terminology services consists of representing facts that happen in the real world through database management. This process is named Semantic Interoperability. It implies that different systems understand the information they are processing through the use of codes of clinical terminologies. Standard terminologies allow controlling medical vocabulary. But how do we do this? What do we need? Terminology services are a fundamental piece for health data management in health environment

    The Development of Medical Record Items: a User-centered, Bottom-up Approach

    Get PDF
    Objectives: Clinical documents (CDs) have evolved from traditional paper documents containing narrative text information into the electronic record sheets composed of itemized records, where each record is expressed as an item with a specific value. We defined medical record (MR) items to be information entities with a specific value. These entities were then used to compile form-based clinical documents as part of an electronic health record system (EHR-s). Methods: We took a reusable bottom-up developmental approach for the MR items, which provided three things: efficient incorporation of the local needs and requirements of the medical professionals from various departments in the hospital, comprehensive inclusion of the essential concepts of the basic elements required in clinical documents, and the provision of a structured means for meaningful data entry and retrieval. This paper delineates our experiences in developing and managing medical records at a large tertiary university hospital in Korea. Results: We collected 63,232 MR items from paper records scanned into 962 CDs. The MR item database was constructed using 13,287 MR items after removing redundant items. During the first year of service users requested changes to be made to 235 (1.8%) attributes of the MR items and also requested the additional 9,572 new MR items. In the second year, the attributes of 70 (0.5%) of the existing MR items were changed and 3,704 new items were added. The number of registered MR items increased by 72.0 % in the first year and 27.9 % in the second year. Conclusions: The MR item concept provides an easier and more structured means of data entry within an EHR-s. By using these MR items, various kinds of clinical documents can be easily constructed and allows for medical information to be reused and retrieved as data

    Collaborative Efforts for Representing Nursing Concepts in Computer-based Systems: International Perspectives

    Get PDF
    Current nursing terminology efforts have converged toward meeting the demand for a reference terminology for nursing concepts by building on the foundation of existing interface and administrative terminologies and by collaborating with terminology efforts across the spectrum of health care. In this article, the authors illustrate how collaboration is promoting convergence toward a reference terminology for nursing by briefly summarizing a wide range of exemplary activities. These include: 1) the International Classification of Nursing Practice (ICNP) activities of the International Council of Nurses (ICN), 2) work in Brazil and Korea that has contributed to, and been stimulated by, ICNP developments, 3) efforts in the United States to improve understanding of the different types of terminologies needed in nursing and to promote harmonization and linking among them, and 4) current nursing participation in major multi-disciplinary standards initiatives. Although early nursing terminology work occurred primarily in isolation and resulted in some duplicative efforts, the activities summarized in this article demonstrate a tremendous level of collaboration and convergence not only in the discipline of nursing but in multi-disciplinary standards initiatives. These efforts are an important prerequisite for ensuring that nursing concepts are represented in computer-based systems in a manner that facilitates multi-purpose use at local, national, regional, and international level

    Protocol for Usability Testing and Validation of the ISO Draft International Standard 19223 for Lung Ventilators

    Get PDF
    ©Dev Minotra, Steven L Dain, Catherine M Burns. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 08.09.2017. This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.Background: Clinicians, such as respiratory therapists and physicians, are often required to set up pieces of medical equipment that use inconsistent terminology. Current lung ventilator terminology that is used by different manufacturers contributes to the risk of usage errors, and in turn the risk of ventilator-associated lung injuries and other conditions. Human factors and communication issues are often associated with ventilator-related sentinel events, and inconsistent ventilator terminology compounds these issues. This paper describes our proposed protocol, which will be implemented at the University of Waterloo, Canada when this project is externally funded. Objective: We propose to determine whether a standardized vocabulary improves the ease of use, safety, and utility as it relates to the usability of medical devices, compared to legacy medical devices from multiple manufacturers, which use different terms. Methods: We hypothesize that usage errors by clinicians will be lower when standardization is consistently applied by all manufacturers. The proposed study will experimentally examine the impact of standardized nomenclature on performance declines in the use of an unfamiliar ventilator product in clinically relevant scenarios. Participants will be respiratory therapy practitioners and trainees, and we propose studying approximately 60 participants. Results: The work reported here is in the proposal phase. Once the protocol is implemented, we will report the results in a follow-up paper. Conclusions: The proposed study will help us better understand the effects of standardization on medical device usability. The study will also help identify any terms in the International Organization for Standardization (ISO) Draft International Standard (DIS) 19223 that may be associated with recurrent errors. Amendments to the standard will be proposed if recurrent errors are identified. This report contributes a protocol that can be used to assess the effect of standardization in any given domain that involves equipment, multiple manufacturers, inconsistent vocabulary, symbology, audio tones, or patterns in interface navigation. Second, the protocol can be used to experimentally evaluate the ISO DIS 19223 for its effectiveness, as researchers around the world may wish to conduct such tests and compare results.We are thankful for funding support from the Natural Sciences and Engineering Research Council discovery grant 132995 and from a Telus Health contract

    Semantic Queries Expedite MedDRA Terms Selection Thanks to a Dedicated User Interface: A Pilot Study on Five Medical Conditions

    Get PDF
    Background: Searching into the MedDRA terminology is usually limited to a hierarchical search, and/or a string search. Our objective was to compare user performances when using a new kind of user interface enabling semantic queries versus classical methods, and evaluating term selection improvement in MedDRA.Methods: We implemented a forms-based web interface: OntoADR Query Tools (OQT). It relies on OntoADR, a formal resource describing MedDRA terms using SNOMED CT concepts and corresponding semantic relations, enabling terminological reasoning. We then compared time spent on five examples of medical conditions using OQT or the MedDRA web-based browser (MWB), and precision and recall of the term selection.Results: OntoADR Query Tools allows the user to search in MedDRA: One may enter search criteria by selecting one semantic property from a dropdown list and one or more SNOMED CT concepts related to the range of the chosen property. The user is assisted in building his query: he can add criteria and combine them. Then, the interface displays the set of MedDRA terms matching the query. Meanwhile, on average, the time spent on OQT (about 4 min 30 s) is significantly lower (−35%; p < 0.001) than time spent on MWB (about 7 min). The results of the System Usability Scale (SUS) gave a score of 62.19 for OQT (rated as good). We also demonstrated increased precision (+27%; p = 0.01) and recall (+34%; p = 0.02). Computed “performance” (correct terms found per minute) is more than three times better with OQT than with MWB.Discussion: This pilot study establishes the feasibility of our approach based on our initial assumption: performing MedDRA queries on the five selected medical conditions, using terminological reasoning, expedites term selection, and improves search capabilities for pharmacovigilance end users. Evaluation with a larger number of users and medical conditions are required in order to establish if OQT is appropriate for the needs of different user profiles, and to check if conclusions can be extended to other kinds of medical conditions. The application is currently limited by the non-exhaustive coverage of MedDRA by OntoADR, but nevertheless shows good performance which encourages continuing in the same direction

    The Development of Medical Record Items: a User-centered, Bottom-up Approach

    Get PDF
    OBJECTIVES: Clinical documents (CDs) have evolved from traditional paper documents containing narrative text information into the electronic record sheets composed of itemized records, where each record is expressed as an item with a specific value. We defined medical record (MR) items to be information entities with a specific value. These entities were then used to compile form-based clinical documents as part of an electronic health record system (EHR-s). METHODS: We took a reusable bottom-up developmental approach for the MR items, which provided three things: efficient incorporation of the local needs and requirements of the medical professionals from various departments in the hospital, comprehensive inclusion of the essential concepts of the basic elements required in clinical documents, and the provision of a structured means for meaningful data entry and retrieval. This paper delineates our experiences in developing and managing medical records at a large tertiary university hospital in Korea. RESULTS: We collected 63,232 MR items from paper records scanned into 962 CDs. The MR item database was constructed using 13,287 MR items after removing redundant items. During the first year of service users requested changes to be made to 235 (1.8%) attributes of the MR items and also requested the additional 9,572 new MR items. In the second year, the attributes of 70 (0.5%) of the existing MR items were changed and 3,704 new items were added. The number of registered MR items increased by 72.0% in the first year and 27.9% in the second year. CONCLUSIONS: The MR item concept provides an easier and more structured means of data entry within an EHR-s. By using these MR items, various kinds of clinical documents can be easily constructed and allows for medical information to be reused and retrieved as data. The success of the use of MR items in a large tertiary university hospital system provides evidence that verifies our approach as being an efficient means of user-oriented and structured data entry, enabling the easy reuse of medical records.ope
    • 

    corecore