The development and evaluation of a computerized decision aid for the treatment of psychotic disorders

Abstract Background Routinely monitoring of symptoms and medical needs can improve the diagnostics and treatment of medical problems, including psychiatric. However, several studies show that few clinicians use Routine Outcome Monitoring (ROM) in their daily work. We describe the development and first evaluation of a ROM based computerized clinical decision aid, Treatment-E-Assist (TREAT) for the treatment of psychotic disorders. The goal is to generate personalized treatment recommendations, based on international guidelines combined with outcomes of mental and physical health acquired through ROM. We present a pilot study aimed to assess the feasibility of this computerized clinical decision aid in daily clinical practice by evaluating clinicians’ experiences with the system. Methods Clinical decision algorithms were developed based on international schizophrenia treatment guidelines and the input of multidisciplinary expert panels from multiple psychiatric institutes. Yearly obtained diagnostic (ROM) information of patients was presented to treating clinicians combined with treatment suggestions generated by the algorithms of TREAT. In this pilot study 6 clinicians and 16 patients of Lentis Psychiatric Institute used the application. Clinicians were interviewed and asked to fill out self-report questionnaires evaluating their opinions about ROM and the effectiveness of TREAT. Results Six clinicians and 16 patients with psychotic disorders participated in the pilot study. The clinicians were psychiatrists, physicians and nurse-practitioners which all worked at least 8 years in mental health care of which at least 3 years treating patients with psychotic illnesses. All Clinicians found TREAT easy to use and would like to continue using the application. They reported that TREAT offered support in using diagnostic ROM information when drafting the treatment plans, by creating more awareness of current treatment options. Conclusion This article presents a pilot study on the implementation of a computerized clinical decision aid linking routine outcome monitoring to clinical guidelines in order to generate personalized treatment advice. TREAT was found to be feasible for daily clinical practice and effective based on this first evaluation by clinicians. However, adjustments have to be made to the system and algorithms of the application. The ultimate goal is to provide appropriate evidence based care for patients with severe mental illnesses

Evaluation, Validation & Implementation of a Computerized Diagnostic Decision Support System in Primary Practice

Background: Medical diagnosis may be the most complex task attempted by humans. Studies estimate that 95% of diagnoses in outpatient care are accurate, implying that the annual rate of inaccurate diagnoses is 12 million in the US alone, with the potential for patient harm in about half. A well-researched differential might reduce inaccurate diagnoses by offering alternatives matching the patient’s symptoms. This study searched the literature for articles evaluating the diagnostic performance of commercially available computerized diagnostic decision support systems. This search led to selecting Isabel Pro, developed by Isabel Healthcare, Ltd. of Haslemere, UK. Evaluation and Validation: A computerized diagnostic decision support system should respond adequately to four questions: What is the “diagnostic retrieval accuracy”? Does it perform as well as clinicians? When provided with the differential, do clinicians improve diagnostic accuracy? Is it easily incorporated into routine practice? The project validated the diagnostic retrieval accuracy of Isabel Pro using 46 cases with a previously confirmed diagnosis. The confirmed diagnosis appeared in Isabel Pro’s differential in 24 cases (52.2%), outperforming even internal medicine faculty (47%). Using those 24 cases and the differentials produced, the author conducted a diagnostic challenge that involved 120 McGovern Medical School residents. The residents produced 406 diagnoses, of which 105 (25.9%) were correct without the differentials, and 37 were correct post-consultation, a 9.1% absolute improvement. In responses, 75.1% of the participants agreed the differentials would be helpful in routine practice, and 64.1% agreed they would consult the differentials if available. Implementation: The project successfully proposed Isabel Pro as a solution to UT practice leadership on September 16, 2021, and incorporated the system into the Epic EHR as a menu line link on November 30, 2021. This system-wide integration also included a QR code for downloading Isabel Pro to a mobile device. Usage of Isabel Pro in the practices of UTPhysicians began on December 8, 2021. Results: The project concluded data collection after 86 days on March 4, 2022, with usage showing a steady increase in the final three weeks. The project produced 73 unique users (37 faculty and 36 residents). The user survey responses showed 83.3% agreeing they would consult the differential generated by Isabel Pro if available at every patient encounter (+19.2% compared to the challenge survey) and 77.8% agreeing that the suggestions would be helpful in routine practice (+2.7% compared to the challenge survey). More than one-third (36.8%) responded that they changed their diagnosis in response to the differential. Limitations: Only usage statistics were analyzed; the system records no reason for the clinician discontinuing a diagnostic session. Only 20 participants responded out of 73 (27.4%), so even though the respondents represented a spread of experience levels, the results may not represent the total number of potential users. The project covered a limited period of 86 days. Conclusions: Diagnostic inaccuracy is a significant patient safety concern. Studies show that computerized diagnostic decision support systems improve diagnostic accuracy, but they are not wide implementation lags despite these findings. This project demonstrated the feasibility of implementing such a well-known system in academic medical practice. The responses to the surveys demonstrate favorable opinions about the system’s perceived usefulness. Active communication and dissemination programs may be essential to improve and sustain use

Reliability and validity of a model computerized simulation examination for nursing

Health care facilities and schools of nursing are beginning to utilize computer technology. There is limited availability of quality software in nursing for instruction and evaluation. In the present study, a computerized simulation examination to evaluate decision-making in nursing was developed and assessed in terms of its psychometric properties. A clinical situation was established and then converted into a computerized simulation program. The computerized simulation examination was given to groups of nurses and non-nurses in order to improve clarity of instructions and to insure the functioning of the computer program. To obtain data indicating reliability and validity, the computerized simulation examination was given to two additional groups: novices who were college students without nursing experience and experts who were masters in nursing prepared faculty. Each person\u27s performance was converted into three scores (performance index, efficiency index, and usefulness). The known-groups technique was then used to determine criterion-related validity. The faculty group was also given a questionnaire relating to the content validity of the simulation

A knowledge-based taxonomy of critical factors for adopting electronic health record systems by physicians: a systematic literature review

<p>Abstract</p> <p>Background</p> <p>The health care sector is an area of social and economic interest in several countries; therefore, there have been lots of efforts in the use of electronic health records. Nevertheless, there is evidence suggesting that these systems have not been adopted as it was expected, and although there are some proposals to support their adoption, the proposed support is not by means of information and communication technology which can provide automatic tools of support. The aim of this study is to identify the critical adoption factors for electronic health records by physicians and to use them as a guide to support their adoption process automatically.</p> <p>Methods</p> <p>This paper presents, based on the PRISMA statement, a systematic literature review in electronic databases with adoption studies of electronic health records published in English. Software applications that manage and process the data in the electronic health record have been considered, i.e.: computerized physician prescription, electronic medical records, and electronic capture of clinical data. Our review was conducted with the purpose of obtaining a taxonomy of the physicians main barriers for adopting electronic health records, that can be addressed by means of information and communication technology; in particular with the information technology roles of the knowledge management processes. Which take us to the question that we want to address in this work: "What are the critical adoption factors of electronic health records that can be supported by information and communication technology?". Reports from eight databases covering electronic health records adoption studies in the medical domain, in particular those focused on physicians, were analyzed.</p> <p>Results</p> <p>The review identifies two main issues: 1) a knowledge-based classification of critical factors for adopting electronic health records by physicians; and 2) the definition of a base for the design of a conceptual framework for supporting the design of knowledge-based systems, to assist the adoption process of electronic health records in an automatic fashion. From our review, six critical adoption factors have been identified: user attitude towards information systems, workflow impact, interoperability, technical support, communication among users, and expert support. The main limitation of the taxonomy is the different impact of the adoption factors of electronic health records reported by some studies depending on the type of practice, setting, or attention level; however, these features are a determinant aspect with regard to the adoption rate for the latter rather than the presence of a specific critical adoption factor.</p> <p>Conclusions</p> <p>The critical adoption factors established here provide a sound theoretical basis for research to understand, support, and facilitate the adoption of electronic health records to physicians in benefit of patients.</p

Application of Smartphone Technology in the Management and Treatment of Mental Illnesses

Abstract: Background: Mental illness continues to be a significant Public Health problem and the innovative use of technology to improve the treatment of mental illnesses holds great public health relevance. Over the past decade telecommunications technology has been used to increase access to and improve the quality of mental health care. There is current evidence that the use of landline and cellular telephones, computer-assisted therapy, and videoconferencing can be effective in improving treatment outcomes. Smartphones, as the newest development in communications technology, offer a new opportunity to improve mental health care through their versatile nature to perform a variety of functions. Methods: A critical literature review was performed to examine the potential of smartphones to increase access to mental health care, reduce barriers to care, and improve patient treatment outcomes. The review was performed by searching several electronic databases using a combination of keywords related to smartphones and mental health interventions using mobile devices. Literature concerning the use of cell phones, handheld computers, and smartphones to improve access to mental health care and improve treatment outcomes was identified.Results: The majority of studies identified were feasibility and pilot studies on patients with a variety of diagnosed mental illnesses using cell phones and PDAs. Authors report that most study participants, with some exceptions, were capable of using a mobile device and found them acceptable to use. Few studies extensively measured treatment outcomes and instead reported preliminary results and presented case illustrations. Studies which used smartphones successfully used them collect data on patients and deliver multimedia interventions. Discussion: The current literature offers encouraging evidence for the use of smartphones to improve mental health care but also reflects the lack of research conducted using smartphones. Studies which examine care provider use of smartphones to improve care is encouraging but has limited generalizability to mental health care. The feasibility of patient use of smartphones is also encouraging, but questions remain about feasibility in some sub-populations, particularly schizophrenia patients. Pilot testing of mobile devices and applications can greatly increase the feasibility of using smartphones in mental health care. Patients who are unfamiliar with smartphones will likely need initial training and support in their use. Conclusion: The literature identified several ways in which smartphones can increase access to care, reduce barriers, and improve treatment outcomes. Study results were encouraging but scientifically weak. Future studies are needed replicating results of studies using cell phones and PDAs on smartphones. Larger and higher quality studies are needed to examine the feasibility, efficacy, and cost-effectiveness of smartphones to deliver multiple component interventions that improve access to mental health care and improve treatment outcomes

Dementia assessment and management in primary care settings: a survey of current provider practices in the United States.

BACKGROUND:Primary care providers (PCPs) are typically the first to screen and evaluate patients for neurocognitive disorders (NCDs), including mild cognitive impairment and dementia. However, data on PCP attitudes and evaluation and management practices are sparse. Our objective was to quantify perspectives and behaviors of PCPs and neurologists with respect to NCD evaluation and management. METHODS:A cross-sectional survey with 150 PCPs and 50 neurologists in the United States who evaluated more than 10 patients over age 55 per month. The 51-item survey assessed clinical practice characteristics, and confidence, perceived barriers, and typical practices when diagnosing and managing patients with NCDs. RESULTS:PCPs and neurologists reported similar confidence and approaches to general medical care and laboratory testing. Though over half of PCPs performed cognitive screening or referred patients for cognitive testing in over 50% of their patients, only 20% reported high confidence in interpreting results of cognitive tests. PCPs were more likely to order CT scans than MRIs, and only 14% of PCPs reported high confidence interpreting brain imaging findings, compared to 70% of specialists. Only 21% of PCPs were highly confident that they correctly recognized when a patient had an NCD, and only 13% were highly confident in making a specific NCD diagnosis (compared to 72 and 44% for neurologists, both p &lt; 0.001). A quarter of all providers identified lack of familiarity with diagnostic criteria for NCD syndromes as a barrier to clinical practice. CONCLUSIONS:This study demonstrates how PCPs approach diagnosis and management of patients with NCDs, and identified areas for improvement in regards to&nbsp;cognitive testing and neuroimaging. This study also identified all&nbsp;providers' lack of familiarity with published diagnostic criteria for NCD syndromes. These findings may inform the development of new policies and interventions to help providers improve the efficacy of their decision processes and deliver better quality care to patients with NCDs

Committed to Safety: Ten Case Studies on Reducing Harm to Patients

Presents case studies of healthcare organizations, clinical teams, and learning collaborations to illustrate successful innovations for improving patient safety nationwide. Includes actions taken, results achieved, lessons learned, and recommendations

Live usability testing of two complex clinical decision support tools: Observational study

© 2019 Journal of Medical Internet Research. All rights reserved. Background: Potential of the electronic health records (EHR) and clinical decision support (CDS) systems to improve the practice of medicine has been tempered by poor design and the resulting burden they place on providers. CDS is rarely tested in the real clinical environment. As a result, many tools are hard to use, placing strain on providers and resulting in low adoption rates. The existing CDS usability literature relies primarily on expert opinion and provider feedback via survey. This is the first study to evaluate CDS usability and the provider-computer-patient interaction with complex CDS in the real clinical environment. Objective: This study aimed to further understand the barriers and facilitators of meaningful CDS usage within a real clinical context. Methods: This qualitative observational study was conducted with 3 primary care providers during 6 patient care sessions. In patients with the chief complaint of sore throat, a CDS tool built with the Centor Score was used to stratify the risk of group A Streptococcus pharyngitis. In patients with a chief complaint of cough or upper respiratory tract infection, a CDS tool built with the Heckerling Rule was used to stratify the risk of pneumonia. During usability testing, all human-computer interactions, including audio and continuous screen capture, were recorded using the Camtasia software. Participants\u27 comments and interactions with the tool during clinical sessions and participant comments during a postsession brief interview were placed into coding categories and analyzed for generalizable themes. Results: In the 6 encounters observed, primary care providers toggled between addressing either the computer or the patient during the visit. Minimal time was spent listening to the patient without engaging the EHR. Participants mostly used the CDS tool with the patient, asking questions to populate the calculator and discussing the results of the risk assessment; they reported the ability to do this as the major benefit of the tool. All providers were interrupted during their use of the CDS tool by the need to refer to other sections of the chart. In half of the visits, patients\u27 clinical symptoms challenged the applicability of the tool to calculate the risk of bacterial infection. Primary care providers rarely used the incorporated incentives for CDS usage, including progress notes and patient instructions. Conclusions: Live usability testing of these CDS tools generated insights about their role in the patient-provider interaction. CDS may contribute to the interaction by being simultaneously viewed by the provider and patient. CDS can improve usability and lessen the strain it places on providers by being short, flexible, and customizable to unique provider workflow. A useful component of CDS is being as widely applicable as possible and ensuring that its functions represent the fastest way to perform a particular task