Computerization of workflows, guidelines and care pathways: a review of implementation challenges for process-oriented health information systems

There is a need to integrate the various theoretical frameworks and formalisms for modeling clinical guidelines, workflows, and pathways, in order to move beyond providing support for individual clinical decisions and toward the provision of process-oriented, patient-centered, health information systems (HIS). In this review, we analyze the challenges in developing process-oriented HIS that formally model guidelines, workflows, and care pathways. A qualitative meta-synthesis was performed on studies published in English between 1995 and 2010 that addressed the modeling process and reported the exposition of a new methodology, model, system implementation, or system architecture. Thematic analysis, principal component analysis (PCA) and data visualisation techniques were used to identify and cluster the underlying implementation ‘challenge’ themes. One hundred and eight relevant studies were selected for review. Twenty-five underlying ‘challenge’ themes were identified. These were clustered into 10 distinct groups, from which a conceptual model of the implementation process was developed. We found that the development of systems supporting individual clinical decisions is evolving toward the implementation of adaptable care pathways on the semantic web, incorporating formal, clinical, and organizational ontologies, and the use of workflow management systems. These architectures now need to be implemented and evaluated on a wider scale within clinical settings

Support and Assessment for Fall Emergency Referrals (SAFER 1) trial protocol. Computerised on-scene decision support for emergency ambulance staff to assess and plan care for older people who have fallen: evaluation of costs and benefits using a pragmatic cluster randomised trial

Background: Many emergency ambulance calls are for older people who have fallen. As half of them are left at home, a community-based response may often be more appropriate than hospital attendance. The SAFER 1 trial will assess the costs and benefits of a new healthcare technology - hand-held computers with computerised clinical decision support (CCDS) software - to help paramedics decide who needs hospital attendance, and who can be safely left at home with referral to community falls services. Methods/Design: Pragmatic cluster randomised trial with a qualitative component. We shall allocate 72 paramedics ('clusters') at random between receiving the intervention and a control group delivering care as usual, of whom we expect 60 to complete the trial. Patients are eligible if they are aged 65 or older, live in the study area but not in residential care, and are attended by a study paramedic following an emergency call for a fall. Seven to 10 days after the index fall we shall offer patients the opportunity to opt out of further follow up. Continuing participants will receive questionnaires after one and 6 months, and we shall monitor their routine clinical data for 6 months. We shall interview 20 of these patients in depth. We shall conduct focus groups or semi-structured interviews with paramedics and other stakeholders. The primary outcome is the interval to the first subsequent reported fall (or death). We shall analyse this and other measures of outcome, process and cost by 'intention to treat'. We shall analyse qualitative data thematically. Discussion: Since the SAFER 1 trial received funding in August 2006, implementation has come to terms with ambulance service reorganisation and a new national electronic patient record in England. In response to these hurdles the research team has adapted the research design, including aspects of the intervention, to meet the needs of the ambulance services. In conclusion this complex emergency care trial will provide rigorous evidence on the clinical and cost effectiveness of CCDS for paramedics in the care of older people who have fallen

Review of economic evidence in the prevention and early detection of colorectal cancer.

This paper aims to systematically review the cost-effectiveness evidence, and to provide a critical appraisal of the methods used in the model-based economic evaluation of CRC screening and subsequent surveillance. A search strategy was developed to capture relevant evidence published 1999-November 2012. Databases searched were MEDLINE, EMBASE, National Health Service Economic Evaluation (NHS EED), EconLit, and HTA. Full economic evaluations that considered costs and health outcomes of relevant intervention were included. Sixty-eight studies which used either cohort simulation or individual-level simulation were included. Follow-up strategies were mostly embedded in the screening model. Approximately 195 comparisons were made across different modalities; however, strategies modelled were often simplified due to insufficient evidence and comparators chosen insufficiently reflected current practice/recommendations. Studies used up-to-date evidence on the diagnostic test performance combined with outdated information on CRC treatments. Quality of life relating to follow-up surveillance is rare. Quality of life relating to CRC disease states was largely taken from a single study. Some studies omitted to say how identified adenomas or CRC were managed. Besides deterministic sensitivity analysis, probabilistic sensitivity analysis (PSA) was undertaken in some studies, but the distributions used for PSA were rarely reported or justified. The cost-effectiveness of follow-up strategies among people with confirmed adenomas are warranted in aiding evidence-informed decision making in response to the rapidly evolving technologies and rising expectations

Choice and judgement in developing models for health technology assessment; a qualitative study

Introduction: The role of models in supporting health policy decisions is reliant on model credibility. Credibility is fundamentally determined by the choices and judgements that people make in the process of developing a model. However, the method of uncovering choices and making judgements in model development is largely unreported and is not addressed by modelling methods guidance. Methods: This qualitative study was part of a project examining errors in health technology assessment models. In-depth interviews with academic and commercial modellers were used to obtain descriptions of the model development process. Data were analysed using framework analysis and interpreted in the context of the methodological literature. Results: The activities involved in developing models were characterised according to the themes; understanding the decision problem, conceptual modelling, model implementation, model checking, and engaging with the decision maker. Finding and using evidence was frequently mentioned across these themes. There was marked variation between practitioners in the extent to which conceptual modelling was recognised as an activity distinct from model implementation. Discussion: Methodological approaches to addressing model credibility described in the wider modelling literature highlight the necessity to disentangle the conceptual modelling and implementation activities. Whilst interviewees talked of judgements and choice making throughout model development, discussion indicated that these were based upon skills and experience with no discussion of formal approaches. Methods are required that provide for a systematic approach to uncovering choices, to generating a shared view of consensus and divergence, and for making judgements and choices in model development

Evaluating telemedicine: A focus on patient pathways

Evaluations of telemedicine have sought to assess various measures of effectiveness (e.g., diagnostic accuracy), efficiency (e.g., cost), and engagement (e.g., patient satisfaction) to determine its success. Few studies, however, have looked at evaluating the organizational impact of telemedicine, which involves technology and process changes that affect the way that it is used and accepted by patients and clinicians alike. This study reviews and discusses the conceptual issues in telemedicine research and proposes a fresh approach for evaluating telemedicine. First, we advance a patient pathway perspective, as most of the existing studies view telemedicine as a support to a singular rather than multiple aspects of a health care process. Second, to conceptualize patient pathways and understand how telemedicine impacts upon them, we propose simulation as a tool to enhance understanding of the traditional and telemedicine patient pathway

Designing intelligent computer‐based simulations: A pragmatic approach

This paper examines the design of intelligent multimedia simulations. A case study is presented which uses an approach based in part on intelligent tutoring system design to integrate formative assessment into the learning of clinical decision‐making skills for nursing students. The approach advocated uses a modular design with an integrated intelligent agent within a multimedia simulation. The application was created using an object‐orientated programming language for the multimedia interface (Delphi) and a logic‐based interpreted language (Prolog) to create an expert assessment system. Domain knowledge is also encoded in a Windows help file reducing some of the complexity of the expert system. This approach offers a method for simplifying the production of an intelligent simulation system. The problems developing intelligent tutoring systems are examined and an argument is made for a practical approach to developing intelligent multimedia simulation systems

Development of a decision support tool to facilitate primary care management of patients with abnormal liver function tests without clinically apparent liver disease [HTA03/38/02]. Abnormal Liver Function Investigations Evaluation (ALFIE)

Liver function tests (LFTs) are routinely performed in primary care, and are often the gateway to further invasive and/or expensive investigations. Little is known of the consequences in people with an initial abnormal liver function (ALF) test in primary care and with no obvious liver disease. Further investigations may be dangerous for the patient and expensive for Health Services. The aims of this study are to determine the natural history of abnormalities in LFTs before overt liver disease presents in the population and identify those who require minimal further investigations with the potential for reduction in NHS costs

Cost comparison of orthopaedic fracture pathways using discrete event simulation in a Glasgow hospital

Objective: Healthcare faces the continual challenge of improving outcome whilst aiming to reduce cost. The aim of this study was to determine the micro cost differences of the Glasgow non-operative trauma virtual pathway in comparison to a traditional pathway. Design:  Discrete event simulation was used to model and analyse cost and resource utilisation with an activity based costing approach. Data for a full comparison before the process change was unavailable so we utilised a modelling approach, comparing a Virtual Fracture Clinic (VFC) to a simulated Traditional Fracture Clinic (TFC). Setting:  The orthopaedic unit VFC pathway pioneered at Glasgow Royal Infirmary has attracted significant attention and interest and is the focus of this cost study. Outcome measures: Our study focused exclusively on non-operative trauma patients attending Emergency Department or the minor injuries unit and the subsequent step in the patient pathway. Retrospective studies of patient outcomes as a result of the protocol introductions for specific injuries in association with activity costs from the models.ResultsPatients are satisfied with the new pathway, the information provided and the outcome of their injuries (Evidence Level IV). There was a 65% reduction in the number of first outpatient face-to-face attendances in orthopaedics. In the VFC pathway, the resources required per day were significantly lower for all staff groups (p=<0.001). The overall cost per patient of the VFC pathway was £22.84 (95% CI: 21.74, 23.92) per patient compared with £36.81 (95% CI: 35.65, 37.97) for the TFC pathway.  Conclusions:  Our results give a clearer picture of the cost comparison of the virtual pathway over a wholly traditional face-to-face clinic system. The use of simulation-based stochastic costings in healthcare economic analysis has been limited to date, but this study provides evidence for adoption of this method as a basis for its application in other healthcare settings

The Scottish Mental Survey 1932 linked to the Midspan studies: a prospective investigation of childhood intelligence and future health

The Scottish Mental Survey of 1932 (SMS1932) recorded mental ability test scores for nearly all of the age group of children born in 1921 and at school in Scotland on 1st June 1932. The Collaborative and Renfrew/Paisley studies, two of the Midspan studies, obtained health and social data by questionnaire and a physical examination in the 1970s. Some Midspan participants were born in 1921 and may have taken part in the SMS1932, so might have mental ability data available from childhood. The 1921-born Midspan participants were matched with the computerised SMS1932 database. The total numbers successfully matched were 1032 out of 1251 people (82.5%). Of those matched, 938 (90.9%) had a mental ability test score recorded. The mean score of the matched sample was 37.2 (standard deviation [SD] 13.9) out of a possible score of 76. The mean (SD) for the boys and girls respectively was 38.3 (14.2) and 35.7 (13.9). This compared with 38.6 (15.7) and 37.2 (14.3) for boys and girls in all of Scotland. Graded relationships were found between mental ability in childhood, and social class and deprivation category of residence in adulthood. Being in a higher social class or in a more affluent deprivation category was associated with higher childhood mental ability scores and the scores reduced with increasing deprivation. Future plans for the matched data include examining associations between childhood mental ability and other childhood and adult risk factors for disease in adulthood, and modelling childhood mental ability, alongside other factors available in the Midspan database, as a risk factor for specific illnesses, admission to hospital and mortality

The relationship between competence and patient outcome with low-intensity cognitive behavioural interventions

Little is understood about the relationship between therapist competence and the outcomes of patients treated for common mental health disorders. Furthermore, the evidence is yet to extend to competence in the delivery of low-intensity cognitive behavioural interventions. Understanding this relationship is essential to the dissemination and implementation of low-intensity cognitive behavioural interventions. The aim of this study was to explore the relationship between Psychological Well-being Practitioner (PWP) competence and patient outcome within the framework of the British government's Improving Access to Psychological Therapies (IAPT) initiative. Forty-seven PWPs treating 3688 patients participated. Relationships between PWP scores on three observed standardized clinical examinations and reliable change in patients' symptoms of anxiety and depression were explored at two time points: during the year-long training phase, and over a 12-month follow-up. Results indicated that patients treated by qualified PWPs achieved superior outcomes than those treated by trainees. Little support was found for a general association between practitioner competence in delivering low-intensity cognitive behavioural interventions and patient outcome, either during or post-training; however, significantly more patients of the most competent PWPs demonstrated reliable improvement in their symptoms of anxiety and depression than would be expected by chance alone and fewer deteriorated compared with those treated by the least competent PWPs. Results were indicative of a complex, non-linear relationship, with patient outcome affected by PWP status (trainee or qualified) and by competence at its extremes. The implications of these results for the dissemination and implementation of low-intensity cognitive behavioural interventions are discussed