How to do health services research in stroke: a focus on performance measurement and quality improvement

The objective of this ‘How to’ research series article is to provide guidance on getting started in Health Services Research. The purpose of health services research is to contribute knowledge that can be used to help improve health systems and clinical services through influencing policy and practice. The methods used are broad, have varying levels of rigour and may require different specialist skills. This paper sets out practical steps for undertaking health services research. Importantly, use of the highlighted techniques can identify solutions to address inadequate knowledge translation or promote greater access to evidence-based stroke care to optimise patient outcomes

Association between patient outcomes and key performance indicators of stroke care quality: A systematic review and meta-analysis

Purpose: Translating research evidence into clinical practice often uses key performance indicators to monitor quality of care. We conducted a systematic review to identify the stroke key performance indicators used in large registries, and to estimate their association with patient outcomes. Method: We sought publications of recent (January 2000–May 2017) national or regional stroke registers reporting the association of key performance indicators with patient outcome (adjusting for age and stroke severity). We searched Ovid Medline, EMBASE and PubMed and screened references from bibliographies. We used an inverse variance random effects meta-analysis to estimate associations (odds ratio; 95% confidence interval) with death or poor outcome (death or disability) at the end of follow-up. Findings: We identified 30 eligible studies (324,409 patients). The commonest key performance indicators were swallowing/nutritional assessment, stroke unit admission, antiplatelet use for ischaemic stroke, brain imaging and anticoagulant use for ischaemic stroke with atrial fibrillation, lipid management, deep vein thrombosis prophylaxis and early physiotherapy/mobilisation. Lower case fatality was associated with stroke unit admission (odds ratio 0.79; 0.72–0.87), swallow/nutritional assessment (odds ratio 0.78; 0.66–0.92) and antiplatelet use for ischaemic stroke (odds ratio 0.61; 0.50–0.74) or anticoagulant use for ischaemic stroke with atrial fibrillation (odds ratio 0.51; 0.43–0.64), lipid management (odds ratio 0.52; 0.38–0.71) and early physiotherapy or mobilisation (odds ratio 0.78; 0.67–0.91). Reduced poor outcome was associated with adherence to swallowing/nutritional assessment (odds ratio 0.58; 0.43–0.78) and stroke unit admission (odds ratio 0.83; 0.77–0.89). Adherence with several key performance indicators appeared to have an additive benefit. Discussion: Adherence with common key performance indicators was consistently associated with a lower risk of death or disability after stroke. Conclusion: Policy makers and health care professionals should implement and monitor those key performance indicators supported by good evidence

Development and application of model of resource utilization, costs, and outcomes for stroke (MORUCOS): an Australian economic model for stroke

Objectives: To outline the development, structure, data assumptions, and application of an Australian economic model for stroke (Model of Resource Utilization, Costs, and Outcomes for Stroke [MORUCOS]).Methods: The model has a linked spreadsheet format with four modules to describe the disease burden and treatment pathways, estimate prevalence-based and incidence-based costs, and derive life expectancy and quality of life consequences. The model uses patient-level, community-based, stroke cohort data and macro-level simulations. An interventions module allows options for change to be consistently evaluated by modifying aspects of the other modules. To date, model validation has included sensitivity testing, face validity, and peer review. Further validation of technical and predictive accuracy is needed. The generic pathway model was assessed by comparison with a stroke subtypes (ischemic, hemorrhagic, or undetermined) approach and used to determine the relative cost-effectiveness of four interventions.Results: The generic pathway model produced lower costs compared with a subtypes version (total average first-year costs/case AUD$15,117 versus AUD$17,786, respectively). Optimal evidence-based uptake of anticoagulation therapy for primary and secondary stroke prevention and intravenous thrombolytic therapy within 3 hours of stroke were more cost-effective than current practice (base year, 1997).Conclusions: MORUCOS is transparent and flexible in describing Australian stroke care and can effectively be used to systematically evaluate a range of different interventions. Adjusting results to account for stroke subtypes, as they influence cost estimates, could enhance the generic model

Development and application of model of resource utilization, costs, and outcomes for stroke (MORUCOS): an Australian economic model for stroke

Objectives: To outline the development, structure, data assumptions, and application of an Australian economic model for stroke (Model of Resource Utilization, Costs, and Outcomes for Stroke [MORUCOS]).Methods: The model has a linked spreadsheet format with four modules to describe the disease burden and treatment pathways, estimate prevalence-based and incidence-based costs, and derive life expectancy and quality of life consequences. The model uses patient-level, community-based, stroke cohort data and macro-level simulations. An interventions module allows options for change to be consistently evaluated by modifying aspects of the other modules. To date, model validation has included sensitivity testing, face validity, and peer review. Further validation of technical and predictive accuracy is needed. The generic pathway model was assessed by comparison with a stroke subtypes (ischemic, hemorrhagic, or undetermined) approach and used to determine the relative cost-effectiveness of four interventions.Results: The generic pathway model produced lower costs compared with a subtypes version (total average first-year costs/case AUD$15,117 versus AUD$17,786, respectively). Optimal evidence-based uptake of anticoagulation therapy for primary and secondary stroke prevention and intravenous thrombolytic therapy within 3 hours of stroke were more cost-effective than current practice (base year, 1997).Conclusions: MORUCOS is transparent and flexible in describing Australian stroke care and can effectively be used to systematically evaluate a range of different interventions. Adjusting results to account for stroke subtypes, as they influence cost estimates, could enhance the generic model

The health and economic benefits of reducing intimate partner violence: an Australian example.

BACKGROUND: Intimate partner violence (IPV) has important impacts on the health of women in society. Our aim was to estimate the health and economic benefits of reducing the prevalence of IPV in the 2008 Australian female adult population. METHODS: Simulation models were developed to show the effect of a 5 percentage point absolute feasible reduction target in the prevalence of IPV from current Australian levels (27%). IPV is not measured in national surveys. Levels of psychological distress were used as a proxy for exposure to IPV since psychological conditions represent three-quarters of the disease burden from IPV. Lifetime cohort health benefits for females were estimated as fewer incident cases of violence-related disease and injury; deaths; and Disability Adjusted Life Years (DALYs). Opportunity cost savings were estimated for the health sector, paid and unpaid production and leisure from reduced incidence of IPV-related disease and deaths. Workforce production gains were estimated by comparing surveyed participation and absenteeism rates of females with moderate psychological distress (lifetime IPV exposure) against high or very high distress (current IPV exposure), and valued using the friction cost approach (FCA). The impact of improved health status on unpaid household production and leisure time were modelled from time use survey data. Potential costs associated with interventions to reduce IPV were not considered. Multivariable uncertainty analyses and univariable sensitivity analyses were undertaken. RESULTS: A 5 percentage point absolute reduction in the lifetime prevalence of IPV in the 2008 Australian female population was estimated to produce 6000 fewer incident cases of disease/injury, 74 fewer deaths, 5000 fewer DALYs lost and provide gains of 926,000 working days, 371,000 days of home-based production and 428,000 leisure days. Overall, AUD371 million in opportunity cost savings could be achievable. The greatest economic savings would be home-based production (AUD147 million), followed by leisure time (AUD98 million), workforce production (AUD94 million) and reduced health sector costs (AUD38 million). CONCLUSIONS: This study contributes new knowledge about the economic impact of IPV in females. The findings provide evidence of large potential opportunity cost savings from reducing the prevalence of IPV and reinforce the need to reduce IPV in Australia, and elsewhere

Development of an electronic health message system to support recovery after stroke: Inspiring Virtual Enabled Resources following Vascular Events (iVERVE)

Purpose: Worldwide, stroke is a leading cause of disease burden. Many survivors have unmet needs after discharge from hospital. Electronic communication technology to support post-discharge care has not been used for patients with stroke. In this paper, we describe the development of a novel electronic messaging system designed for survivors of stroke to support their goals of recovery and secondary prevention after hospital discharge. Participants and methods: This was a formative evaluation study. The design was informed by a literature search, existing data from survivors of stroke, and behavior change theories. We established two working groups; one for developing the electronic infrastructure and the other (comprising researchers, clinical experts and consumer representatives) for establishing the patient-centered program. Following agreement on the categories for the goal-setting menu, we drafted relevant messages to support and educate patients. These messages were then independently reviewed by multiple topic experts. Concurrently, we established an online database to capture participant characteristics and then integrated this database with a purpose-built messaging system. We conducted alpha testing of the approach using the first 60 messages. Results: The initial goal-setting menu comprised 26 subcategories. Following expert review, another 8 goal subcategories were added to the secondary prevention category: managing cholesterol; smoking; physical activity; alcohol consumption; weight management; medication management; access to health professionals, and self-care. Initially, 455 health messages were created by members of working group 2. Following refinement and mapping to different goals by the project team, 980 health messages across the health goals and 69 general motivational messages were formulated. Seventeen independent reviewers assessed the messages and suggested adding 73 messages and removing 16 (2%). Overall, 1,233 messages (18 administrative, 69 general motivation and 1,146 health-related) were created. Conclusion: This novel electronic self-management support system is ready to be pilot tested in a randomized controlled trial in patients with stroke

Understanding the relationship between costs and the modified Rankin Scale: a systematic review, multidisciplinary consensus and recommendations for future studies

Background and purpose: Cost-of-illness studies often describe a single aggregate cost of a disease state. This approach is less helpful for a condition with a spectrum of outcomes like stroke. The modified Rankin Scale is the most commonly used outcome measure for stroke. We sought to describe the existing evidence on the costs of stroke according to individual modified Rankin Scale categories. This may be useful in future cost effectiveness modelling studies of interventions where cost data have not been collected, but disability outcome is known. Methods: Systematic review of the published literature, searching electronic databases between 2004 and 2015 using validated search filters. Results were screened to identify studies presenting costs by individual modified Rankin Scale categories. Results: Of 17,782 unique identified articles, 13 matched all inclusion criteria. In only four of these studies were costs reported by modified Rankin Scale categories. Most studies included direct medical costs only. Societal costs were assessed in two studies. Overall, studies had a high methodological and reporting quality. The heterogeneity in costing methods used in the identified studies prevented meaningful comparison of the reported cost data. Despite this limitation, the costs consistently increased with greater severity (increasing modified Rankin Scale score). Conclusions: Few cost studies of stroke include information based on stroke recovery measured by individual modified Rankin Scale categories and the existing data are limited. To reliably capture this information, future studies are needed that preferably apply standardised costing methods to promote greater potential for use in cost-effectiveness analyses whereby direct collection of patient-level resource use has not been possible

Stroke care in Africa: a systematic review of the literature

Background: Appropriate systems of stroke care are important to manage the increasing death and disability associated with stroke in Africa. Information on existing stroke services in African countries is limited. Aim: To describe the status of stroke care in Africa. Summary of review: We undertook a systematic search of the published literature to identify recent (1 January 2006–20 June 2017) publications that described stroke care in any African country. Our initial search yielded 838 potential papers, of which 38 publications were eligible representing 14/54 African countries. Across the publications included for our review, the proportion of stroke patients reported to arrive at hospital within 3 h from stroke onset varied between 10% and 43%. The median time interval between stroke onset and hospital admission was 31 h. Poor awareness of stroke signs and symptoms, shortages of medical transportation, health care personnel, and stroke units, and the high cost of brain imaging, thrombolysis, and outpatient physiotherapy rehabilitation services were reported as major barriers to providing best-practice stroke care in Africa. Conclusions: This review provides an overview of stroke care in Africa, and highlights the paucity of available data. Stroke care in Africa usually fell below the recommended standards with variations across countries and settings. Combined efforts from policy makers and health care professionals in Africa are needed to improve, and ensure access, to organized stroke care in as many settings as possible. Mechanisms to routinely monitor usual care (i.e., registries or audits) are also needed to inform policy and practice

Integrating acute stroke telemedicine consultations into specialists' usual practice: a qualitative analysis comparing the experience of Australia and the United Kingdom

Stroke telemedicine can reduce healthcare inequities by increasing access to specialists. Successful telemedicine networks require specialists adapting clinical practice to provide remote consultations. Variation in experiences of specialists between different countries is unknown. To support future implementation, we compared perceptions of Australian and United Kingdom specialists providing remote acute stroke consultations. Specialist participants were identified using purposive sampling from two new services: Australia's Victorian Stroke Telemedicine Program (n = 6; 2010-13) and the United Kingdom's Cumbria and Lancashire telestroke network (n = 5; 2010-2012). Semi-structured interviews were conducted pre- and post-implementation, recorded and transcribed verbatim. Deductive thematic and content analysis (NVivo) was undertaken by two independent coders using Normalisation Process Theory to explore integration of telemedicine into practice. Agreement between coders was M = 91%, SD = 9 and weighted average κ = 0.70. Cross-cultural similarities and differences were found. In both countries, specialists described old and new consulting practices, the purpose and value of telemedicine systems, and concerns regarding confidence in the assessment and diagnostic skills of unknown colleagues requesting telemedicine support. Australian specialists discussed how remote consultations impacted on usual roles and suggested future improvements, while United Kingdom specialists discussed system governance, policy and procedures. Australian and United Kingdom specialists reported telemedicine required changes in work practice and development of new skills. Both groups described potential for improvements in stroke telemedicine systems with Australian specialists more focused on role change and the United Kingdom on system governance issues. Future research should examine if cross-cultural variation reflects different models of care and extends to other networks