Developing new ways of measuring the quality and impact of ambulance service care: the PhOEBE mixed-methods research programme

Background Ambulance service quality measures have focused on response times and a small number of emergency conditions, such as cardiac arrest. These quality measures do not reflect the care for the wide range of problems that ambulance services respond to and the Prehospital Outcomes for Evidence Based Evaluation (PhOEBE) programme sought to address this. Objectives The aim was to develop new ways of measuring the impact of ambulance service care by reviewing and synthesising literature on prehospital ambulance outcome measures and using consensus methods to identify measures for further development; creating a data set linking routinely collected ambulance service, hospital and mortality data; and using the linked data to explore the development of case-mix adjustment models to assess differences or changes in processes and outcomes resulting from ambulance service care. Design A mixed-methods study using a systematic review and synthesis of performance and outcome measures reported in policy and research literature; qualitative interviews with ambulance service users; a three-stage consensus process to identify candidate indicators; the creation of a data set linking ambulance, hospital and mortality data; and statistical modelling of the linked data set to produce novel case-mix adjustment measures of ambulance service quality. Setting East Midlands and Yorkshire, England. Participants Ambulance services, patients, public, emergency care clinical academics, commissioners and policy-makers between 2011 and 2015. Interventions None. Main outcome measures Ambulance performance and quality measures. Data sources Ambulance call-and-dispatch and electronic patient report forms, Hospital Episode Statistics, accident and emergency and inpatient data, and Office for National Statistics mortality data. Results Seventy-two candidate measures were generated from systematic reviews in four categories: (1) ambulance service operations (n = 14), (2) clinical management of patients (n = 20), (3) impact of care on patients (n = 9) and (4) time measures (n = 29). The most common operations measures were call triage accuracy; clinical management was adherence to care protocols, and for patient outcome it was survival measures. Excluding time measures, nine measures were highly prioritised by participants taking part in the consensus event, including measures relating to pain, patient experience, accuracy of dispatch decisions and patient safety. Twenty experts participated in two Delphi rounds to refine and prioritise measures and 20 measures scored ≥ 8/9 points, which indicated good consensus. Eighteen patient and public representatives attending a consensus workshop identified six measures as important: time to definitive care, response time, reduction in pain score, calls correctly prioritised to appropriate levels of response, proportion of patients with a specific condition who are treated in accordance with established guidelines, and survival to hospital discharge for treatable emergency conditions. From this we developed six new potential indicators using the linked data set, of which five were constructed using case-mix-adjusted predictive models: (1) mean change in pain score; (2) proportion of serious emergency conditions correctly identified at the time of the 999 call; (3) response time (unadjusted); (4) proportion of decisions to leave a patient at scene that were potentially inappropriate; (5) proportion of patients transported to the emergency department by 999 emergency ambulance who did not require treatment or investigation(s); and (6) proportion of ambulance patients with a serious emergency condition who survive to admission, and to 7 days post admission. Two indicators (pain score and response times) did not need case-mix adjustment. Among the four adjusted indicators, we found that accuracy of call triage was 61%, rate of potentially inappropriate decisions to leave at home was 5–10%, unnecessary transport to hospital was 1.7–19.2% and survival to hospital admission was 89.5–96.4% depending on Clinical Commissioning Group area. We were unable to complete a fourth objective to test the indicators in use because of delays in obtaining data. An economic analysis using indicators (4) and (5) showed that incorrect decisions resulted in higher costs. Limitations Creation of a linked data set was complex and time-consuming and data quality was variable. Construction of the indicators was also complex and revealed the effects of other services on outcome, which limits comparisons between services. Conclusions We identified and prioritised, through consensus processes, a set of potential ambulance service quality measures that reflected preferences of services and users. Together, these encompass a broad range of domains relevant to the population using the emergency ambulance service. The quality measures can be used to compare ambulance services or regions or measure performance over time if there are improvements in mechanisms for linking data across services. Future work The new measures can be used to assess different dimensions of ambulance service delivery but current data challenges prohibit routine use. There are opportunities to improve data linkage processes and to further develop, validate and simplify these measures. Funding The National Institute for Health Research Programme Grants for Applied Research programme

Application of the HIV prevention cascade to identify, develop and evaluate interventions to improve use of prevention methods: examples from a study in east Zimbabwe

Introduction: The HIV prevention cascade could be used in developing interventions to strengthen implementation of efficacious HIV prevention methods, but its practical utility needs to be demonstrated. We propose a standardized approach to using the cascade to guide identification and evaluation of interventions and demonstrate its feasibility for this purpose through a project to develop interventions to improve HIV prevention methods use by adolescent girls and young women (AGYW) and potential male partners in east Zimbabwe. Discussion: We propose a six-step approach to using a published generic HIV prevention cascade formulation to develop interventions to increase motivation to use, access to and effective use of an HIV prevention method. These steps are as follows: (1) measure the HIV prevention cascade for the chosen population and method; (2) identify gaps in the cascade; (3) identify explanatory factors (barriers) contributing to observed gaps; (4) review literature to identify relevant theoretical frameworks and interventions; (5) tailor interventions to the local context; and (6) implement and evaluate the interventions using the cascade steps and explanatory factors as outcome indicators in the evaluation design. In the Zimbabwe example, steps 1-5 aided development of four interventions to overcome barriers to effective use of pre-exposure prophylaxis (PrEP) in AGYW (15-24 years) and voluntary medical male circumcision in male partners (15-29). For young men, prevention cascade analyses identified gaps in motivation and access as barriers to voluntary medical male circumcision uptake, so an intervention was designed including financial incentives and an education session. For AGYW, gaps in motivation (particularly lack of risk perception) and access were identified as barriers to PrEP uptake: an interactive counselling game was developed addressing these barriers. A text messaging intervention was developed to improve PrEP adherence among AGYW, addressing reasons underlying lack of effective PrEP use through improving the capacity (“skills”) to take PrEP effectively. A community-led intervention (community conversations) was developed addressing community-level factors underlying gaps in motivation, access and effective use. These interventions are being evaluated currently using outcomes from the HIV prevention cascade (step 6). Conclusions: The prevention cascade can guide development and evaluation of interventions to strengthen implementation of HIV prevention methods by following the proposed process

UNderstanding uptake of Immunisations in TravellIng aNd Gypsy communities (UNITING): a qualitative interview study

Background: Gypsies, Travellers and Roma (referred to as Travellers) are less likely to access health services, including immunisation. To improve immunisation rates, we need to understand what helps and hinders individuals in these communities in taking up immunisations. Aims: (1) Investigate the barriers to and facilitators of acceptability and uptake of immunisations among six Traveller communities across four UK cities; and (2) identify possible interventions to increase uptake of immunisations in these Traveller communities that could be tested in a subsequent feasibility study. Methods: Three-phase qualitative study underpinned by the social ecological model. Phase 1: interviews with 174 Travellers from six communities: Romanian Roma (Bristol); English Gypsy/Irish Traveller (Bristol); English Gypsy (York); Romanian/Slovakian Roma (Glasgow); Scottish Showpeople (Glasgow); and Irish Traveller (London). Focus on childhood and adult vaccines. Phase 2: interviews with 39 service providers. Data were analysed using the framework approach. Interventions were identified using a modified intervention mapping approach. Phase 3: 51 Travellers and 25 service providers attended workshops and produced a prioritised list of potentially acceptable and feasible interventions. Results: There were many common accounts of barriers and facilitators across communities, particularly across the English-speaking communities. Scottish Showpeople were the most similar to the general population. Roma communities experienced additional barriers of language and being in a new country. Men, women and service providers described similar barriers and facilitators. There was widespread acceptance of childhood and adult immunisation, with current parents perceived as more positive than their elders. A minority of English-speaking Travellers worried about multiple/combined childhood vaccines, adult flu and whooping cough. Cultural concerns about vaccines offered during pregnancy and about human papillomavirus were most evident in the Bristol English Gypsy/Irish Traveller community. Language, literacy, discrimination, poor school attendance, poverty and housing were identified by Travellers and service providers as barriers for some. Trustful relationships with health professionals were important and continuity of care was valued. A few English-speaking Travellers described problems of booking and attending for immunisation. Service providers tailored their approach to Travellers, particularly the Roma. Funding cuts, NHS reforms and poor monitoring challenged their work. Five ‘top-priority’ interventions were agreed across communities and service providers to improve the immunisation among Travellers who are housed or settled on an authorised site: (1) cultural competence training for health professionals and frontline staff; (2) identification of Travellers in health records to tailor support and monitor uptake; (3) provision of a named frontline person in general practitioner practices to provide respectful and supportive service; (4) flexible and diverse systems for booking appointments, recall and reminders; and (5) protected funding for health visitors specialising in Traveller health, including immunisation. Limitations: No Travellers living on the roadside or on unofficial encampments were interviewed. We should exert caution in generalising to these groups. Future work: To include development, implementation and evaluation of a national policy plan (and practice guidance plan) to promote the uptake of immunisation among Traveller communities

Defining Kawasaki disease and pediatric inflammatory multisystem syndrome-temporally associated to SARS-CoV-2 infection during SARS-CoV-2 epidemic in Italy: results from a national, multicenter survey

Background: There is mounting evidence on the existence of a Pediatric Inflammatory Multisystem Syndrome-temporally associated to SARS-CoV-2 infection (PIMS-TS), sharing similarities with Kawasaki Disease (KD). The main outcome of the study were to better characterize the clinical features and the treatment response of PIMS-TS and to explore its relationship with KD determining whether KD and PIMS are two distinct entities. Methods: The Rheumatology Study Group of the Italian Pediatric Society launched a survey to enroll patients diagnosed with KD (Kawasaki Disease Group - KDG) or KD-like (Kawacovid Group - KCG) disease between February 1st 2020, and May 31st 2020. Demographic, clinical, laboratory data, treatment information, and patients' outcome were collected in an online anonymized database (RedCAP®). Relationship between clinical presentation and SARS-CoV-2 infection was also taken into account. Moreover, clinical characteristics of KDG during SARS-CoV-2 epidemic (KDG-CoV2) were compared to Kawasaki Disease patients (KDG-Historical) seen in three different Italian tertiary pediatric hospitals (Institute for Maternal and Child Health, IRCCS "Burlo Garofolo", Trieste; AOU Meyer, Florence; IRCCS Istituto Giannina Gaslini, Genoa) from January 1st 2000 to December 31st 2019. Chi square test or exact Fisher test and non-parametric Wilcoxon Mann-Whitney test were used to study differences between two groups. Results: One-hundred-forty-nine cases were enrolled, (96 KDG and 53 KCG). KCG children were significantly older and presented more frequently from gastrointestinal and respiratory involvement. Cardiac involvement was more common in KCG, with 60,4% of patients with myocarditis. 37,8% of patients among KCG presented hypotension/non-cardiogenic shock. Coronary artery abnormalities (CAA) were more common in the KDG. The risk of ICU admission were higher in KCG. Lymphopenia, higher CRP levels, elevated ferritin and troponin-T characterized KCG. KDG received more frequently immunoglobulins (IVIG) and acetylsalicylic acid (ASA) (81,3% vs 66%; p = 0.04 and 71,9% vs 43,4%; p = 0.001 respectively) as KCG more often received glucocorticoids (56,6% vs 14,6%; p < 0.0001). SARS-CoV-2 assay more often resulted positive in KCG than in KDG (75,5% vs 20%; p < 0.0001). Short-term follow data showed minor complications. Comparing KDG with a KD-Historical Italian cohort (598 patients), no statistical difference was found in terms of clinical manifestations and laboratory data. Conclusion: Our study suggests that SARS-CoV-2 infection might determine two distinct inflammatory diseases in children: KD and PIMS-TS. Older age at onset and clinical peculiarities like the occurrence of myocarditis characterize this multi-inflammatory syndrome. Our patients had an optimal response to treatments and a good outcome, with few complications and no deaths

An assessment of the cost-effectiveness of magnetic resonance, including diffusion-weighted imaging in patients with transient ischaemic attack and minor stroke : a systematic review, meta-analysis and economic evaluation

Erratum issued September 2015 Erratum DOI: 10.3310/hta18270-c201509Peer reviewedPublisher PD