Developing new ways of measuring the quality and impact of ambulance service care: the PhOEBE mixed-methods research programme

Background Ambulance service quality measures have focused on response times and a small number of emergency conditions, such as cardiac arrest. These quality measures do not reflect the care for the wide range of problems that ambulance services respond to and the Prehospital Outcomes for Evidence Based Evaluation (PhOEBE) programme sought to address this. Objectives The aim was to develop new ways of measuring the impact of ambulance service care by reviewing and synthesising literature on prehospital ambulance outcome measures and using consensus methods to identify measures for further development; creating a data set linking routinely collected ambulance service, hospital and mortality data; and using the linked data to explore the development of case-mix adjustment models to assess differences or changes in processes and outcomes resulting from ambulance service care. Design A mixed-methods study using a systematic review and synthesis of performance and outcome measures reported in policy and research literature; qualitative interviews with ambulance service users; a three-stage consensus process to identify candidate indicators; the creation of a data set linking ambulance, hospital and mortality data; and statistical modelling of the linked data set to produce novel case-mix adjustment measures of ambulance service quality. Setting East Midlands and Yorkshire, England. Participants Ambulance services, patients, public, emergency care clinical academics, commissioners and policy-makers between 2011 and 2015. Interventions None. Main outcome measures Ambulance performance and quality measures. Data sources Ambulance call-and-dispatch and electronic patient report forms, Hospital Episode Statistics, accident and emergency and inpatient data, and Office for National Statistics mortality data. Results Seventy-two candidate measures were generated from systematic reviews in four categories: (1) ambulance service operations (n = 14), (2) clinical management of patients (n = 20), (3) impact of care on patients (n = 9) and (4) time measures (n = 29). The most common operations measures were call triage accuracy; clinical management was adherence to care protocols, and for patient outcome it was survival measures. Excluding time measures, nine measures were highly prioritised by participants taking part in the consensus event, including measures relating to pain, patient experience, accuracy of dispatch decisions and patient safety. Twenty experts participated in two Delphi rounds to refine and prioritise measures and 20 measures scored ≥ 8/9 points, which indicated good consensus. Eighteen patient and public representatives attending a consensus workshop identified six measures as important: time to definitive care, response time, reduction in pain score, calls correctly prioritised to appropriate levels of response, proportion of patients with a specific condition who are treated in accordance with established guidelines, and survival to hospital discharge for treatable emergency conditions. From this we developed six new potential indicators using the linked data set, of which five were constructed using case-mix-adjusted predictive models: (1) mean change in pain score; (2) proportion of serious emergency conditions correctly identified at the time of the 999 call; (3) response time (unadjusted); (4) proportion of decisions to leave a patient at scene that were potentially inappropriate; (5) proportion of patients transported to the emergency department by 999 emergency ambulance who did not require treatment or investigation(s); and (6) proportion of ambulance patients with a serious emergency condition who survive to admission, and to 7 days post admission. Two indicators (pain score and response times) did not need case-mix adjustment. Among the four adjusted indicators, we found that accuracy of call triage was 61%, rate of potentially inappropriate decisions to leave at home was 5–10%, unnecessary transport to hospital was 1.7–19.2% and survival to hospital admission was 89.5–96.4% depending on Clinical Commissioning Group area. We were unable to complete a fourth objective to test the indicators in use because of delays in obtaining data. An economic analysis using indicators (4) and (5) showed that incorrect decisions resulted in higher costs. Limitations Creation of a linked data set was complex and time-consuming and data quality was variable. Construction of the indicators was also complex and revealed the effects of other services on outcome, which limits comparisons between services. Conclusions We identified and prioritised, through consensus processes, a set of potential ambulance service quality measures that reflected preferences of services and users. Together, these encompass a broad range of domains relevant to the population using the emergency ambulance service. The quality measures can be used to compare ambulance services or regions or measure performance over time if there are improvements in mechanisms for linking data across services. Future work The new measures can be used to assess different dimensions of ambulance service delivery but current data challenges prohibit routine use. There are opportunities to improve data linkage processes and to further develop, validate and simplify these measures. Funding The National Institute for Health Research Programme Grants for Applied Research programme

UNderstanding uptake of Immunisations in TravellIng aNd Gypsy communities (UNITING): a qualitative interview study

Background: Gypsies, Travellers and Roma (referred to as Travellers) are less likely to access health services, including immunisation. To improve immunisation rates, we need to understand what helps and hinders individuals in these communities in taking up immunisations. Aims: (1) Investigate the barriers to and facilitators of acceptability and uptake of immunisations among six Traveller communities across four UK cities; and (2) identify possible interventions to increase uptake of immunisations in these Traveller communities that could be tested in a subsequent feasibility study. Methods: Three-phase qualitative study underpinned by the social ecological model. Phase 1: interviews with 174 Travellers from six communities: Romanian Roma (Bristol); English Gypsy/Irish Traveller (Bristol); English Gypsy (York); Romanian/Slovakian Roma (Glasgow); Scottish Showpeople (Glasgow); and Irish Traveller (London). Focus on childhood and adult vaccines. Phase 2: interviews with 39 service providers. Data were analysed using the framework approach. Interventions were identified using a modified intervention mapping approach. Phase 3: 51 Travellers and 25 service providers attended workshops and produced a prioritised list of potentially acceptable and feasible interventions. Results: There were many common accounts of barriers and facilitators across communities, particularly across the English-speaking communities. Scottish Showpeople were the most similar to the general population. Roma communities experienced additional barriers of language and being in a new country. Men, women and service providers described similar barriers and facilitators. There was widespread acceptance of childhood and adult immunisation, with current parents perceived as more positive than their elders. A minority of English-speaking Travellers worried about multiple/combined childhood vaccines, adult flu and whooping cough. Cultural concerns about vaccines offered during pregnancy and about human papillomavirus were most evident in the Bristol English Gypsy/Irish Traveller community. Language, literacy, discrimination, poor school attendance, poverty and housing were identified by Travellers and service providers as barriers for some. Trustful relationships with health professionals were important and continuity of care was valued. A few English-speaking Travellers described problems of booking and attending for immunisation. Service providers tailored their approach to Travellers, particularly the Roma. Funding cuts, NHS reforms and poor monitoring challenged their work. Five ‘top-priority’ interventions were agreed across communities and service providers to improve the immunisation among Travellers who are housed or settled on an authorised site: (1) cultural competence training for health professionals and frontline staff; (2) identification of Travellers in health records to tailor support and monitor uptake; (3) provision of a named frontline person in general practitioner practices to provide respectful and supportive service; (4) flexible and diverse systems for booking appointments, recall and reminders; and (5) protected funding for health visitors specialising in Traveller health, including immunisation. Limitations: No Travellers living on the roadside or on unofficial encampments were interviewed. We should exert caution in generalising to these groups. Future work: To include development, implementation and evaluation of a national policy plan (and practice guidance plan) to promote the uptake of immunisation among Traveller communities

Prescribed doses of inhaled steroids in Dutch children: too little or too much, for too short a time

Aims To investigate the dosage and duration of inhaled steroids prescribed to children and to compare the prescribed doses with recommended doses for the treatment of asthma in children. Methods For 2514 Dutch children aged 0-12 years who had used inhaled steroids in 2002, pharmacy dispensing data were obtained from the InterAction database, type of steroid (beclomethason, budesonide, fluticasone) and type of user (first time or existing) and the average prescribed doses according to age were determined and compared with the doses as recommended in the national Dutch Nederlands Huisartsen Genootschap (NHG) guideline. Furthermore, for all first-time users the duration of therapy with inhaled steroids was determined using a Kaplan-Meier analysis. Results The major findings were that: (i) overall 43% of children starting inhaled steroids were prescribed doses that are half the recommended dose or less; (ii) overall 8% of the children starting inhaled steroids were prescribed doses that were twice the recommended dose or more, up to 50% in the 12-year-olds fluticasone group; and (iii) only 8% of the children who started with inhaled steroids used them continuously for a full year. Conclusions Doses of inhaled steroids for many children deviate from those recommended, with lower doses more frequently occurring than higher doses. Less than 10% of the children receive prescriptions for a prolonged period of time