Differences in delivery of prehospital ambulance care comparing non-white versus white patients with suspected cardiac chest pain: cross-sectional study

Introduction Quality implies equitable care irrespective of ethnicity. There have been few previous studies investigating quality of prehospital cardiac care by ethnicity. We aimed to investigate whether prehospital care for suspected cardiac pain varied by ethnicity. Methods We conducted a cross-sectional analysis of retrospective electronic clinical data for patients with chest pain over one year (August 2011 to July 2012) extracted from a single regional ambulance service. This included patient demographic data (ethnicity, age, sex, deprivation), clinical measurements (blood pressure, respiratory rate, pain assessment, temperature, blood glucose, oxygen saturation), drugs (aspirin, nitroglycerin, Entonox, morphine) and outcomes such as transportation to hospital or referral to primary care. We used multivariate regression to investigate differences in care by ethnicity comparing non-white with white patients. Results There were 7046 patients with suspected cardiac chest pain, with 4825 who had ethnicity recorded including 4661 (96.6%) white, 164 (3.4%) non-white (2221 patients had missing data for ethnicity). Non-white patients were similar in sex (p=0.63) and socioeconomic group (p=0.07) but significantly younger in age (p<0.001) than white patients. After correcting for age, sex, socioeconomic status and whether transported to hospital, non-white patients were similar to white patients in recording of blood pressure, pain score or electrocardiogram but significantly more likely to have temperature (77.4 vs.69.8%), blood glucose (78.7 vs. 69.4%), and oxygen saturation (85.4 vs. 80.7%) recorded. There were no differences in aspirin, nitroglycerin, Entonox or morphine treatment but non-white patients were less likely than white patients to be transported to hospital (93.3 vs. 94.4, p=0.02). Conclusion We found differences in prehospital ambulance care for non-white compared with white patients with cardiac pain that could be due to recording bias, varying clinical condition or provider management. Further analysis should involve larger and more complete datasets to explore ethnic differences in greater detail

Leadership, innovation and engagement in quality improvement in the Ambulance Services Cardiovascular Quality Initiative: cross sectional study

Introduction: Clinical leadership and organisational culture are important contextual factors for successful Quality Improvement (QI) programmes. The relationship between these and with organisational performance is complex and poorly understood. We aimed to explore the relationship between leadership, culture of innovation, and clinical engagement in QI for organisations participating in a large-scale national ambulance Quality Improvement Collaborative (QIC). Methods: We used a cross sectional survey design. An online questionnaire was distributed to 22,117 frontline ambulance staff across all 12 ambulance services in England. Scores (0-100%) were derived for each key aspect: clinical leadership; culture of innovation; use of QI methods; and effectiveness of QI methods. Responses to an open-ended question were analysed and complemented the quantitative findings. Results: There were 2,743 (12%) responses from 11 of 12 participating ambulance services. Despite only a small proportion of responders (3%) being directly involved with ASCQI, leadership behaviour was significantly higher for ASCQI members than for non-ASCQI members. Involvement in ASCQI was not significantly associated with responders’ perceptions of the culture of innovation of their organisation, which was generally considered to be poor. ASCQI members were significantly more likely to use QI methods but overall uptake of QI methods was low. The use of QI methods was also significantly associated with leadership behaviour and service tenure. Limitations: There was a low response rate, although sufficient responses to enable comparison of those who participated in ASCQI with those who did not. Conclusion and recommendations: Although participants reported a lack of organisational culture of innovation, considered a prerequisite for QI, the collaborative achieved significant wide-scale improvements in prehospital care for myocardial infarction and stroke. We postulate that improvement was mediated through a ‘QI subculture’ developed from ASCQI’s distributed leadership and network. Further research is needed to understand success factors for QI in different complex healthcare environments

What do users value about the emergency ambulance service?

Introduction: Response times have been used as a key quality indicator for emergency ambulance services in the United Kingdom, but criticised for their narrow focus. Consequently, there is a need to consider wider measures of quality. The patient perspective is becoming an increasingly important dimension in pre-hospital outcomes research. To that end, we aimed to investigate patients’ experiences of the 999 ambulance service to understand the processes and outcomes important to them. Methods: We employed a qualitative design, using semi-structured interviews with a purposive sample of people who had recently used a 999 ambulance in the East Midlands. We recruited patients of different age, sex, geographical location, and ambulance service response including ‘hear and treat’, ‘see and treat’ and ‘see and convey’. Results: We interviewed 20 service users. Eleven men and nine women participated and 12 were aged 65 years and over. Users valued a quick response when they perceived the call to be an emergency. This was of less value to those who did not perceive their situation as an emergency and irrelevant to ‘hear and treat’ users. All users valued the professional approach and information and advice given by call handlers, crew and first responders, which provided them with reassurance in a worrying situation. ‘See and convey’ users valued a seamless handover to secondary care. Limitations: We found it challenging to engage participants to consider quality indicators beyond response times because these were considered to be abstract in comparison with their concrete experiences. Conclusions and recommendations: Aspects other than response times were important to patients, particularly in situations perceived by patients to be non-emergency. The results will be combined with issues identified from systematic reviews and used in a Delphi study to identify candidates for new outcome measures for emergency ambulance services

Leadership, innovation and engagement in quality improvement in the Ambulance Services Cardiovascular Quality Initiative: cross sectional study

Introduction: Clinical leadership and organisational culture are important contextual factors for successful Quality Improvement (QI) programmes. The relationship between these and with organisational performance is complex and poorly understood. We aimed to explore the relationship between leadership, culture of innovation, and clinical engagement in QI for organisations participating in a large-scale national ambulance Quality Improvement Collaborative (QIC). Methods: We used a cross sectional survey design. An online questionnaire was distributed to 22,117 frontline ambulance staff across all 12 ambulance services in England. Scores (0-100%) were derived for each key aspect: clinical leadership; culture of innovation; use of QI methods; and effectiveness of QI methods. Responses to an open-ended question were analysed and complemented the quantitative findings. Results: There were 2,743 (12%) responses from 11 of 12 participating ambulance services. Despite only a small proportion of responders (3%) being directly involved with ASCQI, leadership behaviour was significantly higher for ASCQI members than for non-ASCQI members. Involvement in ASCQI was not significantly associated with responders’ perceptions of the culture of innovation of their organisation, which was generally considered to be poor. ASCQI members were significantly more likely to use QI methods but overall uptake of QI methods was low. The use of QI methods was also significantly associated with leadership behaviour and service tenure. Limitations: There was a low response rate, although sufficient responses to enable comparison of those who participated in ASCQI with those who did not. Conclusion and recommendations: Although participants reported a lack of organisational culture of innovation, considered a prerequisite for QI, the collaborative achieved significant wide-scale improvements in prehospital care for myocardial infarction and stroke. We postulate that improvement was mediated through a ‘QI subculture’ developed from ASCQI’s distributed leadership and network. Further research is needed to understand success factors for QI in different complex healthcare environments

Prioritising pre-hospital outcome measures with a multi-stakeholder group: a consensus methods study

Context: A consensus event to discuss and prioritise ambulance service care outcome measures was held with 43 participants from a range of professional backgrounds including Commissioners; Policy makers; clinicians; managers; academics and patient and public representatives. Problem: Ambulance services in England manage 8 million emergency calls per years and treat 6.5 million people. Services are currently unable to ascertain whether the care they provide is safe, effective and of good quality as they receive no information about patients once they have been discharged from their care. The lack of robust patient focussed outcome measures for ambulance care means there is no opportunity for identifying and sharing good practice, identifying problems and measuring the impact of service developments and innovations. Assessment of problem and analysis of its causes: Historically ambulance service performance has been measured using response time as a proxy measure for quality. Although the limitations of this measure are recognised there is a lack of consensus on which outcome measures are important and little opportunity to measure alternatives due to poor information on what happens to patients after their ambulance service contact. The PhOEBE NIHR research programme aims to develop a linked ambulance service and secondary care dataset and to assess quality of care in this patient group using outcome measures identified from the literature and in consultation with different stakeholder groups. This means that for the first time the ambulance service will be able to assess the quality of care they provide to patients, rather than just how quickly the ambulance arrived. Intervention: Potential outcome measures identified from 2 systematic reviews were categorised into 1 of 3 headings (Service/operational, patient management and patient outcomes) and participants were pre-allocated to a discussion group. All discussion groups contained participants representing a range of stakeholder view points. Participants took part in small group themed discussions relating to a number of pre-specified outcome measures. They were also able to add to the list of measures. Directly following the discussion participants voted on the importance of the outcome measures in relation to ambulance service care quality. This was done using Turning Point software. Participants rated each outcome measure as either ‘Essential’, ‘Desirable’ or ‘Irrelevant’ using individual key pads. The voting was done independently and anonymously. Real time results were displayed following each vote. Study design: We used an interactive voting system coupled with a modified nominal group technique for the prioritisation of potential ambulance service outcome measures. Strategy for change: Following on from this study the top ranking outcome measures will be further refined as part of a Delphi study, before using the outcome measures to assess ambulance service quality of care in our linked data sample. The methods for linking the ambulance service data to other health care information and the identified outcome measures will enable all UK ambulance services to assess the quality of care they provide to patients and the impact of any service changes on care quality and patient outcomes. Measurement of improvement: The results from the outcome prioritisation voting exercise were ranked based on the highest proportion of ‘Essential’ rated measures. Where over 50% of participants rated a measure as ‘Essential’ these were taken forward and considered in further consensus studies. Effects of changes: From undertaking the consensus event we have prioritised potential ambulance service outcome measures. Lessons learnt: We have established that it is possible to incorporate voting technology into consensus methodologies and provide real time results to participants. Message for others: This research prioritised ambulance service outcome measures. Out of the 40 number of measures considered, the top 5 measures were Accuracy of dispatch decisions; Completeness and accuracy of patient records; Accuracy of call taker identification of different conditions; pain measurement and symptom relief and Patient experience

Developing new ways of measuring the impact of ambulance service care

Background Pre-hospital care in England is provided by ambulance services who deliver a diverse range of services to over 9 million patients a year but there is limited evidence about the effectiveness of this care. Historically ambulance performance has been measured by response times rather than clinical need or effectiveness. Progress on developing more appropriate performance measures is constrained by a lack of information about what happens to patients and their outcome after the pre-hospital component of care. If ambulance service information about patients could be linked to process and outcome data further along the care pathway then relevant measurement tools could be developed that allow a better assessment of the impact of pre-hospital care. The Pre-hospital Outcomes for Evidence Based Evaluation (PhOEBE) project is a 5 year programme of research funded by the UK National Institute of Health Research. Aims & objectives The aim of the programme is to develop new ways of measuring the impact of care provided by the ambulance service to support quality improvement through monitoring, audit and service evaluation. The objectives are to: 1) Review and synthesise the research literature on pre-hospital care outcome measures and identify measures relevant to the NHS and patients for further development; 2) Create a dataset linking routinely collected pre-hospital data, hospital data and mortality data to provide outcome information; 3) Develop new ways of measuring process and outcome indicators including building risk adjustment models that predict the outcomes using the linked data; 4) Explore the practical use of the linked dataset and the risk adjustment models to measure the effectiveness and quality of ambulance service care. Research plans The programme has 4 linked stages; 1. Synthesis of evidence on outcome measures and identification of measures for further development - review and assessment of the evidence base on outcome measurement for pre-hospital care and a consensus studies to identify measures relevant to patients and NHS staff. 2: Linking pre-hospital data with other patient data sources – creating a single dataset that links ambulance service electronic care records with routinely collected Hospital Episode Statistics (HES) and national mortality data. 3. Development of risk adjustment models for outcomes in patients attended by the ambulance service – using the linked data to develop risk adjustment tools that will allow patient differences to be taken into account and differences between expected and actual outcomes to be detected. Particular emphasis will be made to include the broad EMS population and not specific conditions as has been the case in the past. 4. Testing the risk adjustment models to assess if they can be used to measure effectiveness and quality – exploring the practical application of the measures by using them to assess if different ways of providing ambulance service care result in different consequences for patients. Outputs, outcomes and impact The programme will: • Provide a summary of relevant evidence on pre-hospital care outcome measurement • Develop a method for linking healthcare information into a format that can be used to support quality improvement, is acceptable to patients and complies with information legislation • Develop population based models for measuring the impact of pre-hospital care that can be used to monitor quality and safety, evaluate new service innovations and support quality improvement • Provide added value by using routine information and NHS infrastructure to operationalise the process and outcome models so that they will be of use across the NHS Progress to date The programme commenced in June 2011 and ends in May 2016. Two systematic reviews of measures used to measure the impact of ambulance service care (one policy literature and one research literature based) have been completed as has a qualitative study of recent service users to identify aspects of service they value. Potential measures identified by these studies were presented at a consensus conference and then further refined in a Delphi study to prioritise and identify measures for further development. Linked data is currently being created and the next stage will be the development of risk adjusted predictive models for the final identified measures

Understanding how Eastern European migrants use and experience UK health services: a systematic scoping review

Background: The UK has experienced significant immigration from Eastern Europe following European Union (EU) expansion in 2004, which raises the importance of equity and equality for the recent immigrants. Previous research on ethnic health inequalities focused on established minority ethnic groups, whereas Eastern European migrants are a growing, but relatively under-researched group. We aimed to conduct a systematic scoping review of published literature on Eastern European migrants’ use and experiences of UK health services. Methods: An initial search of nine databases produced 5997 relevant publications. Removing duplicates reduced the figure to 2198. Title and abstract screening left 73 publications. Full-text screening narrowed this down further to 10 articles, with three more from these publications to leave 13 included publications. We assessed publications for quality, extracted data and undertook a narrative synthesis. Results: The included publications most commonly studied sexual health and family planning services. For Eastern European migrants in the UK, the most commonly cited barriers to accessing and using healthcare were limited understanding of how the system worked and language difficulties. It was also common for migrants to return to their home country to a healthcare system they were familiar with, free from language barriers. Familial and social networks were valuable for patients with a limited command of English in the absence of suitable and available interpreting and translating services. Conclusions: To address limited understanding of the healthcare system and the English language, the NHS could produce information in all the Eastern European languages about how it operates. Adding nationality to the Electronic Patient Report Form (EPRF) may reveal the demand for interpretation and translation services. Eastern European migrants need to be encouraged to register with GPs to reduce A&E attendance for primary care conditions. Many of the issues raised will be relevant to other European countries since the long-term outcomes from Brexit are likely to influence the level of Eastern European and non-Eastern European migration across the continent, not just the UK

Prehospital outcomes for ambulance service care: systematic review

Background: Ambulance service performance measurement has previously focused on response times and survival. We conducted a systematic review of the international literature on quality measures and outcomes relating to pre-hospital ambulance service care, aiming to identify a broad range of outcome measures to provide a more meaningful assessment of ambulance service care. Methods: We searched a number of electronic databases including CINAHL, the Cochrane Library, EMBASE, Medline, and Web of Science. For inclusion, studies had to report either research or evaluation conducted in a pre-hospital setting, published in the English language from 1982 to 2011, and reporting either outcome measures or specific outcome instruments. Results: Overall, 181 full-text articles were included: 83 (46%) studies from North America, 50 (28%) from Europe and 21 (12%) from the UK. A total of 176 articles were obtained after examining 257 full-text articles in detail from 5,088 abstracts screened. A further five papers were subsequently identified from references of the articles examined and studies known to the authors. There were 140 articles (77%) which contained at least one survival-related measure, 47 (34%) which included information about length of stay and 87 (48%) which identified at least one place of discharge as an outcome. Limitations: We encountered the problem of incomplete information, for instance studies not specifying which pain scales when these had been used or using survival without a specific time period. Conclusion and recommendations: In addition to measures relating to survival, length of stay and place of discharge, we identified 247 additional outcome measures. Few studies included patient reported or cost outcomes. By identifying a wide range of outcome measures this review will inform further research looking at the feasibility of using a wider range of outcome measures and developing new outcome measures in prehospital research and quality improvement

How should we measure ambulance service quality and performance?

The problem Ambulance services in England treat 6.5 million people per year but get no information about what happens to patients after discharge. This has led to a reliance on measuring response times rather than outcomes to assess how well services perform, and little opportunity for identifying problems and good practice or evaluating service developments. Research aim There is a lack of consensus on which outcome measures are important for pre-hospital care so we set out to address this within the Prehospital Outcomes for Evidence Based Evaluation (PhOEBE) research programme. Methods We conducted a two round Delphi study to prioritise outcome measures identified from a systematic review and a multi-stakeholder consensus event. 20 participants scored 57 measures over two rounds. Participants included policy makers and commissioners, clinical ambulance service and ambulance service operational groups. Outcomes were scored in three categories: patient outcomes; whole service measures and clinical management. Results Highly ranked patient outcome measures related to pain, survival, recontacts and patient experience. High ranking outcomes in the Clinical Management group related to compliance with protocols and guidelines and appropriateness and accuracy of triage. In the Whole Service measures group highly ranked measures related to completeness of clinical records, staff training and time to definitive care. Conclusions The next steps are to identify which measures are suitable for measuring with routine data; use a linked dataset to build predictive models and determine what aspects of care can predict good or poor outcomes (mortality and non-mortality); measure the effectiveness and quality of ambulance service care, and; assess the practical use of the measures and the linked data as a way to support quality improvement in the NHS