Differentiating between hospitals according to the “maturity” of quality improvement systems: a new classification scheme in a sample of European hospitals

Aim: This study, part of the Methods of Assessing Response to Quality Improvement Strategies (MARQuIS) research project focusing on cross-border patients in Europe, investigated quality policies and improvement in healthcare systems across the European Union (EU). The aim was to develop a classification scheme for the level of quality improvement (maturity) in EU hospitals, in order to evaluate hospitals according to the maturity of their quality improvement activities. Methods: A web-based questionnaire survey designed to measure quality improvement in EU hospitals was used as the basis for the classification scheme. Items included for the development of an evaluation tool-the maturity index-were considered important contributors to quality improvement. The four-stage quality cycle (plan, do, check and act) was used to determine the level of maturity of the various items. Psychometric properties of the classification scheme were assessed, and validation analyses were performed. Results: A total of 389 hospitals participated in a questionnaire survey; response rates varied by country. For a final sample of 349 hospitals, it was possible to construct a quality improvement maturity index which consisted of seven domains and 113 items. The results of independent analyses sustained the validity of the index, which was useful in differentiating between hospitals in the research sample according to the maturity of their quality improvement system (defined as the total of all quality improvement activities). Discussion: Further research is recommended to develop an instrument which for use in the future as a practical tool to evaluate the maturity of hospital quality improvement systems

Application of quality improvement strategies in 389 European hospitals: results of the MARQuIS project

Context: This study was part of the Methods of Assessing Response to Quality Improvement Strategies (MARQuIS) research project investigating the impact of quality improvement strategies on hospital care in various countries of the European Union (EU), in relation to specific needs of cross-border patients. Aim: This paper describes how EU hospitals have applied seven quality improvement strategies previously defined by the MARQuIS study: organisational quality management programmes; systems for obtaining patients' views; patient safety systems; audit and internal assessment of clinical standards; clinical and practice guidelines; performance indicators; and external assessment. Methods: A web-based questionnaire was used to survey acute care hospitals in eight EU countries. The reported findings were later validated via on-site survey and site visits in a sample of the participating hospitals. Data collection took place from April to August 2006. Results: 389 hospitals participated in the survey; response rates varied per country. All seven quality improvement strategies were widely used in European countries. Activities related to external assessment were the most broadly applied across Europe, and activities related to patient involvement were the least widely implemented. No one country implemented all quality strategies at all hospitals. There were no differences between participating hospitals in western and eastern European countries regarding the application of quality improvement strategies. Conclusions: Implementation varied per country and per quality improvement strategy, leaving considerable scope for progress in quality improvements. The results may contribute to benchmarking activities in European countries, and point to further areas of research to explore the relationship between the application of quality improvement strategies and actual hospital performanc

Involvement of patients or their representatives in quality management functions in EU hospitals:implementation and impact on patient-centred care strategies

OBJECTIVE: The objective of this study was to describe the involvement of patients or their representatives in quality management (QM) functions and to assess associations between levels of involvement and the implementation of patient-centred care strategies. DESIGN: A cross-sectional, multilevel STUDY DESIGN: that surveyed quality managers and department heads and data from an organizational audit. SETTING: Randomly selected hospitals (n = 74) from seven European countries (The Czech Republic, France, Germany, Poland, Portugal, Spain and Turkey). PARTICIPANTS: Hospital quality managers (n = 74) and heads of clinical departments (n = 262) in charge of four patient pathways (acute myocardial infarction, stroke, hip fracture and deliveries) participated in the data collection between May 2011 and February 2012. MAIN OUTCOME MEASURES: Four items reflecting essential patient-centred care strategies based on an on-site hospital visit: (1) formal survey seeking views of patients and carers, (2) written policies on patients' rights, (3) patient information literature including guidelines and (4) fact sheets for post-discharge care. The main predictors were patient involvement in QM at the (i) hospital level and (ii) pathway level. RESULTS: Current levels of involving patients and their representatives in QM functions in European hospitals are low at hospital level (mean score 1.6 on a scale of 0 to 5, SD 0.7), but even lower at departmental level (mean 0.6, SD 0.7). We did not detect associations between levels of involving patients and their representatives in QM functions and the implementation of patient-centred care strategies; however, the smallest hospitals were more likely to have implemented patient-centred care strategies. CONCLUSIONS: There is insufficient evidence that involving patients and their representatives in QM leads to establishing or implementing strategies and procedures that facilitate patient-centred care; however, lack of evidence should not be interpreted as evidence of no effect

Managing COVID-19 within and across health systems:why we need performance intelligence to coordinate a global response

Background The COVID-19 pandemic is a complex global public health crisis presenting clinical, organisational and system-wide challenges. Different research perspectives on health are needed in order to manage and monitor this crisis. Performance intelligence is an approach that emphasises the need for different research perspectives in supporting health systems’ decision-makers to determine policies based on well-informed choices. In this paper, we present the viewpoint of the Innovative Training Network for Healthcare Performance Intelligence Professionals (HealthPros) on how performance intelligence can be used during and after the COVID-19 pandemic. Discussion A lack of standardised information, paired with limited discussion and alignment between countries contribute to uncertainty in decision-making in all countries. Consequently, a plethora of different non-data-driven and uncoordinated approaches to address the outbreak are noted worldwide. Comparative health system research is needed to help countries shape their response models in social care, public health, primary care, hospital care and long-term care through the different phases of the pandemic. There is a need in each phase to compare context-specific bundles of measures where the impact on health outcomes can be modelled using targeted data and advanced statistical methods. Performance intelligence can be pursued to compare data, construct indicators and identify optimal strategies. Embracing a system perspective will allow countries to take coordinated strategic decisions while mitigating the risk of system collapse.A framework for the development and implementation of performance intelligence has been outlined by the HealthPros Network and is of pertinence. Health systems need better and more timely data to govern through a pandemic-induced transition period where tensions between care needs, demand and capacity are exceptionally high worldwide. Health systems are challenged to ensure essential levels of healthcare towards all patients, including those who need routine assistance. Conclusion Performance intelligence plays an essential role as part of a broader public health strategy in guiding the decisions of health system actors on the implementation of contextualised measures to tackle COVID-19 or any future epidemic as well as their effect on the health system at large. This should be based on commonly agreed-upon standardised data and fit-for-purpose indicators, making optimal use of existing health information infrastructures. The HealthPros Network can make a meaningful contribution

Towards actionable international comparisons of health system performance: expert revision of the OECD framework and quality indicators.

OBJECTIVE: To review and update the conceptual framework, indicator content and research priorities of the Organisation for Economic Cooperation and Development's (OECD) Health Care Quality Indicators (HCQI) project, after a decade of collaborative work. DESIGN: A structured assessment was carried out using a modified Delphi approach, followed by a consensus meeting, to assess the suite of HCQI for international comparisons, agree on revisions to the original framework and set priorities for research and development. SETTING: International group of countries participating to OECD projects. PARTICIPANTS: Members of the OECD HCQI expert group. RESULTS: A reference matrix, based on a revised performance framework, was used to map and assess all seventy HCQI routinely calculated by the OECD expert group. A total of 21 indicators were agreed to be excluded, due to the following concerns: (i) relevance, (ii) international comparability, particularly where heterogeneous coding practices might induce bias, (iii) feasibility, when the number of countries able to report was limited and the added value did not justify sustained effort and (iv) actionability, for indicators that were unlikely to improve on the basis of targeted policy interventions. CONCLUSIONS: The revised OECD framework for HCQI represents a new milestone of a long-standing international collaboration among a group of countries committed to building common ground for performance measurement. The expert group believes that the continuation of this work is paramount to provide decision makers with a validated toolbox to directly act on quality improvement strategies

Can italian healthcare administrative databases be used to compare regions with respect to compliance with standards of care for chronic diseases?

BACKGROUND: Italy has a population of 60 million and a universal coverage single-payer healthcare system, which mandates collection of healthcare administrative data in a uniform fashion throughout the country. On the other hand, organization of the health system takes place at the regional level, and local initiatives generate natural experiments. This is happening in particular in primary care, due to the need to face the growing burden of chronic diseases. Health services research can compare and evaluate local initiatives on the basis of the common healthcare administrative data.However reliability of such data in this context needs to be assessed, especially when comparing different regions of the country. In this paper we investigated the validity of healthcare administrative databases to compute indicators of compliance with standards of care for diabetes, ischaemic heart disease (IHD) and heart failure (HF). METHODS: We compared indicators estimated from healthcare administrative data collected by Local Health Authorities in five Italian regions with corresponding estimates from clinical data collected by General Practitioners (GPs). Four indicators of diagnostic follow-up (two for diabetes, one for IHD and one for HF) and four indicators of appropriate therapy (two each for IHD and HF) were considered. RESULTS: Agreement between the two data sources was very good, except for indicators of laboratory diagnostic follow-up in one region and for the indicator of bioimaging diagnostic follow-up in all regions, where measurement with administrative data underestimated quality. CONCLUSION: According to evidence presented in this study, estimating compliance with standards of care for diabetes, ischaemic heart disease and heart failure from healthcare databases is likely to produce reliable results, even though completeness of data on diagnostic procedures should be assessed first. Performing studies comparing regions using such indicators as outcomes is a promising development with potential to improve quality governance in the Italian healthcare system

Development and validation of an index to assess hospital quality management systems

The study, "Deepening our Understanding of Quality Improvement in Europe (DUQuE)" has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 241822. Funding to pay the Open Access publication charges for this article was provided by European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement no. 241822.Objective: The aim of this study was to develop and validate an index to assess the implementation of quality management systems (QMSs) in European countries. Design: Questionnaire development was facilitated through expert opinion, literature review and earlier empirical research. A cross-sectional online survey utilizing the questionnaire was undertaken between May 2011 and February 2012. We used psychometric methods to explore the factor structure, reliability and validity of the instrument. Setting and participants. As part of the Deepening our Understanding of Quality improvement in Europe (DUQuE) project, we invited a random sample of 188 hospitals in 7 countries. The quality managers of these hospitals were the main respondents. Main Outcome Measure. The extent of implementation of QMSs. Results: Factor analysis yielded nine scales, which were combined to build the Quality Management Systems Index. Cronbach's reliability coefficients were satisfactory (ranging from 0.72 to 0.82) for eight scales and low for one scale (0.48). Corrected item-total correlations provided adequate evidence of factor homogeneity. Inter-scale correlations showed that every factor was related, but also distinct, and added to the index. Construct validity testing showed that the index was related to recent measures of quality. Participating hospitals attained a mean value of 19.7 (standard deviation of 4.7) on the index that theoretically ranged from 0 to 27. Conclusion: Assessing QMSs across Europe has the potential to help policy-makers and other stakeholders to compare hospitals and focus on the most important areas for improvement

Involvement of patients or their representatives in quality management functions in EU hospitals : Implementation and impact on patient-centred care strategies

The study, "Deepening our Understanding of Quality Improvement in Europe (DUQuE)" has received funding from the European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement no 241822. Funding to pay the Open Access publication charges for this article was provided by European Community's Seventh Framework Programme (FP7/2007-2013) under grant agreement no 241822.Objective: The objective of this study was to describe the involvement of patients or their representatives in quality management (QM) functions and to assess associations between levels of involvement and the implementation of patient-centred care strategies. Design: A cross-sectional, multilevel study design that surveyed quality managers and department heads and data from an organizational audit. Setting: Randomly selected hospitals (n = 74) from seven European countries (The Czech Republic, France, Germany, Poland, Portugal, Spain and Turkey). Participants: Hospital qualitymanagers (n = 74) and heads of clinical departments (n = 262) in charge of four patient pathways (acute myocardial infarction, stroke, hip fracture and deliveries) participated in the data collection between May 2011 and February 2012. Main Outcome Measures: Four items reflecting essential patient-centred care strategies based on an on-site hospital visit: (1) formal survey seeking views of patients and carers, (2) written policies on patients' rights, (3) patient information literature including guidelines and (4) fact sheets for post-discharge care. The main predictors were patient involvement in QM at the (i) hospital level and (ii) pathway level. Results: Current levels of involving patients and their representatives in QM functions in European hospitals are low at hospital level (mean score 1.6 on a scale of 0 to 5, SD 0.7), but even lower at departmental level (mean 0.6, SD 0.7). We did not detect associations between levels of involving patients and their representatives in QM functions and the implementation of patient-centred care strategies; however, the smallest hospitals were more likely to have implemented patient-centred care strategies. Conclusions: There is insufficient evidence that involving patients and their representatives in QM leads to establishing or implementing strategies and procedures that facilitate patient-centred care; however, lack of evidence should not be interpreted as evidence of no effect

Suboptimal asthma care for immigrant children: results of an audit study

<p>Abstract</p> <p>Background</p> <p>Little is known on the scope and nature of ethnic inequalities in suboptimal asthma care for children. This study aimed to assess (1) ethnic differences in suboptimal asthma care for children with an asthma exacerbation who consulted a physician, and (2) ethnic differences in the nature of suboptimal care.</p> <p>Methods</p> <p>All children aged 6–16 years who during a period of six months consulted the paediatric department of the Academic Medical Centre-University of Amsterdam or one of the six regional primary care centres with an asthma exacerbation were included. Clinical guidelines were systematically converted to review criteria following the strategy as proposed by the Agency for Health Care Policy and Research. Based upon these review criteria and their experience experts of two multidisciplinary panels retrospectively assessed the quality of care and its (possible) failure to prevent the occurrence of asthma exacerbation.</p> <p>Results</p> <p>Only a small number of children (n = 35) were included in the analysis as a result of which the ethnic differences in suboptimal care were not significant. However, the results do indicate immigrant children, in particular 'other non-Western' children (n = 11), more frequently to receive suboptimal care related to the asthma exacerbation when compared to ethnic Dutch children. Furthermore, we found the nature of suboptimal care to differ with under-prescribing in the 'other non-Western' group (n = 11), lack of information exchange between physicians in the Surinamese/Antillean group (n = 12) and lack of education, and counselling of patients and parents in the ethnic Dutch (n = 12) as the most relevant factor.</p> <p>Conclusion</p> <p>Ethnic inequalities in the scope and nature of suboptimal asthma care for children in the Netherlands seem to exist. For the non-western immigrant groups the results indicate the importance of the prescription behaviour of the medical doctor, as well as the supervision by one health care provider.</p