Exploring variation in the use of feedback from national clinical audits : a realist investigation

BACKGROUND: National Clinical Audits (NCAs) are a well-established quality improvement strategy used in healthcare settings. Significant resources, including clinicians' time, are invested in participating in NCAs, yet there is variation in the extent to which the resulting feedback stimulates quality improvement. The aim of this study was to explore the reasons behind this variation. METHODS: We used realist evaluation to interrogate how context shapes the mechanisms through which NCAs work (or not) to stimulate quality improvement. Fifty-four interviews were conducted with doctors, nurses, audit clerks and other staff working with NCAs across five healthcare providers in England. In line with realist principles we scrutinised the data to identify how and why providers responded to NCA feedback (mechanisms), the circumstances that supported or constrained provider responses (context), and what happened as a result of the interactions between mechanisms and context (outcomes). We summarised our findings as Context+Mechanism = Outcome configurations. RESULTS: We identified five mechanisms that explained provider interactions with NCA feedback: reputation, professionalism, competition, incentives, and professional development. Professionalism and incentives underpinned most frequent interaction with feedback, providing opportunities to stimulate quality improvement. Feedback was used routinely in these ways where it was generated from data stored in local databases before upload to NCA suppliers. Local databases enabled staff to access data easily, customise feedback and, importantly, the data were trusted as accurate, due to the skills and experience of staff supporting audit participation. Feedback produced by NCA suppliers, which included national comparator data, was used in a more limited capacity across providers. Challenges accessing supplier data in a timely way and concerns about the quality of data submitted across providers were reported to constrain use of this mode of feedback. CONCLUSION: The findings suggest that there are a number of mechanisms that underpin healthcare providers' interactions with NCA feedback. However, there is variation in the mode, frequency and impact of these interactions. Feedback was used most routinely, providing opportunities to stimulate quality improvement, within clinical services resourced to collect accurate data and to maintain local databases from which feedback could be customised for the needs of the service

Institutional use of National Clinical Audits by healthcare providers

Rationale, aims, and objectives Healthcare systems worldwide devote significant resources towards collecting data to support care quality assurance and improvement. In the United Kingdom, National Clinical Audits are intended to contribute to these objectives by providing public reports of data on healthcare treatment and outcomes, but their potential for quality improvement in particular is not realized fully among healthcare providers. Here, we aim to explore this outcome from the perspective of hospital boards and their quality committees: an under‐studied area, given the emphasis in previous research on the audits' use by clinical teams. Methods We carried out semi‐structured, qualitative interviews with 54 staff in different clinical and management settings in five English National Health Service hospitals about their use of NCA data, and the circumstances that supported or constrained such use. We used Framework Analysis to identify themes within their responses. Results We found that members and officers of hospitals' governing bodies perceived an imbalance between the benefits to their institutions from National Clinical Audits and the substantial resources consumed by participating in them. This led some to question the audits' legitimacy, which could limit scope for improvements based on audit data, proposed by clinical teams. Conclusions Measures to enhance the audits' perceived legitimacy could help address these limitations. These include audit suppliers moving from an emphasis on cumulative, retrospective reports to real‐time reporting, clearly presenting the “headline” outcomes important to institutional bodies and staff. Measures may also include further negotiation between hospitals, suppliers and their commissioners about the nature and volume of data the latter are expected to collect; wider use by hospitals of routine clinical data to populate audit data fields; and further development of interactive digital technologies to help staff explore and report audit data in meaningful ways

Social innovation, social enterprise, and local public services: undertaking transformation?

This article discusses some of the challenges encountered in embedding effective and sustainable social enterprise and social innovation within established political institutional systems to deliver local welfare services. It draws upon evidence analyzing social innovation and social enterprise in Scotland to contribute to the debate over whether social innovations and social enterprises are able to meet expectations in addressing the significant challenges faced by welfare systems. The article clarifies the meaning of both these contested concepts and explains how social innovation and social enterprise relate to similar ideas in social and public policy. The evidence suggests that actually operating social enterprises and social innovations do not embrace the image of them promoted by enthusiasts as either “entrepreneurial” or “innovative”. Furthermore, they bring distinctive challenges in delivering local welfare services, including potential tensions or rivalry with existing public agencies. The article suggests that social enterprises and social innovations are not themselves instigators nor catalysts for systemic change, but that their impact is constrained by structural conditions and institutional factors beyond their control

Analysis of a Web-Based Dashboard to Support the Use of National Audit Data in Quality Improvement: Realist Evaluation

YesDashboards can support data-driven quality improvements in health care. They visualize data in ways intended to ease cognitive load and support data comprehension, but how they are best integrated into working practices needs further investigation. This paper reports the findings of a realist evaluation of a web-based quality dashboard (QualDash) developed to support the use of national audit data in quality improvement. QualDash was co-designed with data users and installed in 8 clinical services (3 pediatric intensive care units and 5 cardiology services) across 5 health care organizations (sites A-E) in England between July and December 2019. Champions were identified to support adoption. Data to evaluate QualDash were collected between July 2019 and August 2021 and consisted of 148.5 hours of observations including hospital wards and clinical governance meetings, log files that captured the extent of use of QualDash over 12 months, and a questionnaire designed to assess the dashboard's perceived usefulness and ease of use. Guided by the principles of realist evaluation, data were analyzed to understand how, why, and in what circumstances QualDash supported the use of national audit data in quality improvement. The observations revealed that variation across sites in the amount and type of resources available to support data use, alongside staff interactions with QualDash, shaped its use and impact. Sites resourced with skilled audit support staff and established reporting systems (sites A and C) continued to use existing processes to report data. A number of constraints influenced use of QualDash in these sites including that some dashboard metrics were not configured in line with user expectations and staff were not fully aware how QualDash could be used to facilitate their work. In less well-resourced services, QualDash automated parts of their reporting process, streamlining the work of audit support staff (site B), and, in some cases, highlighted issues with data completeness that the service worked to address (site E). Questionnaire responses received from 23 participants indicated that QualDash was perceived as useful and easy to use despite its variable use in practice. Web-based dashboards have the potential to support data-driven improvement, providing access to visualizations that can help users address key questions about care quality. Findings from this study point to ways in which dashboard design might be improved to optimize use and impact in different contexts; this includes using data meaningful to stakeholders in the co-design process and actively engaging staff knowledgeable about current data use and routines in the scrutiny of the dashboard metrics and functions. In addition, consideration should be given to the processes of data collection and upload that underpin the quality of the data visualized and consequently its potential to stimulate quality improvement.This research was funded by the National Institute for Health Research Health Services and Delivery Research Program (project #16/04/06)

Rapid spread of complex change: a case study in inpatient palliative care

<p>Abstract</p> <p>Background</p> <p>Based on positive findings from a randomized controlled trial, Kaiser Permanente's national executive leadership group set an expectation that all Kaiser Permanente and partner hospitals would implement a consultative model of interdisciplinary, inpatient-based palliative care (IPC). Within one year, the number of IPC consultations program-wide increased almost tenfold from baseline, and the number of teams nearly doubled. We report here results from a qualitative evaluation of the IPC initiative after a year of implementation; our purpose was to understand factors supporting or impeding the rapid and consistent spread of a complex program.</p> <p>Methods</p> <p>Quality improvement study using a case study design and qualitative analysis of in-depth semi-structured interviews with 36 national, regional, and local leaders.</p> <p>Results</p> <p>Compelling evidence of impacts on patient satisfaction and quality of care generated 'pull' among adopters, expressed as a remarkably high degree of conviction about the value of the model. Broad leadership agreement gave rise to sponsorship and support that permeated the organization. A robust social network promoted knowledge exchange and built on an existing network with a strong interest in palliative care. Resource constraints, pre-existing programs of a different model, and ambiguous accountability for implementation impeded spread.</p> <p>Conclusions</p> <p>A complex, hospital-based, interdisciplinary intervention in a large health care organization spread rapidly due to a synergy between organizational 'push' strategies and grassroots-level pull. The combination of push and pull may be especially important when the organizational context or the practice to be spread is complex.</p

Design and evaluation of an interactive quality dashboard for national clinical audit data: a realist evaluation

YesBackground: National audits aim to reduce variations in quality by stimulating quality improvement. However, varying provider engagement with audit data means that this is not being realised. Aim: The aim of the study was to develop and evaluate a quality dashboard (i.e. QualDash) to support clinical teams’ and managers’ use of national audit data. Design: The study was a realist evaluation and biography of artefacts study. Setting: The study involved five NHS acute trusts. Methods and results: In phase 1, we developed a theory of national audits through interviews. Data use was supported by data access, audit staff skilled to produce data visualisations, data timeliness and quality, and the importance of perceived metrics. Data were mainly used by clinical teams. Organisational-level staff questioned the legitimacy of national audits. In phase 2, QualDash was co-designed and the QualDash theory was developed. QualDash provides interactive customisable visualisations to enable the exploration of relationships between variables. Locating QualDash on site servers gave users control of data upload frequency. In phase 3, we developed an adoption strategy through focus groups. ‘Champions’, awareness-raising through e-bulletins and demonstrations, and quick reference tools were agreed. In phase 4, we tested the QualDash theory using a mixed-methods evaluation. Constraints on use were metric configurations that did not match users’ expectations, affecting champions’ willingness to promote QualDash, and limited computing resources. Easy customisability supported use. The greatest use was where data use was previously constrained. In these contexts, report preparation time was reduced and efforts to improve data quality were supported, although the interrupted time series analysis did not show improved data quality. Twenty-three questionnaires were returned, revealing positive perceptions of ease of use and usefulness. In phase 5, the feasibility of conducting a cluster randomised controlled trial of QualDash was assessed. Interviews were undertaken to understand how QualDash could be revised to support a region-wide Gold Command. Requirements included multiple real-time data sources and functionality to help to identify priorities. Conclusions: Audits seeking to widen engagement may find the following strategies beneficial: involving a range of professional groups in choosing metrics; real-time reporting; presenting ‘headline’ metrics important to organisational-level staff; using routinely collected clinical data to populate data fields; and dashboards that help staff to explore and report audit data. Those designing dashboards may find it beneficial to include the following: ‘at a glance’ visualisation of key metrics; visualisations configured in line with existing visualisations that teams use, with clear labelling; functionality that supports the creation of reports and presentations; the ability to explore relationships between variables and drill down to look at subgroups; and low requirements for computing resources. Organisations introducing a dashboard may find the following strategies beneficial: clinical champion to promote use; testing with real data by audit staff; establishing routines for integrating use into work practices; involving audit staff in adoption activities; and allowing customisation. Limitations: The COVID-19 pandemic stopped phase 4 data collection, limiting our ability to further test and refine the QualDash theory. Questionnaire results should be treated with caution because of the small, possibly biased, sample. Control sites for the interrupted time series analysis were not possible because of research and development delays. One intervention site did not submit data. Limited uptake meant that assessing the impact on more measures was not appropriate. Future work: The extent to which national audit dashboards are used and the strategies national audits use to encourage uptake, a realist review of the impact of dashboards, and rigorous evaluations of the impact of dashboards and the effectiveness of adoption strategies should be explored. Study registration: This study is registered as ISRCTN18289782.This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme and will be published in full in Health and Social Care Delivery Research; Vol. 10, No. 12. See the NIHR Journals Library website for further project information

Discovery of potent and selective MRCK inhibitors with therapeutic effect on skin cancer

The myotonic dystrophy-related Cdc42-binding kinases MRCKα and MRCKβ contribute to the regulation of actin-myosin cytoskeleton organization and dynamics, acting in concert with the Rho-associated coiled-coil kinases ROCK1 and ROCK2. The absence of highly potent and selective MRCK inhibitors has resulted in relatively little knowledge of the potential roles of these kinases in cancer. Here we report the discovery of the azaindole compounds BDP8900 and BDP9066 as potent and selective MRCK inhibitors that reduce substrate phosphorylation, leading to morphological changes in cancer cells along with inhibition of their motility and invasive character. In over 750 human cancer cell lines tested, BDP8900 and BDP9066 displayed consistent anti-proliferative effects with greatest activity in hematological cancer cells. Mass spectrometry identified MRCKα S1003 as an autophosphorylation site, enabling development of a phosphorylation-sensitive antibody tool to report on MRCKα status in tumor specimens. In a two-stage chemical carcinogenesis model of murine squamous cell carcinoma, topical treatments reduced MRCKα S1003 autophosphorylation and skin papilloma outgrowth. In parallel work, we validated a phospho-selective antibody with the capability to monitor drug pharmacodynamics. Taken together, our findings establish an important oncogenic role for MRCK in cancer, and they offer an initial preclinical proof of concept for MRCK inhibition as a valid therapeutic strategy

The UK needs a sustainable strategy for COVID-19

The UK is well into the second wave of COVID-19, with 60 051 lives lost to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection to date, according to provisional data from the&nbsp;Office for National Statistics. Official UK Government&nbsp;data&nbsp;show that cases have been rising exponentially since late August, 2020, with increases across all regions in England in recent weeks. &nbsp;As of Nov 4, 2020, the UK had 25 177 confirmed daily cases. These are almost certainly underestimates as between Oct 17 and Oct 23, 2020, England alone had 52 000 estimated daily cases. &nbsp;Estimates of the effective reproduction number in England vary between 1·1 and 1·6.</p

Tumour risks and genotype-phenotype correlations associated with germline variants in succinate dehydrogenase subunit genes SDHB, SDHC and SDHD.

BACKGROUND: Germline pathogenic variants in SDHB/SDHC/SDHD are the most frequent causes of inherited phaeochromocytomas/paragangliomas. Insufficient information regarding penetrance and phenotypic variability hinders optimum management of mutation carriers. We estimate penetrance for symptomatic tumours and elucidate genotype-phenotype correlations in a large cohort of SDHB/SDHC/SDHD mutation carriers. METHODS: A retrospective survey of 1832 individuals referred for genetic testing due to a personal or family history of phaeochromocytoma/paraganglioma. 876 patients (401 previously reported) had a germline mutation in SDHB/SDHC/SDHD (n=673/43/160). Tumour risks were correlated with in silico structural prediction analyses. RESULTS: Tumour risks analysis provided novel penetrance estimates and genotype-phenotype correlations. In addition to tumour type susceptibility differences for individual genes, we confirmed that the SDHD:p.Pro81Leu mutation has a distinct phenotype and identified increased age-related tumour risks with highly destabilising SDHB missense mutations. By Kaplan-Meier analysis, the penetrance (cumulative risk of clinically apparent tumours) in SDHB and (paternally inherited) SDHD mutation-positive non-probands (n=371/67 with detailed clinical information) by age 60 years was 21.8% (95% CI 15.2% to 27.9%) and 43.2% (95% CI 25.4% to 56.7%), respectively. Risk of malignant disease at age 60 years in non-proband SDHB mutation carriers was 4.2%(95% CI 1.1% to 7.2%). With retrospective cohort analysis to adjust for ascertainment, cumulative tumour risks for SDHB mutation carriers at ages 60 years and 80 years were 23.9% (95% CI 20.9% to 27.4%) and 30.6% (95% CI 26.8% to 34.7%). CONCLUSIONS: Overall risks of clinically apparent tumours for SDHB mutation carriers are substantially lower than initially estimated and will improve counselling of affected families. Specific genotype-tumour risk associations provides a basis for novel investigative strategies into succinate dehydrogenase-related mechanisms of tumourigenesis and the development of personalised management for SDHB/SDHC/SDHD mutation carriers

The determinants and consequences of adult nursing staff turnover: a systematic review of systematic reviews.

BACKGROUND: Nurses leaving their jobs and the profession are an issue of international concern, with supply-demand gaps for nurses reported to be widening. There is a large body of existing literature, much of which is already in review form. In order to advance the usefulness of the literature for nurse and human resource managers, we undertook an overview (review of systematic reviews). The aim of the overview was to identify high quality evidence of the determinants and consequences of turnover in adult nursing. METHODS: Reviews were identified which were published between 1990 and January 2015 in English using electronic databases (the Cochrane Database of Systematic Reviews, MEDLINE, EMBASE, Applied Social Sciences Index and Abstracts, CINAHL plus and SCOPUS) and forward searching. All stages of the review were conducted in parallel by two reviewers. Reviews were quality appraised using the Assessment of Multiple Systematic Reviews and their findings narratively synthesised. RESULTS: Nine reviews were included. We found that the current evidence is incomplete and has a number of important limitations. However, a body of moderate quality review evidence does exist giving a picture of multiple determinants of turnover in adult nursing, with - at the individual level - nurse stress and dissatisfaction being important factors and -at the organisational level - managerial style and supervisory support factors holding most weight. The consequences of turnover are only described in economic terms, but are considered significant. CONCLUSIONS: In making a quality assessment of the review as well as considering the quality of the included primary studies and specificity in the outcomes they measure, the overview found that the evidence is not as definitive as previously presented from individual reviews. Further research is required, of rigorous research design, whether quantitative or qualitative, particularly against the outcome of actual turnover as opposed to intention to leave. TRIAL REGISTRATION: PROSPERO Registration 17 March 2015: CRD42015017613