Variation in National Clinical Audit Data Capture:Is Using Routine Data the Answer?

National Clinical Audit (NCA) data are collected from all National Health Service providers in the UK, to measure the quality of care and stimulate quality improvement initatives. As part of a larger study we explored how NHS providers currently collect NCA data and the resources involved. Study results highlight a dependence on manual data entry and use of professional resources, which could be improved by exploring how routine clinical data could be captured more effectively

Multifactorial falls risk assessment and prevention in acute hospitals A practical guide for successful implementation

YesNIHR - Health and Social Care Delivery Research (HSDR) programme (project number NIHR129488

QualDash: Adaptable Generation of Visualisation Dashboards for Healthcare Quality Improvement

YesAdapting dashboard design to different contexts of use is an open question in visualisation research. Dashboard designers often seek to strike a balance between dashboard adaptability and ease-of-use, and in hospitals challenges arise from the vast diversity of key metrics, data models and users involved at different organizational levels. In this design study, we present QualDash, a dashboard generation engine that allows for the dynamic configuration and deployment of visualisation dashboards for healthcare quality improvement (QI). We present a rigorous task analysis based on interviews with healthcare professionals, a co-design workshop and a series of one-on-one meetings with front line analysts. From these activities we define a metric card metaphor as a unit of visual analysis in healthcare QI, using this concept as a building block for generating highly adaptable dashboards, and leading to the design of a Metric Specification Structure (MSS). Each MSS is a JSON structure which enables dashboard authors to concisely configure unit-specific variants of a metric card, while offloading common patterns that are shared across cards to be preset by the engine. We reflect on deploying and iterating the design of QualDash in cardiology wards and pediatric intensive care units of five NHS hospitals. Finally, we report evaluation results that demonstrate the adaptability, ease-of-use and usefulness of QualDash in a real-world scenario

A simulation study of diagnostics for bias in non-probability samples

A non-probability sampling mechanism is likely to bias estimates of parameters with respect to a target population of interest. This bias poses a unique challenge when selection is \u27non-ignorable\u27, i.e. dependent upon the unobserved outcome of interest, since it is then undetectable and thus cannot be ameliorated. We extend a simulation study by Nishimura et al. [International Statistical Review, 84, 43--62 (2016)], adding a recently published statistic, the so-called \u27standardized measure of unadjusted bias\u27, which explicitly quantifies the extent of bias under the assumption that a specified amount of non-ignorable selection exists. Our findings suggest that this new sensitivity diagnostic is considerably correlated with, and more predictive of, the true, unknown extent of selection bias than other diagnostics, even when the underlying assumed level of non-ignorability is incorrect

Indices of nonâ ignorable selection bias for proportions estimated from nonâ probability samples

Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/151805/1/rssc12371_am.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/151805/2/rssc12371.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/151805/3/rssc12371-sup-0001-SupInfo.pd

Exploring variation in the use of feedback from national clinical audits : a realist investigation

BACKGROUND: National Clinical Audits (NCAs) are a well-established quality improvement strategy used in healthcare settings. Significant resources, including clinicians' time, are invested in participating in NCAs, yet there is variation in the extent to which the resulting feedback stimulates quality improvement. The aim of this study was to explore the reasons behind this variation. METHODS: We used realist evaluation to interrogate how context shapes the mechanisms through which NCAs work (or not) to stimulate quality improvement. Fifty-four interviews were conducted with doctors, nurses, audit clerks and other staff working with NCAs across five healthcare providers in England. In line with realist principles we scrutinised the data to identify how and why providers responded to NCA feedback (mechanisms), the circumstances that supported or constrained provider responses (context), and what happened as a result of the interactions between mechanisms and context (outcomes). We summarised our findings as Context+Mechanism = Outcome configurations. RESULTS: We identified five mechanisms that explained provider interactions with NCA feedback: reputation, professionalism, competition, incentives, and professional development. Professionalism and incentives underpinned most frequent interaction with feedback, providing opportunities to stimulate quality improvement. Feedback was used routinely in these ways where it was generated from data stored in local databases before upload to NCA suppliers. Local databases enabled staff to access data easily, customise feedback and, importantly, the data were trusted as accurate, due to the skills and experience of staff supporting audit participation. Feedback produced by NCA suppliers, which included national comparator data, was used in a more limited capacity across providers. Challenges accessing supplier data in a timely way and concerns about the quality of data submitted across providers were reported to constrain use of this mode of feedback. CONCLUSION: The findings suggest that there are a number of mechanisms that underpin healthcare providers' interactions with NCA feedback. However, there is variation in the mode, frequency and impact of these interactions. Feedback was used most routinely, providing opportunities to stimulate quality improvement, within clinical services resourced to collect accurate data and to maintain local databases from which feedback could be customised for the needs of the service

Factors supporting and constraining the implementation of robot-assisted surgery: a realist interview study

YesTo capture stakeholders’ theories concerning how and in what contexts robot-assisted surgery becomes integrated into routine practice. A literature review provided tentative theories that were revised through a realist interview study. Literature-based theories were presented to the interviewees, who were asked to describe to what extent and in what ways those theories reflected their experience. Analysis focused on identifying mechanisms through which robot-assisted surgery becomes integrated into practice and contexts in which those mechanisms are triggered. Nine hospitals in England where robot-assisted surgery is used for colorectal operations. Forty-four theatre staff with experience of robot-assisted colorectal surgery, including surgeons, surgical trainees, theatre nurses, operating department practitioners and anaesthetists. Interviewees emphasised the importance of support from hospital management, team leaders and surgical colleagues. Training together as a team was seen as beneficial, increasing trust in each other’s knowledge and supporting team bonding, in turn leading to improved teamwork. When first introducing robot-assisted surgery, it is beneficial to have a handpicked dedicated robotic team who are able to quickly gain experience and confidence. A suitably sized operating theatre can reduce operation duration and the risk of de-sterilisation. Motivation among team members to persist with robot-assisted surgery can be achieved without involvement in the initial decision to purchase a robot, but training that enables team members to feel confident as they take on the new tasks is essential. We captured accounts of how robot-assisted surgery has been introduced into a range of hospitals. Using a realist approach, we were also able to capture perceptions of the factors that support and constrain the integration of robot-assisted surgery into routine practice. We have translated these into recommendations that can inform future implementations of robot-assisted surgery

Staff experiences of integrating community and secondary care musculoskeletal services: A qualitative investigation

YesIntegrated models of care intend to provide seamless and timely access to health and social care services. This study investigated the integration of musculoskeletal services across community and secondary care boundaries, including the introduction of a single point of access from which patients were triaged. Staff (n = 15) involved in service development and delivery were interviewed about how, why and to what extent integration impacted service delivery. The analysis focused on staff experiences of using an on-line patient self-referral form and co-located clinics to enhance decision-making in triage, and on the provision of educational materials and de-medicalising language in patient consultations to support self-management. Single point of access, including online self-referral, were operationalised during data collection, but co-located clinics were not. Triage staff explained that the volume of referrals and quality of information provided in online self-referrals sometimes constrained decision-making in triage. Secondary care staff discussed concerns that the single point of access might not consistently identify patients with hard to diagnose conditions that require timely surgical intervention. This concern appeared to constrain staff engagement with integration, potentially inhibiting the delivery of co-located clinics. However, triage staff accessed support to inform secondary care referral via alternate modes. Patient circumstances, for example, need for reassurance, necessitated multiple self-management strategies and innovative approaches were developed to provide patients ongoing and professionally led support. Findings emphasise that restructuring services requires engagement from diverse stakeholders. Collaborating with stakeholders to address their concerns about the impact of restructures on well-established pathways may help cultivate this engagement.Newcastle upon Tyne Hospitals NHS Foundation Trus