Quality assessment standards in artificial intelligence diagnostic accuracy systematic reviews: a meta-research study

Artificial intelligence (AI) centred diagnostic systems are increasingly recognized as robust solutions in healthcare delivery pathways. In turn, there has been a concurrent rise in secondary research studies regarding these technologies in order to influence key clinical and policymaking decisions. It is therefore essential that these studies accurately appraise methodological quality and risk of bias within shortlisted trials and reports. In order to assess whether this critical step is performed, we undertook a meta-research study evaluating adherence to the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool within AI diagnostic accuracy systematic reviews. A literature search was conducted on all studies published from 2000 to December 2020. Of 50 included reviews, 36 performed quality assessment, of which 27 utilised the QUADAS-2 tool. Bias was reported across all four domains of QUADAS-2. 243 of 423 studies (57.5%) across all systematic reviews utilising QUADAS-2 reported a high or unclear risk of bias in the patient selection domain, 110 (26%) reported a high or unclear risk of bias in the index test domain, 121 (28.6%) in the reference standard domain and 157 (37.1%) in the flow and timing domain. This study demonstrates incomplete uptake of quality assessment tools in reviews of AI-based diagnostic accuracy studies and highlights inconsistent reporting across all domains of quality assessment. Poor standards of reporting act as barriers to clinical implementation. The creation of an AI specific extension for quality assessment tools of diagnostic accuracy AI studies may facilitate the safe translation of AI tools into clinical practice

A systematic review of interventions to improve breast cancer screening health behaviours

Whilst breast cancer screening has been implemented in many countries, uptake is often suboptimal. Consequently, several interventions targeting non-attendance behaviour have been developed. This systematic review aims to appraise the successes of interventions, identifying and comparing the specific techniques they use to modify health behaviours. A literature search (PROSPERO CRD42020212090) between January 2005 and December 2020 using PubMed, Medline, PsycInfo, EMBASE and Google Scholar was conducted. Studies which investigated patient-facing interventions to increase attendance at breast cancer screening appointments were included. Details regarding the intervention delivery, theoretical background, and contents were extracted, as was quantitative data on the impact on attendance rates, compared to control measures. Interventions were also coded using the Behavioural Change Techniques (BCT) Taxonomy. In total fifty-four studies, detailing eighty interventions, met the inclusion criteria. Only 50% of interventions reported a significant impact on screening attendance. Thirty-two different BCTs were used, with 'prompts/cues' the most commonly incorporated (77.5%), however techniques from the group 'covert learning' had the greatest pooled effect size 0.12 (95% CI 0.05-0.19, P < 0·01, I2 = 91.5%). 'Problem solving' was used in the highest proportion of interventions that significantly increased screening attendance (69.0%). 70% of the interventions were developed using behavioural theories. These results show interventions aimed at increasing screening uptake are often unsuccessful. Commonly used approaches which focus upon explaining the consequences of not attending mammograms were often ineffective. Problem solving, however, has shown promise. These techniques should be investigated further, as should emerging technologies which can enable interventions to be feasibly translated at a population-level

Simulated wound assessment using digital planimetry versus three-dimensional cameras: implications for clinical assessment.

BACKGROUND: Clinical management of wounds can benefit from objective measures of response to treatment. Wound surface area and volume are objective measures of wound healing. Using a synthetic wound model, we compare the accuracy and reproducibility of 2 commercially available 3-dimensional (3D) cameras against planimetry and water displacement. METHODS: Twelve ulcers of various sizes and colors were reproduced in modeling clay and cured. Five naive observers used digital planimetry, water displacement, Eykona camera (Fuel 3D, UK), and Silhouette camera (ARANZ, New Zealand) to measure the wounds. RESULTS: When compared with traditional planimetry, wound surface area measurement with Eykona and Silhouette tended to underestimate wounds by 1.7% and 3.7%, respectively. Spearman correlation coefficients were 0.94 (Eykona) and 0.92 (Silhouette). Intraclass correlations for planimetry and the 2 cameras were all 1. Eykona and Silhouette tended to underestimate wound volumes when compared with water displacement by 58% and 23%, respectively. Spearman correlation coefficients were 0.92 (Eykona) and 0.72 (Silhouette). Intraclass correlations for water displacement and the two cameras were all 1. DISCUSSION: Serial accurate objective area measurements are feasible as part of ongoing clinical assessment of wounds. 3D cameras are reliable but have not shown superior accuracy to manual planimetry, and financial concerns and IT integration may limit general clinical usage. Volume measurements of wounds are practicable as part of clinical care

Investigating the implementation of SMS and mobile messaging In Population Screening (The SIPS Study): Protocol for a Delphi Study

Background The use of mobile messaging including Short Message Service (SMS) and Web-based messaging in healthcare has grown significantly. Using messaging to facilitate patient communication has been advocated in several circumstances including population screening. These programmes, however, pose unique challenges to mobile communication, as messaging is often sent from a central hub to a diverse population with differing needs. Despite this, there is a paucity of robust frameworks to guide implementation. Objective This protocol describes the methods that will be used to develop a guide for the principles of use of mobile messaging for population screening programmes in England. Methods This modified Delphi study will be conducted in two parts: evidence synthesis and consensus generation. The former will incorporate a literature review of publications from 1st January 2000 to the present. This will elicit key themes to inform an online scoping questionnaire posed to a group of experts from academia, clinical medicine, industry and public health. Thematic analysis of free-text responses by two independent authors will elicit items to be used in the consensus generation. Patient and Public Involvement groups will be convened to ensure that a comprehensive item list is generated, which represents the public’s perspective. Each item will then be anonymously voted upon by experts as to its importance and feasibility of implementation in screening, during three rounds of a Delphi process. Consensus will be defined a priori at 70%, with items considered important and feasible eligible for inclusion into the final recommendation. A list of desirable items (important, but not currently feasible) will be developed to guide future work. Results The Institutional Review Board at Imperial College London has granted ethical approval (20IC6088). Results are expected to involve a list of recommendations to screening services with findings made available to screening services through Public Health England. This study will thus provide a formal guideline for the use of mobile messaging in screening services and provide future directions in this field. Discussion The use of mobile messaging has grown significantly across healthcare services, especially given the COVID-19 pandemic, but its implementation in screening programmes remains challenging. this modified Delphi approach with leading experts, will provide invaluable insights to facilitate incorporating messaging in these programmes, and create awareness of future developments in this area

A national survey assessing public readiness for digital health strategies against COVID-19 within the United Kingdom

There is concern that digital public health initiatives used in the management of COVID-19 may marginalise certain population groups. There is an overlap between the demographics of groups at risk of digital exclusion (older, lower social grade, low educational attainment and ethnic minorities) and those who are vulnerable to poorer health outcomes from SARS-CoV-2. In this national survey study (n=2040), we assessed how the UK population; particularly these overlapping groups, reported their preparedness for digital health strategies. We report, with respect to using digital information to make health decisions, that those over 60 are less comfortable (net comfort: 57%) than those between 18-39 (net comfort: 78%) and lower social grades are less comfortable (net comfort: 63%) than higher social grades (net comfort: 75%). With respect to a preference for digital over non-digital sources in seeking COVID-19 health information, those over 60 (net preference: 21%) are less inclined than those between 18-39 (net preference: 60%) and those of low educational attainment (net preference: 30%) are less inclined than those of high educational attainment (net preference: 52%). Lastly, with respect to distinguishing reliable digital COVID-19 information, lower social grades (net confidence: 55%) are less confident than higher social grades (net confidence: 68%) and those of low educational attainment (net confidence: 51%) are less confident than those of high educational attainment (net confidence: 71%). All reported differences are statistically significant (p<0.01) following multivariate regression modelling. This study suggests that digital public health approaches to COVID-19 have the potential to marginalise groups who are concurrently at risk of digital exclusion and poor health outcomes from SARS-CoV-2

Avoidable 30‐day readmissions in patients undergoing vascular surgery

Background: Vascular surgery has one of the highest unplanned 30-day readmission rates of all surgical specialities. The degree to which these may be avoidable and the optimal strategies to reduce their occurrence is unknown. The aim of this study was to identify and classify avoidable 30-day readmissions in patients undergoing vascular surgery in order to plan targeted interventions to reduce their occurrence, improve outcomes and reduce cost. Methods: A retrospective analysis of discharges over a 12-month period from a single tertiary vascular unit was performed. A multidisciplinary panel conducted a manual case note review to identify and classify those 30-day unplanned emergency readmissions deemed avoidable. Results: An unplanned 30-day readmission occurred in 72/885 (8.1%) admissions. These unplanned readmissions were deemed avoidable in 50.0% (36/72) and were most frequently due to unresolved medical issues (19/36, 52.8%) and inappropriate admission with the potential for outpatient management (7/36, 19.4%). A smaller number were due to inadequate social care provision (4/36, 11.1%) and the occurrence of other avoidable adverse events (4/36, 11.1%). Conclusion: Half of all 30-day readmissions in vascular patients are potentially avoidable. Multidisciplinary coordination of inpatient care and the transition from hospital to community care following discharge need to be improved

Are disruptive innovations recognised in the healthcare literature? A systematic review

The study aims to conduct a systematic review to characterise the spread and use of the concept of ‘disruptive innovation’ within the healthcare sector. We aim to categorise references to the concept over time, across geographical regions and across prespecified healthcare domains. From this, we further aim to critique and challenge the sector-specific use of the concept. PubMed, Medline, Embase, Global Health, PsycINFO, Maternity and Infant Care, and Health Management Information Consortium were searched from inception to August 2019 for references pertaining to disruptive innovations within the healthcare industry. The heterogeneity of the articles precluded a meta-analysis, and neither quality scoring of articles nor risk of bias analyses were required. 245 articles that detailed perceived disruptive innovations within the health sector were identified. The disruptive innovations were categorised into seven domains: basic science (19.2%), device (12.2%), diagnostics (4.9%), digital health (21.6%), education (5.3%), processes (17.6%) and technique (19.2%). The term has been used with increasing frequency annually and is predominantly cited in North American (78.4%) and European (15.2%) articles. The five most cited disruptive innovations in healthcare are ‘omics’ technologies, mobile health applications, telemedicine, health informatics and retail clinics. The concept ‘disruptive innovation’ has diffused into the healthcare industry. However, its use remains inconsistent and the recognition of disruption is obscured by other types of innovation. The current definition does not accommodate for prospective scouting of disruptive innovations, a likely hindrance to policy makers. Redefining disruptive innovation within the healthcare sector is therefore crucial for prospectively identifying cost-effective innovations

Harnessing a clinician-led governance model to overcome healthcare tribalism and drive innovation: a case study of Northumbria NHS Foundation Trust

Purpose Healthcare tribalism refers to the phenomenon through which different groups in a healthcare setting strictly adhere to their profession-based silo, within which they exhibit stereotypical behaviours. In turn, this can lead to deleterious downstream effects upon productivity and care delivered to patients. This study highlights a clinician-led governance model, implemented at a National Health Service (NHS) trust, to investigate whether it successfully overcame tribalism and helped drive innovation. Design/methodology/approach This was a convergent mixed-methods study including qualitative and quantitative data collected in parallel. Qualitative data included 27 semi-structured interviews with representatives from four professional groups. Quantitative data were collected through a verbally administered survey and scored on a 10-point scale. Findings The trust arranged its services under five autonomous business units, with a clinician and a manager sharing the leadership role at each unit. According to interviewees replies, this equivalent authority was cascaded down and enabled breaking down professional siloes, which in turn aided in the adoption of an innovative clinical model restructure. Practical implications This study contributes to the literature by characterizing a real-world example in which healthcare tribalism was mitigated while reflecting on the advantages yielded as a result. Originality/value Previous studies from all over the world identified major differences in the perspectives of different healthcare professional groups. In the United Kingdom, clinicians largely felt cut off from decision-making and dissatisfied with their managerial role. The study findings explain a governance model that allowed harmony and inclusion of different professions. Given the long-standing strains on healthcare systems worldwide, stakeholders can leverage the study findings for guidance in developing and implementing innovative managerial approaches

Impact of the COVID-19 pandemic on emergency adult surgical patients and surgical services: an international multi-center cohort study and department survey.

OBJECTIVES: The PREDICT study aimed to determine how the COVID-19 pandemic affected surgical services and surgical patients and to identify predictors of outcomes in this cohort. BACKGROUND: High mortality rates were reported for surgical patients with COVID-19 in the early stages of the pandemic. However, the indirect impact of the pandemic on this cohort is not understood, and risk predictors are yet to be identified. METHODS: PREDICT is an international longitudinal cohort study comprising surgical patients presenting to hospital between March and August 2020, conducted alongside a survey of staff redeployment and departmental restructuring. A subgroup analysis of 3176 adult emergency patients, recruited by 55 teams across 18 countries is presented. RESULTS: Among adult emergency surgical patients, all-cause in-hospital mortality (IHM) was 3 6%, compared to 15 5% for those with COVID-19. However, only 14 1% received a COVID-19 test on admission in March, increasing to 76 5% by July.Higher Clinical Frailty Scale scores (CFS >7 aOR 18 87), ASA grade above 2 (aOR 4 29), and COVID-19 infection (aOR 5 12) were independently associated with significantly increased IHM.The peak months of the first wave were independently associated with significantly higher IHM (March aOR 4 34; April aOR 4 25; May aOR 3 97), compared to non-peak months.During the study, UK operating theatre capacity decreased by a mean of 63 6% with a concomitant 27 3% reduction in surgical staffing. CONCLUSION: The first wave of the COVID-19 pandemic significantly impacted surgical patients, both directly through co-morbid infection and indirectly as shown by increasing mortality in peak months, irrespective of COVID-19 status.Higher CFS scores and ASA grades strongly predict outcomes in surgical patients and are an important risk assessment tool during the pandemic

Arterial spectral waveform analysis in the prediction of diabetic foot ulcer healing

Objective: We assessed the association between (1) severity of vessel wall calcification, (2) number of patent vessels at the ankle and (3) arterial spectral waveform features, as assessed on a focused ankle Duplex ultrasound (DUS), and healing at 12-months in a cohort of patients who had their diabetic foot ulcers conservatively managed. Research design and methods: Scans performed on 50 limbs in 48 patients were included for analysis. Patient health records were prospectively reviewed for 12-months to assess for the outcome of ulcer healing. Results: We identified that the number of waveform components, peak systolic velocity, systolic rise time and long forward flow as well as the number of vessels patent at the ankle on DUS, may be useful independent predictors of healing, as noted by the trend towards statistical significance. Conclusion: Arterial spectral waveform features may be useful in predicting the chance of diabetic foot ulcer healing