Artificial intelligence in digital pathology: a diagnostic test accuracy systematic review and meta-analysis

Ensuring diagnostic performance of AI models before clinical use is key to the safe and successful adoption of these technologies. Studies reporting AI applied to digital pathology images for diagnostic purposes have rapidly increased in number in recent years. The aim of this work is to provide an overview of the diagnostic accuracy of AI in digital pathology images from all areas of pathology. This systematic review and meta-analysis included diagnostic accuracy studies using any type of artificial intelligence applied to whole slide images (WSIs) in any disease type. The reference standard was diagnosis through histopathological assessment and / or immunohistochemistry. Searches were conducted in PubMed, EMBASE and CENTRAL in June 2022. We identified 2976 studies, of which 100 were included in the review and 48 in the full meta-analysis. Risk of bias and concerns of applicability were assessed using the QUADAS-2 tool. Data extraction was conducted by two investigators and meta-analysis was performed using a bivariate random effects model. 100 studies were identified for inclusion, equating to over 152,000 whole slide images (WSIs) and representing many disease types. Of these, 48 studies were included in the meta-analysis. These studies reported a mean sensitivity of 96.3% (CI 94.1-97.7) and mean specificity of 93.3% (CI 90.5-95.4) for AI. There was substantial heterogeneity in study design and all 100 studies identified for inclusion had at least one area at high or unclear risk of bias. This review provides a broad overview of AI performance across applications in whole slide imaging. However, there is huge variability in study design and available performance data, with details around the conduct of the study and make up of the datasets frequently missing. Overall, AI offers good accuracy when applied to WSIs but requires more rigorous evaluation of its performance

Artificial intelligence in digital pathology: a systematic review and meta-analysis of diagnostic test accuracy

Ensuring diagnostic performance of artificial intelligence (AI) before introduction into clinical practice is essential. Growing numbers of studies using AI for digital pathology have been reported over recent years. The aim of this work is to examine the diagnostic accuracy of AI in digital pathology images for any disease. This systematic review and meta-analysis included diagnostic accuracy studies using any type of AI applied to whole slide images (WSIs) for any disease. The reference standard was diagnosis by histopathological assessment and/or immunohistochemistry. Searches were conducted in PubMed, EMBASE and CENTRAL in June 2022. Risk of bias and concerns of applicability were assessed using the QUADAS-2 tool. Data extraction was conducted by two investigators and meta-analysis was performed using a bivariate random effects model, with additional subgroup analyses also performed. Of 2976 identified studies, 100 were included in the review and 48 in the meta-analysis. Studies were from a range of countries, including over 152,000 whole slide images (WSIs), representing many diseases. These studies reported a mean sensitivity of 96.3% (CI 94.1–97.7) and mean specificity of 93.3% (CI 90.5–95.4). There was heterogeneity in study design and 99% of studies identified for inclusion had at least one area at high or unclear risk of bias or applicability concerns. Details on selection of cases, division of model development and validation data and raw performance data were frequently ambiguous or missing. AI is reported as having high diagnostic accuracy in the reported areas but requires more rigorous evaluation of its performance

Conservative management versus tonsillectomy in adults with recurrent acute tonsillitis in the UK (NATTINA): a multicentre, open-label, randomised controlled trial

Background: Tonsillectomy is regularly performed in adults with acute tonsillitis, but with scarce evidence. A reduction in tonsillectomies has coincided with an increase in acute adult hospitalisation for tonsillitis complications. We aimed to assess the clinical effectiveness and cost-effectiveness of conservative management versus tonsillectomy in patients with recurrent acute tonsillitis. Methods: This pragmatic multicentre, open-label, randomised controlled trial was conducted in 27 hospitals in the UK. Participants were adults aged 16 years or older who were newly referred to secondary care otolaryngology clinics with recurrent acute tonsillitis. Patients were randomly assigned (1:1) to receive tonsillectomy or conservative management using random permuted blocks of variable length. Stratification by recruiting centre and baseline symptom severity was assessed using the Tonsil Outcome Inventory-14 score (categories defined as mild 0–35, moderate 36–48, or severe 49–70). Participants in the tonsillectomy group received elective surgery to dissect the palatine tonsils within 8 weeks after random assignment and those in the conservative management group received standard non-surgical care during 24 months. The primary outcome was the number of sore throat days collected during 24 months after random assignment, reported once per week with a text message. The primary analysis was done in the intention-to-treat (ITT) population. This study is registered with the ISRCTN registry, 55284102. Findings: Between May 11, 2015, and April 30, 2018, 4165 participants with recurrent acute tonsillitis were assessed for eligibility and 3712 were excluded. 453 eligible participants were randomly assigned (233 in the immediate tonsillectomy group vs 220 in the conservative management group). 429 (95%) patients were included in the primary ITT analysis (224 vs 205). The median age of participants was 23 years (IQR 19–30), with 355 (78%) females and 97 (21%) males. Most participants were White (407 [90%]). Participants in the immediate tonsillectomy group had fewer days of sore throat during 24 months than those in the conservative management group (median 23 days [IQR 11–46] vs 30 days [14–65]). After adjustment for site and baseline severity, the incident rate ratio of total sore throat days in the immediate tonsillectomy group (n=224) compared with the conservative management group (n=205) was 0·53 (95% CI 0·43 to 0·65; <0·0001). 191 adverse events in 90 (39%) of 231 participants were deemed related to tonsillectomy. The most common adverse event was bleeding (54 events in 44 [19%] participants). No deaths occurred during the study. Interpretation: Compared with conservative management, immediate tonsillectomy is clinically effective and cost-effective in adults with recurrent acute tonsillitis. Funding: National Institute for Health Research

Clinical effectiveness of septoplasty versus medical management for nasal airways obstruction: multicentre, open label, randomised controlled trial

OBJECTIVE: To assess the clinical effectiveness of septoplasty. DESIGN: Multicentre, randomised controlled trial. SETTING: 17 otolaryngology clinics in the UK's National Health Service. PARTICIPANTS: 378 adults (≥18 years, 67% men) newly referred with symptoms of nasal obstruction associated with septal deviation and at least moderate symptoms of nasal obstruction (score >30 on the Nasal Obstruction and Symptom Evaluation (NOSE) scale). INTERVENTIONS: Participants were randomised 1:1 to receive either septoplasty (n=188) or defined medical management (n=190, nasal steroid and saline spray for six months), stratified by baseline symptom severity and sex. MAIN OUTCOME MEASURES: The primary outcome measure was patient reported score on the Sino-Nasal Outcome Test-22 (SNOT-22) at six months, with 9 points defined as the minimal clinically important difference. Secondary outcomes included quality of life and objective nasal airflow measures. RESULTS: Mean SNOT-22 scores at six months were 19.9 (95% confidence interval 17.0 to 22.7) in the septoplasty arm (n=152, intention-to-treat population) and 39.5 (36.1 to 42.9) in the medical management arm (n=155); an estimated 20.0 points lower (better) for participants randomised to receive septoplasty (95% confidence interval 16.4 to 23.6, P<0.001, adjusted for baseline continuous SNOT-22 score and the stratification variables sex and baseline NOSE severity categories). Greater improvement in SNOT-22 scores was predicted by higher baseline symptom severity scores. Quality of life outcomes and nasal airflow measures (including peak nasal inspiratory flow and absolute inhalational nasal partitioning ratio) improved more in participants in the septoplasty group. Readmission to hospital with bleeding after septoplasty occurred in seven participants (4% of 174 who had septoplasty), and a further 20 participants (12%) required antibiotics for infections. CONCLUSIONS: Septoplasty is a more effective intervention than a defined medical management regimen with a nasal steroid and saline spray in adults with nasal obstruction associated with a deviated nasal septum. TRIAL REGISTRATION: ISRCTN Registry ISRCTN16168569

Preoperative mitomycin, ifosfamide, and cisplatin followed by esophagectomy in squamous cell carcinoma of the esophagus: pathologic complete response induced by chemotherapy leads to long-term survival.

PURPOSE: Squamous cell carcinoma of the esophagus remains an aggressive disease with a poor prognosis, even after curative-intent surgery. This article analyzes the impact of preoperative chemotherapy with mitomycin, ifosfamide, and cisplatin (MIC) on a cohort of 68 patients. PATIENTS AND METHODS: From 1988 to 1994, 68 patients with potentially operable squamous cell carcinoma of the esophagus were entered onto two phase II trials of neoadjuvant chemotherapy with mitomycin 6 mg/m2, ifosfamide 3 g/m2, and cisplatin 50 mg/m2 and received between two and four cycles of treatment at 3-weekly intervals. Two patients were removed from the analysis when they were found to have malignancy other than squamous cell carcinoma of the esophagus. RESULTS: Forty (61%) of 66 patients had a radiologic response to chemotherapy (18 complete responses and 22 partial responses), and 52 (79%) of 66 patients went on to have the primary tumor resected. There were nine pathologic complete responders, seven of whom remain fit and well after at least 60 months of follow-up. The overall median survival was 12.4 months (95% confidence interval, 9.6 to 18.8 months). The complete response and node-negative patients survived significantly longer than those in other categories (log-rank chi2 = 18.8; P <.001): on average 13 months longer than the node-positive or nonresected category (22.0 v 9.4 months). The toxicity of the regimen was low. CONCLUSION: MIC is an easily administered, well-tolerated, and efficacious regimen as neoadjuvant therapy for patients with squamous cell carcinoma of the esophagus. These results warrant further investigation

Good Statistical Practice—development of tailored Good Clinical Practice training for statisticians

Background Statisticians are fundamental in ensuring clinical research, including clinical trials, are conducted with quality, transparency, reproducibility and integrity. Good Clinical Practice (GCP) is an international quality standard for the conduct of clinical trials research. Statisticians are required to undertake training on GCP but existing training is generic and, crucially, does not cover statistical activities. This results in statisticians undertaking training mostly unrelated to their role and variation in awareness and implementation of relevant regulatory requirements with regards to statistical conduct. The need for role-relevant training is recognised by the UK NHS Health Research Authority and the Medicines and Healthcare products Regulatory Agency (MHRA). Methods The Good Statistical Practice (GCP for Statisticians) project was instigated by the UK Clinical Research Collaboration (UKCRC) Registered Clinical Trials Unit (CTU) Statisticians Operational Group and funded by the National Institute for Health and Care Research (NIHR), to develop materials to enable role-specific GCP training tailored to statisticians. Review of current GCP training was undertaken by survey. Development of training materials were based on MHRA GCP. Critical review and piloting was conducted with UKCRC CTU and NIHR researchers with comment from MHRA. Final review was conducted through the UKCRC CTU Statistics group. Results The survey confirmed the need and desire for the development of dedicated GCP training for statisticians. An accessible, comprehensive, piloted training package was developed tailored to statisticians working in clinical research, particularly the clinical trials arena. The training materials cover legislation and guidance for best practice across all clinical trial processes with statistical involvement, including exercises and real-life scenarios to bridge the gap between theory and practice. Comprehensive feedback was incorporated. The training materials are freely available for national and international adoption. Conclusion All research staff should have training in GCP yet the training undertaken by most academic statisticians does not cover activities related to their role. The Good Statistical Practice (GCP for Statisticians) project has developed and extensively piloted new, role-specific, comprehensive, accessible GCP training tailored to statisticians working in clinical research, particularly the clinical trials arena. This role-specific training will encourage best practice, leading to transparent and reproducible statistical activity, as required by regulatory authorities and funders

Multicenter randomized trial of intermittently scanned continuous glucose monitoring versus self-monitoring of blood glucose in individuals with type 2 diabetes and recent-onset acute myocardial infarction: results of the LIBERATES trial

OBJECTIVE To analyze the impact of modern glucose-monitoring strategies on glycemic and patient-related outcomes in individuals with type 2 diabetes (T2D) and recent myocardial infarction (MI) and assess cost effectiveness. RESEARCH DESIGN AND METHODS LIBERATES was a multicenter two-arm randomized trial comparing self-monitoring of blood glucose (SMBG) with intermittently scanned continuous glucose monitoring (isCGM), also known as flash CGM, in individuals with T2D and recent MI, treated with insulin and/or a sulphonylurea before hospital admission. The primary outcome measure was time in range (TIR) (glucose 3.9–10 mmol/L/day) on days 76–90 post randomization. Secondary and exploratory outcomes included time in hypoglycemia, hemoglobin A1c (HbA1c), clinical outcome, quality of life (QOL), and cost effectiveness. RESULTS Of 141 participants randomly assigned (median age 63 years; interquartile range 53, 70), 73% of whom were men, isCGM was associated with increased TIR by 17 min/day (95% credible interval −105 to +153 min/day), with 59% probability of benefit. Users of isCGM showed lower hypoglycemic exposure (<3.9 mmol/L) at days 76–90 (−80 min/day; 95% CI −118, −43), also evident at days 16–30 (−28 min/day; 95% CI −92, 2). Compared with baseline, HbA1c showed similar reductions of 7 mmol/mol at 3 months in both study arms. Combined glycemic emergencies and mortality occurred in four isCGM and seven SMBG study participants. QOL measures marginally favored isCGM, and the intervention proved to be cost effective. CONCLUSIONS Compared with SMBG, isCGM in T2D individuals with MI marginally increases TIR and significantly reduces hypoglycemic exposure while equally improving HbA1c, explaining its cost effectiveness. Studies are required to understand whether these glycemic differences translate into longer-term clinical benefit

A randomised controlled trial of losartan as an anti-fibrotic agent in non-alcoholic steatohepatitis

Introduction: Non-alcoholic fatty liver disease (NAFLD) is a common liver disease worldwide. Experimental and small clinical trials have demonstrated that angiotensin II blockers (ARB) may be anti-fibrotic in the liver. The aim of this randomised controlled trial was to assess whether treatment with Losartan for 96 weeks slowed, halted or reversed the progression of fibrosis in patients with non-alcoholic steatohepatitis (NASH). Methods: Double-blind randomised-controlled trial of Losartan 50 mg once a day versus placebo for 96 weeks in patients with histological evidence of NASH. The primary outcome for the study was change in histological fibrosis stage from pre-treatment to end-of-treatment. Results: The study planned to recruit 214 patients. However, recruitment was slower than expected, and after 45 patients were randomised (median age 55; 56% male; 60% diabetic; median fibrosis stage 2), enrolment was suspended. Thirty-two patients (15 losartan and 17 placebo) completed follow up period: one patient (6.7%) treated with losartan and 4 patients (23.5%) in the placebo group were &quot;responders&quot; (lower fibrosis stage at follow up compared with baseline). The major reason for slow recruitment was that 39% of potentially eligible patients were already taking an ARB or angiotensin converting enzyme inhibitor (ACEI), and 15% were taking other prohibited medications. Conclusions: Due to the widespread use of ACEI and ARB in patients with NASH this trial failed to recruit sufficient patients to determine whether losartan has anti-fibrotic effects in the liver. Trial registration: ISRCTN 57849521 © 2017 McPherson et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited