CONFIDENT-trial protocol: a pragmatic template for clinical implementation of artificial intelligence assistance in pathology

Introduction Artificial intelligence (AI) has been on the rise in the field of pathology. Despite promising results in retrospective studies, and several CE-IVD certified algorithms on the market, prospective clinical implementation studies of AI have yet to be performed, to the best of our knowledge. In this trial, we will explore the benefits of an AI-assisted pathology workflow, while maintaining diagnostic safety standards.Methods and analysis This is a Standard Protocol Items: Recommendations for Interventional Trials–Artificial Intelligence compliant single-centre, controlled clinical trial, in a fully digital academic pathology laboratory. We will prospectively include prostate cancer patients who undergo prostate needle biopsies (CONFIDENT-P) and breast cancer patients who undergo a sentinel node procedure (CONFIDENT-B) in the University Medical Centre Utrecht. For both the CONFIDENT-B and CONFIDENT-P trials, the specific pathology specimens will be pseudo-randomised to be assessed by a pathologist with or without AI assistance in a pragmatic (bi-)weekly sequential design. In the intervention group, pathologists will assess whole slide images (WSI) of the standard hematoxylin and eosin (H&E)-stained sections assisted by the output of the algorithm. In the control group, pathologists will assess H&E WSI according to the current clinical workflow. If no tumour cells are identified or when the pathologist is in doubt, immunohistochemistry (IHC) staining will be performed. At least 80 patients in the CONFIDENT-P and 180 patients in the CONFIDENT-B trial will need to be enrolled to detect superiority, allocated as 1:1. Primary endpoint for both trials is the number of saved resources of IHC staining procedures for detecting tumour cells, since this will clarify tangible cost savings that will support the business case for AI.Ethics and dissemination The ethics committee (MREC NedMec) waived the need of official ethical approval, since participants are not subjected to procedures nor are they required to follow rules. Results of both trials (CONFIDENT-B and CONFIDENT-P) will be published in scientific peer-reviewed journals

Validation of a whole-slide image-based teleconsultation network

Contains fulltext : 197199.pdf (Publisher’s version ) (Closed access

High resolution systematic digital histological quantification of cardiac fibrosis and adipose tissue in phospholamban mutation associated cardiomyopathy

Myocardial fibrosis can lead to heart failure and act as a substrate for cardiac arrhythmias. In dilated cardiomyopathy diffuse interstitial reactive fibrosis can be observed, whereas arrhythmogenic cardiomyopathy is characterized by fibrofatty replacement in predominantly the right ventricle. The p.Arg14del mutation in the phospholamban (PLN) gene has been associated with dilated cardiomyopathy and recently also with arrhythmogenic cardiomyopathy. Aim of the present study is to determine the exact pattern of fibrosis and fatty replacement in PLN p.Arg14del mutation positive patients, with a novel method for high resolution systematic digital histological quantification of fibrosis and fatty tissue in cardiac tissue. Transversal mid-ventricular slices (n = 8) from whole hearts were collected from patients with the PLN p.Arg14del mutation (age 48±16 years; 4 (50%) male). An in-house developed open source MATLAB script was used for digital analysis of Masson's trichrome stained slides (http://sourceforge.net/projects/fibroquant/). Slides were divided into trabecular, inner and outer compact myocardium. Per region the percentage of connective tissue, cardiomyocytes and fatty tissue was quantified. In PLN p.Arg14del mutation associated cardiomyopathy, myocardial fibrosis is predominantly present in the left posterolateral wall and to a lesser extent in the right ventricular wall, whereas fatty changes are more pronounced in the right ventricular wall. No difference in distribution pattern of fibrosis and adipocytes was observed between patients with a clinical predominantly dilated and arrhythmogenic cardiomyopathy phenotype. In the future, this novel method for quantifying fibrosis and fatty tissue can be used to assess cardiac fibrosis and fatty tissue in animal models and a broad range of human cardiomyopathies

Implementation of Artificial Intelligence in Diagnostic Practice as a Next Step after Going Digital: The UMC Utrecht Perspective

Building on a growing number of pathology labs having a full digital infrastructure for pathology diagnostics, there is a growing interest in implementing artificial intelligence (AI) algorithms for diagnostic purposes. This article provides an overview of the current status of the digital pathology infrastructure at the University Medical Center Utrecht and our roadmap for implementing AI algorithms in the next few years

1399 H&E-stained sentinel lymph node sections of breast cancer patients: the CAMELYON dataset

Contains fulltext : 193420.pdf (publisher's version ) (Open Access)Background: The presence of lymph node metastases is one of the most important factors in breast cancer prognosis. The most common way to assess regional lymph node status is the sentinel lymph node procedure. The sentinel lymph node is the most likely lymph node to contain metastasized cancer cells and is excised, histopathologically processed, and examined by a pathologist. This tedious examination process is time-consuming and can lead to small metastases being missed. However, recent advances in whole-slide imaging and machine learning have opened an avenue for analysis of digitized lymph node sections with computer algorithms. For example, convolutional neural networks, a type of machine-learning algorithm, can be used to automatically detect cancer metastases in lymph nodes with high accuracy. To train machine-learning models, large, well-curated datasets are needed. Results: We released a dataset of 1,399 annotated whole-slide images (WSIs) of lymph nodes, both with and without metastases, in 3 terabytes of data in the context of the CAMELYON16 and CAMELYON17 Grand Challenges. Slides were collected from five medical centers to cover a broad range of image appearance and staining variations. Each WSI has a slide-level label indicating whether it contains no metastases, macro-metastases, micro-metastases, or isolated tumor cells. Furthermore, for 209 WSIs, detailed hand-drawn contours for all metastases are provided. Last, open-source software tools to visualize and interact with the data have been made available. Conclusions: A unique dataset of annotated, whole-slide digital histopathology images has been provided with high potential for re-use

Mitosis domain generalization in histopathology images — The MIDOG challenge

The density of mitotic figures (MF) within tumor tissue is known to be highly correlated with tumor proliferation and thus is an important marker in tumor grading. Recognition of MF by pathologists is subject to a strong inter-rater bias, limiting its prognostic value. State-of-the-art deep learning methods can support experts but have been observed to strongly deteriorate when applied in a different clinical environment. The variability caused by using different whole slide scanners has been identified as one decisive component in the underlying domain shift. The goal of the MICCAI MIDOG 2021 challenge was the creation of scanner-agnostic MF detection algorithms. The challenge used a training set of 200 cases, split across four scanning systems. As test set, an additional 100 cases split across four scanning systems, including two previously unseen scanners, were provided. In this paper, we evaluate and compare the approaches that were submitted to the challenge and identify methodological factors contributing to better performance. The winning algorithm yielded an score of 0.748 (CI95: 0.704-0.781), exceeding the performance of six experts on the same task

Mitosis domain generalization in histopathology images - The MIDOG challenge

The density of mitotic figures (MF) within tumor tissue is known to be highly correlated with tumor proliferation and thus is an important marker in tumor grading. Recognition of MF by pathologists is subject to a strong inter-rater bias, limiting its prognostic value. State-of-the-art deep learning methods can support experts but have been observed to strongly deteriorate when applied in a different clinical environment. The variability caused by using different whole slide scanners has been identified as one decisive component in the underlying domain shift. The goal of the MICCAI MIDOG 2021 challenge was the creation of scanner-agnostic MF detection algorithms. The challenge used a training set of 200 cases, split across four scanning systems. As test set, an additional 100 cases split across four scanning systems, including two previously unseen scanners, were provided. In this paper, we evaluate and compare the approaches that were submitted to the challenge and identify methodological factors contributing to better performance. The winning algorithm yielded an F(1) score of 0.748 (CI95: 0.704-0.781), exceeding the performance of six experts on the same task