Direct prediction of genetic aberrations from pathology images in gastric cancer with swarm learning.

BACKGROUND Computational pathology uses deep learning (DL) to extract biomarkers from routine pathology slides. Large multicentric datasets improve performance, but such datasets are scarce for gastric cancer. This limitation could be overcome by Swarm Learning (SL). METHODS Here, we report the results of a multicentric retrospective study of SL for prediction of molecular biomarkers in gastric cancer. We collected tissue samples with known microsatellite instability (MSI) and Epstein-Barr Virus (EBV) status from four patient cohorts from Switzerland, Germany, the UK and the USA, storing each dataset on a physically separate computer. RESULTS On an external validation cohort, the SL-based classifier reached an area under the receiver operating curve (AUROC) of 0.8092 (± 0.0132) for MSI prediction and 0.8372 (± 0.0179) for EBV prediction. The centralized model, which was trained on all datasets on a single computer, reached a similar performance. CONCLUSIONS Our findings demonstrate the feasibility of SL-based molecular biomarkers in gastric cancer. In the future, SL could be used for collaborative training and, thus, improve the performance of these biomarkers. This may ultimately result in clinical-grade performance and generalizability

pT3 colorectal cancer revisited: a multicentric study on the histological depth of invasion in more than 1000 pT3 carcinomas—proposal for a new pT3a/pT3b subclassification

BACKGROUND: Pathological TNM staging (pTNM) is the strongest prognosticator in colorectal carcinoma (CRC) and the foundation of its post-operative clinical management. Tumours that invade pericolic/perirectal adipose tissue generally fall into the pT3 category without further subdivision. METHODS: The histological depth of invasion into the pericolic/perirectal fat was digitally and conventionally measured in a training cohort of 950 CRCs (Munich). We biostatistically calculated the optimal cut-off to stratify pT3 CRCs into novel pT3a (≤3 mm)/pT3b (>3 mm) subgroups, which were then validated in two independent cohorts (447 CRCs, Bayreuth/542 CRCs, Mainz). RESULTS: Compared to pT3a tumours, pT3b CRCs showed significantly worse disease-specific survival, including in pN0 vs pN+ and colonic vs. rectal cancers (DSS: P < 0.001, respectively, pooled analysis of all cohorts). Furthermore, the pT3a/pT3b subclassification remained an independent predictor of survival in multivariate analyses (e.g. DSS: P < 0.001, hazard ratio: 4.41 for pT3b, pooled analysis of all cohorts). While pT2/pT3a CRCs showed similar survival characteristics, pT3b cancers remained a distinct subgroup with dismal survival. DISCUSSION: The delineation of pT3a/pT3b subcategories of CRC based on the histological depth of adipose tissue invasion adds valuable prognostic information to the current pT3 classification and implementation into current staging practices of CRC should be considered

Encrypted federated learning for secure decentralized collaboration in cancer image analysis.

Artificial intelligence (AI) has a multitude of applications in cancer research and oncology. However, the training of AI systems is impeded by the limited availability of large datasets due to data protection requirements and other regulatory obstacles. Federated and swarm learning represent possible solutions to this problem by collaboratively training AI models while avoiding data transfer. However, in these decentralized methods, weight updates are still transferred to the aggregation server for merging the models. This leaves the possibility for a breach of data privacy, for example by model inversion or membership inference attacks by untrusted servers. Somewhat-homomorphically-encrypted federated learning (SHEFL) is a solution to this problem because only encrypted weights are transferred, and model updates are performed in the encrypted space. Here, we demonstrate the first successful implementation of SHEFL in a range of clinically relevant tasks in cancer image analysis on multicentric datasets in radiology and histopathology. We show that SHEFL enables the training of AI models which outperform locally trained models and perform on par with models which are centrally trained. In the future, SHEFL can enable multiple institutions to co-train AI models without forsaking data governance and without ever transmitting any decryptable data to untrusted servers

Fully transformer-based biomarker prediction from colorectal cancer histology: a large-scale multicentric study

Background: Deep learning (DL) can extract predictive and prognostic biomarkers from routine pathology slides in colorectal cancer. For example, a DL test for the diagnosis of microsatellite instability (MSI) in CRC has been approved in 2022. Current approaches rely on convolutional neural networks (CNNs). Transformer networks are outperforming CNNs and are replacing them in many applications, but have not been used for biomarker prediction in cancer at a large scale. In addition, most DL approaches have been trained on small patient cohorts, which limits their clinical utility. Methods: In this study, we developed a new fully transformer-based pipeline for end-to-end biomarker prediction from pathology slides. We combine a pre-trained transformer encoder and a transformer network for patch aggregation, capable of yielding single and multi-target prediction at patient level. We train our pipeline on over 9,000 patients from 10 colorectal cancer cohorts. Results: A fully transformer-based approach massively improves the performance, generalizability, data efficiency, and interpretability as compared with current state-of-the-art algorithms. After training on a large multicenter cohort, we achieve a sensitivity of 0.97 with a negative predictive value of 0.99 for MSI prediction on surgical resection specimens. We demonstrate for the first time that resection specimen-only training reaches clinical-grade performance on endoscopic biopsy tissue, solving a long-standing diagnostic problem. Interpretation: A fully transformer-based end-to-end pipeline trained on thousands of pathology slides yields clinical-grade performance for biomarker prediction on surgical resections and biopsies. Our new methods are freely available under an open source license

Generalizable biomarker prediction from cancer pathology slides with self-supervised deep learning: A retrospective multi-centric study

Deep learning (DL) can predict microsatellite instability (MSI) from routine histopathology slides of colorectal cancer (CRC). However, it is unclear whether DL can also predict other biomarkers with high performance and whether DL predictions generalize to external patient populations. Here, we acquire CRC tissue samples from two large multi-centric studies. We systematically compare six different state-of-the-art DL architectures to predict biomarkers from pathology slides, including MSI and mutations in BRAF, KRAS, NRAS, and PIK3CA. Using a large external validation cohort to provide a realistic evaluation setting, we show that models using self-supervised, attention-based multiple-instance learning consistently outperform previous approaches while offering explainable visualizations of the indicative regions and morphologies. While the prediction of MSI and BRAF mutations reaches a clinical-grade performance, mutation prediction of PIK3CA, KRAS, and NRAS was clinically insufficient

Confocal laser endomicroscopy in gastrointestinal diseases

Confocal laser endomicroscopy (CLE) is a novel endoscopic technique permitting in vivo microscopy (optical biopsies) of the gastrointestinal mucosa. CLE has been studied in a multitude of diseases of the upper and lower gastrointestinal tract, including Barrett's esophagus, gastric inflammation and cancer, celiac disease, colorectal adenoma and carcinoma, and inflammatory bowel diseases. CLE has recently evolved and been studied for bile duct and liver imaging. CLE has shown overall high accuracy and enabled smart, targeted biopsies rather than untargeted sampling. Furthermore, the availability of real time microscopic information during endoscopy has immediate impact on therapeutic decisions and guides endoscopic interventions. CLE is also a unique tool for observation of (patho-)physiologic events in their natural environment (functional imaging) and has been linked to molecular imaging of gastrointestinal neoplasia in vivo, thereby broadening our understanding of mucosal pathology in clinical and basic science