Triplet network for classification of benign and pre-malignant polyps

Colorectal polyps are critical indicators of colorectal cancer (CRC). Classification of polyps during colonoscopy is still a challenge for which many medical experts have come up with visual models, albeit with limited success. An early detection of CRC prevents further complications in the colon, which makes identification of abnormal tissue a crucial step during routinary colonoscopy. In this paper, a classification approach is proposed to differentiate between benign and pre-malignant polyps using features learned from a Triplet Network architecture. The study includes a total of 154 patients, with 203 different polyps. For each polyp an image is acquired with White Light (WL), and additionally with two recent endoscopic modalities:Blue Laser Imaging (BLI) and Linked Color Imaging (LCI). The network is trained with the associated triplet loss, allowing the learning of non-linear features, which prove to be a highly discriminative embedding, leading to excellent results with simple linear classifiers. Additionally, the acquisition of multiple polyps with WL, BLI and LCI, enables the combination of the posterior probabilities, yielding a more robust classification result. Threefold cross-validation is employed as validation method and accuracy, sensitivity, specificity and area under the curve (AUC) are computed as evaluation metrics. While our approach achieves a similar classification performance compared to state-of-the-art methods, it has a much lower inference time (from hours to seconds, on a single GPU). The increased robustness and much faster execution facilitates future advances towards patient safety and may avoid time-consuming and costly histhological assessment.</p

Polyp malignancy classification with CNN features based on Blue Laser and Linked Color Imaging

In-vivo classification of benign and pre-malignant polyps is a laborious task that requires histophatology confirmation. In an effort to improve the quality of clinical diagnosis, medical experts have come up with visual models with only limited success. In this paper, a classification approach is proposed to differentiate between polypmalignancy, using features extracted from the Global Average Pooling (GAP) layer of a pre-trained Convolutional Neural Network (CNNs) . Two recently developed endoscopic modalities are used to improve the pipeline prediction: Blue Laser Imaging (BLI) and Linked Color Imaging (LCI). Furthermore, a new strategy of per-class data augmentation is adopted to tackle the differences of unbalanced class distribution. The results are compared with a more general approach, showing how artificial examples can improve results on highly unbalanced problems. For the same reason, the combined features for each patient are extracted and trained using several machine learning classifiers without CNNs. Moreover to speed up computation, a recent GPU based Support Vector Machine (SVM) scheme is employed to substantially decrease the overload during training time. The presented methodology shows the feasibility of using the LCI and BLI techniques for automatic polypmalignancy classification and facilitates future advances to limit the need for time-consuming and costly histopathological assessment

Artificial intelligence and computer-aided diagnosis in colonoscopy: current evidence and future directions

Computer-aided diagnosis offers a promising solution to reduce variation in colonoscopy performance. Pooled miss rates for polyps are as high as 22%, and associated interval colorectal cancers after colonoscopy are of concern. Optical biopsy, whereby in-vivo classification of polyps based on enhanced imaging replaces histopathology, has not been incorporated into routine practice because it is limited by interobserver variability and generally only meets accepted standards in expert settings. Real-time decision-support software has been developed to detect and characterise polyps, and also to offer feedback on the technical quality of inspection. Some of the current algorithms, particularly with recent advances in artificial intelligence techniques, match human expert performance for optical biopsy. In this Review, we summarise the evidence for clinical applications of computer-aided diagnosis and artificial intelligence in colonoscopy

Quality Assurance of Computer-Aided Detection and Diagnosis in Colonoscopy

Recent breakthroughs in artificial intelligence (AI), specifically via its emerging sub-field “Deep Learning,” have direct implications for computer-aided detection and diagnosis (CADe/CADx) for colonoscopy. AI is expected to have at least 2 major roles in colonoscopy practice; polyp detection (CADe) and polyp characterization (CADx). CADe has the potential to decrease polyp miss rate, contributing to improving adenoma detection, whereas CADx can improve the accuracy of colorectal polyp optical diagnosis, leading to reduction of unnecessary polypectomy of non-neoplastic lesions, potential implementation of a resect and discard paradigm, and proper application of advanced resection techniques. A growing number of medical-engineering researchers are developing both, CADe and CADx systems, some of which allow real-time recognition of polyps or in vivo identification of adenomas with over 90% accuracy. However, the quality of the developed AI systems as well as that of the study designs vary significantly, hence raising some concerns regarding the generalization of the proposed AI systems. Initial studies were conducted in an exploratory or retrospective fashion using stored images and likely overestimating the results. These drawbacks potentially hinder smooth implementation of this novel technology into colonoscopy practice. The aim of this article is to review both contributions and limitations in recent machine learning based CADe/CADx colonoscopy studies and propose some principles that should underlie system development and clinical testing

Spatio-temporal classification for polyp diagnosis

Colonoscopy remains the gold standard investigation for colorectal cancer screening as it offers the opportunity to both detect and resect pre-cancerous polyps. Computer-aided polyp characterisation can determine which polyps need polypectomy and recent deep learning-based approaches have shown promising results as clinical decision support tools. Yet polyp appearance during a procedure can vary, making automatic predictions unstable. In this paper, we investigate the use of spatio-temporal information to improve the performance of lesions classification as adenoma or non-adenoma. Two methods are implemented showing an increase in performance and robustness during extensive experiments both on internal and openly available benchmark datasets

Confident texture-based laryngeal tissue classification for early stage diagnosis support

none8siopenMoccia, Sara; De Momi, Elena; Guarnaschelli, Marco; Savazzi, Matteo; Laborai, Andrea; Guastini, Luca; Peretti, Giorgio; Mattos, Leonardo S.Moccia, Sara; De Momi, Elena; Guarnaschelli, Marco; Savazzi, Matteo; Laborai, Andrea; Guastini, Luca; Peretti, Giorgio; Mattos, Leonardo S

Advanced endoscopic imaging for diagnosis of inflammatory bowel diseases : present and future perspectives

Crohn's disease and ulcerative colitis are chronic inflammatory bowel diseases (IBD) causing severe damage of the luminal gastrointestinal tract. Differential diagnosis between both disease entities is sometimes awkward requiring a multifactorial pathway, including clinical and laboratory data, radiological findings, histopathology and endoscopy. Apart from disease diagnosis, endoscopy in IBD plays a major role in prediction of disease severity and extent (i.e. mucosal healing) for tailored patient management and for screening of colitis-associated cancer and its precursor lesions. In this state-of-the-art review, we focus on current applications of endoscopy for diagnosis and surveillance of IBD. Moreover, we will discuss the latest guidelines on surveillance and provide an overview of the most recent developments in the field of endoscopic imaging and IBD

Confident texture-based laryngeal tissue classification for early stage diagnosis support

Early stage diagnosis of laryngeal squamous cell carcinoma (SCC) is of primary importance for lowering patient mortality or after treatment morbidity. Despite the challenges in diagnosis reported in the clinical literature, few efforts have been invested in computer-assisted diagnosis. The objective of this paper is to investigate the use of texture-based machine-learning algorithms for early stage cancerous laryngeal tissue classification. To estimate the classification reliability, a measure of confidence is also exploited. From the endoscopic videos of 33 patients affected by SCC, a well-balanced dataset of 1320 patches, relative to four laryngeal tissue classes, was extracted. With the best performing feature, the achieved median classification recall was 93% [interquartile range ðIQRÞ ¼ 6%]. When excluding low-confidence patches, the achieved median recall was increased to 98% (IQR ¼ 5%), proving the high reliability of the proposed approach. This research represents an important advancement in the state-of-the-art computer-assisted laryngeal diagnosis, and the results are a promising step toward a helpful endoscope-integrated processing system to support early stage diagnosis