An Efficient Approach for Polyps Detection in Endoscopic Videos Based on Faster R-CNN

Polyp has long been considered as one of the major etiologies to colorectal cancer which is a fatal disease around the world, thus early detection and recognition of polyps plays a crucial role in clinical routines. Accurate diagnoses of polyps through endoscopes operated by physicians becomes a challenging task not only due to the varying expertise of physicians, but also the inherent nature of endoscopic inspections. To facilitate this process, computer-aid techniques that emphasize fully-conventional image processing and novel machine learning enhanced approaches have been dedicatedly designed for polyp detection in endoscopic videos or images. Among all proposed algorithms, deep learning based methods take the lead in terms of multiple metrics in evolutions for algorithmic performance. In this work, a highly effective model, namely the faster region-based convolutional neural network (Faster R-CNN) is implemented for polyp detection. In comparison with the reported results of the state-of-the-art approaches on polyps detection, extensive experiments demonstrate that the Faster R-CNN achieves very competing results, and it is an efficient approach for clinical practice.Comment: 6 pages, 10 figures,2018 International Conference on Pattern Recognitio

Decomposition of color wavelet with higher order statistical texture and convolutional neural network features set based classification of colorectal polyps from video endoscopy

Gastrointestinal cancer is one of the leading causes of death across the world. The gastrointestinal polyps are considered as the precursors of developing this malignant cancer. In order to condense the probability of cancer, early detection and removal of colorectal polyps can be cogitated. The most used diagnostic modality for colorectal polyps is video endoscopy. But the accuracy of diagnosis mostly depends on doctors' experience that is crucial to detect polyps in many cases. Computer-aided polyp detection is promising to reduce the miss detection rate of the polyp and thus improve the accuracy of diagnosis results. The proposed method first detects polyp and non-polyp then illustrates an automatic polyp classification technique from endoscopic video through color wavelet with higher-order statistical texture feature and Convolutional Neural Network (CNN). Gray Level Run Length Matrix (GLRLM) is used for higher-order statistical texture features of different directions (Ɵ = 0o, 45o, 90o, 135o). The features are fed into a linear support vector machine (SVM) to train the classifier. The experimental result demonstrates that the proposed approach is auspicious and operative with residual network architecture, which triumphs the best performance of accuracy, sensitivity, and specificity of 98.83%, 97.87%, and 99.13% respectively for classification of colorectal polyps on standard public endoscopic video databases

AFP-Net: Realtime Anchor-Free Polyp Detection in Colonoscopy

Colorectal cancer (CRC) is a common and lethal disease. Globally, CRC is the third most commonly diagnosed cancer in males and the second in females. For colorectal cancer, the best screening test available is the colonoscopy. During a colonoscopic procedure, a tiny camera at the tip of the endoscope generates a video of the internal mucosa of the colon. The video data are displayed on a monitor for the physician to examine the lining of the entire colon and check for colorectal polyps. Detection and removal of colorectal polyps are associated with a reduction in mortality from colorectal cancer. However, the miss rate of polyp detection during colonoscopy procedure is often high even for very experienced physicians. The reason lies in the high variation of polyp in terms of shape, size, textural, color and illumination. Though challenging, with the great advances in object detection techniques, automated polyp detection still demonstrates a great potential in reducing the false negative rate while maintaining a high precision. In this paper, we propose a novel anchor free polyp detector that can localize polyps without using predefined anchor boxes. To further strengthen the model, we leverage a Context Enhancement Module and Cosine Ground truth Projection. Our approach can respond in real time while achieving state-of-the-art performance with 99.36% precision and 96.44% recall

Искусственный интеллект при колоректальном раке: обзор

The study objective: the study objective is to examine the use of artificial intelligence (AI) in the diagnosis, treatment, and prognosis of Colorectal Cancer (CRC) and discuss the future potential of AI in CRC. Material and Methods. The Web of Science, Scopus, PubMed, Medline, and eLIBRARY databases were used to search for the publications. A study on the application of Artificial Intelligence (AI) to the diagnosis, treatment, and prognosis of Colorectal Cancer (CRC) was discovered in more than 100 sources. In the review, data from 83 articles were incorporated. Results. The review article explores the use of artificial intelligence (AI) in medicine, specifically focusing on its applications in colorectal cancer (CRC). It discusses the stages of AI development for CRC, including molecular understanding, image-based diagnosis, drug design, and individualized treatment. The benefits of AI in medical image analysis are highlighted, improving diagnosis accuracy and inspection quality. Challenges in AI development are addressed, such as data standardization and the interpretability of machine learning algorithms. The potential of AI in treatment decision support, precision medicine, and prognosis prediction is discussed, emphasizing the role of AI in selecting optimal treatments and improving surgical precision. Ethical and regulatory considerations in integrating AI are mentioned, including patient trust, data security, and liability in AI-assisted surgeries. The review emphasizes the importance of an AI standard system, dataset standardization, and integrating clinical knowledge into AI algorithms. Overall, the article provides an overview of the current research on AI in CRC diagnosis, treatment, and prognosis, discussing its benefits, challenges, and future prospects in improving medical outcomes.Цель исследования - оценка возможностей использования искусственного интеллекта (ИИ) в диагностике, лечении и прогнозировании колоректального рака (КРР), а также обсуждение потенциала ИИ в лечении КРР. Материал и методы. Проведен поиск научных публикаций в поисковых системах Web of Science, Scopus, PubMed, Medline и eLIBRARY. Было просмотрено более 100 источников по применению ИИ для диагностики, лечения и прогнозирования КРР. В обзор включены данные из 83 статей. Результаты. Проведен анализ литературы, посвященной применению искусственного интеллекта в медицине, особое внимание уделено его использованию при колоректальном раке. Обсуждаются этапы развития ИИ при КРР, включая молекулярную верификацию, лучевую диагностику, разработку лекарств и индивидуальное лечение. Подчеркнуты преимущества ИИ в анализе медицинских изображений, таких как КТ, МРТ и ПЭТ, что повышает точность диагностики. Рассматриваются такие проблемы развития ИИ, как стандартизация данных и интерпретируемость алгоритмов машинного обучения. Подчеркивается роль ИИ в выборе оптимальной тактики лечения и повышении эффективности хирургического вмешательства. Учитываются этические и нормативные аспекты ИИ, включая доверие пациентов, безопасность данных и ответственность в проведении операций с использованием ИИ. Обсуждаются преимущества ИИ в диагностике, лечении и прогнозировании колоректального рака, проблемы и перспективы улучшения результатов лечения

Artificial intelligence and automation in endoscopy and surgery

Modern endoscopy relies on digital technology, from high-resolution imaging sensors and displays to electronics connecting configurable illumination and actuation systems for robotic articulation. In addition to enabling more effective diagnostic and therapeutic interventions, the digitization of the procedural toolset enables video data capture of the internal human anatomy at unprecedented levels. Interventional video data encapsulate functional and structural information about a patient’s anatomy as well as events, activity and action logs about the surgical process. This detailed but difficult-to-interpret record from endoscopic procedures can be linked to preoperative and postoperative records or patient imaging information. Rapid advances in artificial intelligence, especially in supervised deep learning, can utilize data from endoscopic procedures to develop systems for assisting procedures leading to computer-assisted interventions that can enable better navigation during procedures, automation of image interpretation and robotically assisted tool manipulation. In this Perspective, we summarize state-of-the-art artificial intelligence for computer-assisted interventions in gastroenterology and surgery

Mapas de atención para destacar pólipos potenciales durante la colonoscopia

Context: Polyps are protruding masses that grow along the intestinal tract and are considered to be the main precursors of colorectal cancer. In early stages, polyp detection represents a survival probability of up to 93%, whereas, for other stages, this probability can decrease to 8%. Despite the fact that colonoscopy is the most effective method to detect polyps, several studies have shown a loss rate of up to 26% in detecting polyps. Computer tools have emerged as an alternative to support polyp detection and localization, but various problems remain open due to their high variability. Method: This work introduces a computational strategy that produces visual attention maps with the most probable location of polyps to generate alarms and support detection procedures. Each colonoscopy frame is decomposed into a set of deep features extracted from pre-trained architectures. Such features are encoded into a dense Hough representation in order to obtain a polyp template, which is then propagated in each frame to obtain a visual attention map. The maximum regions are back-projected to the colonoscopy in order to draw suspicious polyp regions. Results: The proposed strategy was evaluated in the ASU-Mayo Clinic and CVC-Video Clinic datasets, reporting a detection accuracy of 70% among the four most probable regions, while ten regions yielded 80%. Conclusions: The obtained attention maps highlight the most probable regions with suspicious polyps. The proposed approach may be useful to support colonoscopy analysis.Contexto: Los pólipos son masas protuberantes que crecen a lo largo del tracto intestinal y se consideran los principales precursores del cáncer de colon. En las etapas tempranas, la detección de pólipos representa una probabilidad de supervivencia de hasta el 93%, mientras que, en otras etapas, esta probabilidad disminuye hasta el 8%. A pesar de que la colonoscopia es el método más efectivo para detectar pólipos, varios estudios han demostrado una tasa de pérdida de hasta el 26% en la detección pólipos. Las herramientas computacionales han surgido como una alternativa para soportar la detección y localización de pólipos, pero varios problemas siguen abiertos debido a la alta variabilidad de los mismos. Método: Este trabajo introduce una estrategia computacional que produce mapas de atención visual con la localización más probable de los pólipos para generar alarmas y apoyar la tarea de detección. Cada fotograma de colonoscopia se descompone en un conjunto de características profundas extraídas de arquitecturas preentrenadas. Dichas características se codifican en una representación densa de Hough para obtener una plantilla del pólipo, que posteriormente se propaga en cada fotograma para obtener los mapas de atención visual. Las regiones máximas son proyectadas a la colonoscopia para dibujar las regiones sospechosas de pólipo. Resultados:  La estrategia propuesta fue evaluada en los conjuntos de datos ASU-Mayo Clinic y CVC-Video Clinic, reportando una exactitud de 70% de detección entre las cuatro regiones más probables, mientras que con diez regiones se tiene un 80%. Conclusiones:  Los mapas de atención obtenidos destacan las regiones más probables con pólipos. El enfoque propuesto puede ser útil para apoyar el análisis de la colonoscopia