Joint Segmentation and Uncertainty Visualization of Retinal Layers in Optical Coherence Tomography Images using Bayesian Deep Learning

Optical coherence tomography (OCT) is commonly used to analyze retinal layers for assessment of ocular diseases. In this paper, we propose a method for retinal layer segmentation and quantification of uncertainty based on Bayesian deep learning. Our method not only performs end-to-end segmentation of retinal layers, but also gives the pixel wise uncertainty measure of the segmentation output. The generated uncertainty map can be used to identify erroneously segmented image regions which is useful in downstream analysis. We have validated our method on a dataset of 1487 images obtained from 15 subjects (OCT volumes) and compared it against the state-of-the-art segmentation algorithms that does not take uncertainty into account. The proposed uncertainty based segmentation method results in comparable or improved performance, and most importantly is more robust against noise

M2U-net: Effective and efficient retinal vessel segmentation for real-world applications

In this paper, we present a novel neural network architecture for retinal vessel segmentation that improves over the state of the art on two benchmark datasets, is the first to run in real time on high resolution images, and its small memory and processing requirements make it deployable in mobile and embedded systems. The M2U-Net has a new encoder-decoder architecture that is inspired by the U-Net. It adds pretrained components of MobileNetV2 in the encoder part and novel contractive bottleneck blocks in the decoder part that, combined with bilinear upsampling, drastically reduce the parameter count to 0.55M compared to 31.03M in the original U-Net. We have evaluated its performance against a wide body of previously published results on three public datasets. On two of them, the M2U-Net achieves new state-of-the-art performance by a considerable margin. When implemented on a GPU, our method is the first to achieve real-time inference speeds on high-resolution fundus images. We also implemented our proposed network on an ARM-based embedded system where it segments images in between 0.6 and 15 sec, depending on the resolution. Thus, the M2U-Net enables a number of applications of retinal vessel structure extraction, such as early diagnosis of eye diseases, retinal biometric authentication systems, and robot assisted microsurgery

Joint Diabetic Macular Edema Segmentation and Characterization in OCT Images

This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/s10278-020-00360-y[Abstract]: The automatic identification and segmentation of edemas associated with diabetic macular edema (DME) constitutes a crucial ophthalmological issue as they provide useful information for the evaluation of the disease severity. According to clinical knowledge, the DME disorder can be categorized into three main pathological types: serous retinal detachment (SRD), cystoid macular edema (CME), and diffuse retinal thickening (DRT). The implementation of computational systems for their automatic extraction and characterization may help the clinicians in their daily clinical practice, adjusting the diagnosis and therapies and consequently the life quality of the patients. In this context, this paper proposes a fully automatic system for the identification, segmentation and characterization of the three ME types using optical coherence tomography (OCT) images. In the case of SRD and CME edemas, different approaches were implemented adapting graph cuts and active contours for their identification and precise delimitation. In the case of the DRT edemas, given their fuzzy regional appearance that requires a complex extraction process, an exhaustive analysis using a learning strategy was designed, exploiting intensity, texture, and clinical-based information. The different steps of this methodology were validated with a heterogeneous set of 262 OCT images, using the manual labeling provided by an expert clinician. In general terms, the system provided satisfactory results, reaching Dice coefficient scores of 0.8768, 0.7475, and 0.8913 for the segmentation of SRD, CME, and DRT edemas, respectively.This work is supported by the Instituto de Salud Carlos III, Government of Spain, and FEDER funds through the DTS18/00136 research project and by Ministerio de Ciencia, Innovación y Universidades, Government of Spain through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. Also, this work has received financial support from the European Union (European Regional Development Fund - ERDF) and the Xunta de Galicia, Centro de Investigación del Sistema Universitário de Galicia, Ref. ED431G 2019/01; and Grupos de Referencia Competitiva, Ref. ED431C 2016-047.Xunta de Galicia; ED431G 2019/01Xunta de Galicia; ED431C 2016-04

Supervised machine learning based multi-task artificial intelligence classification of retinopathies

Artificial intelligence (AI) classification holds promise as a novel and affordable screening tool for clinical management of ocular diseases. Rural and underserved areas, which suffer from lack of access to experienced ophthalmologists may particularly benefit from this technology. Quantitative optical coherence tomography angiography (OCTA) imaging provides excellent capability to identify subtle vascular distortions, which are useful for classifying retinovascular diseases. However, application of AI for differentiation and classification of multiple eye diseases is not yet established. In this study, we demonstrate supervised machine learning based multi-task OCTA classification. We sought 1) to differentiate normal from diseased ocular conditions, 2) to differentiate different ocular disease conditions from each other, and 3) to stage the severity of each ocular condition. Quantitative OCTA features, including blood vessel tortuosity (BVT), blood vascular caliber (BVC), vessel perimeter index (VPI), blood vessel density (BVD), foveal avascular zone (FAZ) area (FAZ-A), and FAZ contour irregularity (FAZ-CI) were fully automatically extracted from the OCTA images. A stepwise backward elimination approach was employed to identify sensitive OCTA features and optimal-feature-combinations for the multi-task classification. For proof-of-concept demonstration, diabetic retinopathy (DR) and sickle cell retinopathy (SCR) were used to validate the supervised machine leaning classifier. The presented AI classification methodology is applicable and can be readily extended to other ocular diseases, holding promise to enable a mass-screening platform for clinical deployment and telemedicine.Comment: Supplemental material attached at the en

Automatic macular edema identification and characterization using OCT images

© 2018. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/. This version of the article: Samagaio, G., Estévez, A., Moura, J. de, Novo, J., Fernández, M. I., & Ortega, M. (2018). “Automatic macular edema identification and characterization using OCT images” has been accepted for publication in Computer Methods and Programs in Biomedicine, 163, 47–63. The Version of Record is available online at: https://doi.org/10.1016/j.cmpb.2018.05.033.[Abstract]: Background and objective: The detection and characterization of the intraretinal fluid accumulation constitutes a crucial ophthalmological issue as it provides useful information for the identification and diagnosis of the different types of Macular Edema (ME). These types are clinically defined, according to the clinical guidelines, as: Serous Retinal Detachment (SRD), Diffuse Retinal Thickening (DRT) and Cystoid Macular Edema (CME). Their accurate identification and characterization facilitate the diagnostic process, determining the disease severity and, therefore, allowing the clinicians to achieve more precise analysis and suitable treatments. Methods: This paper proposes a new fully automatic system for the identification and characterization of the three types of ME using Optical Coherence Tomography (OCT) images. In the case of SRD and CME edemas, multilevel image thresholding approaches were designed and combined with the application of ad-hoc clinical restrictions. The case of DRT edemas, given their complexity and fuzzy regional appearance, was approached by a learning strategy that exploits intensity, texture and clinical-based information to identify their presence. Results: The system provided satisfactory results with F-Measures of 87.54% and 91.99% for the DRT and CME detections, respectively. In the case of SRD edemas, the system correctly detected all the cases that were included in the designed dataset. Conclusions: The proposed methodology offered an accurate performance for the individual identification and characterization of the three different types of ME in OCT images. In fact, the method is capable to handle the ME analysis even in cases of significant severity with the simultaneous existence of the three ME types that appear merged inside the retinal layers.This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the PI14/02161 and the DTS15/00153 research projects and by the Ministerio de Economía y Competitividad, Government of Spain through the DPI2015-69948-R research project. Also, this work has received financial support from the European Union (European Regional Development Fund - ERDF) and the Xunta de Galicia, Centro singular de investigación de Galicia accreditation 2016–2019, Ref. ED431G/01; and Grupos de Referencia Competitiva, Ref. ED431C 2016-047.Xunta de Galicia; ED431G/01Xunta de Galicia; ED431C 2016-04

Deep learning-based improvement for the outcomes of glaucoma clinical trials

Glaucoma is the leading cause of irreversible blindness worldwide. It is a progressive optic neuropathy in which retinal ganglion cell (RGC) axon loss, probably as a consequence of damage at the optic disc, causes a loss of vision, predominantly affecting the mid-peripheral visual field (VF). Glaucoma results in a decrease in vision-related quality of life and, therefore, early detection and evaluation of disease progression rates is crucial in order to assess the risk of functional impairment and to establish sound treatment strategies. The aim of my research is to improve glaucoma diagnosis by enhancing state of the art analyses of glaucoma clinical trial outcomes using advanced analytical methods. This knowledge would also help better design and analyse clinical trials, providing evidence for re-evaluating existing medications, facilitating diagnosis and suggesting novel disease management. To facilitate my objective methodology, this thesis provides the following contributions: (i) I developed deep learning-based super-resolution (SR) techniques for optical coherence tomography (OCT) image enhancement and demonstrated that using super-resolved images improves the statistical power of clinical trials, (ii) I developed a deep learning algorithm for segmentation of retinal OCT images, showing that the methodology consistently produces more accurate segmentations than state-of-the-art networks, (iii) I developed a deep learning framework for refining the relationship between structural and functional measurements and demonstrated that the mapping is significantly improved over previous techniques, iv) I developed a probabilistic method and demonstrated that glaucomatous disc haemorrhages are influenced by a possible systemic factor that makes both eyes bleed simultaneously. v) I recalculated VF slopes, using the retinal never fiber layer thickness (RNFLT) from the super-resolved OCT as a Bayesian prior and demonstrated that use of VF rates with the Bayesian prior as the outcome measure leads to a reduction in the sample size required to distinguish treatment arms in a clinical trial

An In-Depth Statistical Review of Retinal Image Processing Models from a Clinical Perspective

The burgeoning field of retinal image processing is critical in facilitating early diagnosis and treatment of retinal diseases, which are amongst the leading causes of vision impairment globally. Despite rapid advancements, existing machine learning models for retinal image processing are characterized by significant limitations, including disparities in pre-processing, segmentation, and classification methodologies, as well as inconsistencies in post-processing operations. These limitations hinder the realization of accurate, reliable, and clinically relevant outcomes. This paper provides an in-depth statistical review of extant machine learning models used in retinal image processing, meticulously comparing them based on their internal operating characteristics and performance levels. By adopting a robust analytical approach, our review delineates the strengths and weaknesses of current models, offering comprehensive insights that are instrumental in guiding future research and development in this domain. Furthermore, this review underscores the potential clinical impacts of these models, highlighting their pivotal role in enhancing diagnostic accuracy, prognostic assessments, and therapeutic interventions for retinal disorders. In conclusion, our work not only bridges the existing knowledge gap in the literature but also paves the way for the evolution of more sophisticated and clinically-aligned retinal image processing models, ultimately contributing to improved patient outcomes and advancements in ophthalmic care