Deep learning for optical coherence tomography angiography: Quantifying microvascular changes in diabetic retinopathy

Optical Coherence Tomography Angiography (OCT-A) permits visualization of the changes to the retinal circulation due to diabetic retinopathy (DR), a microvascular complication of diabetes. Machine learning applications have directly benefited ophthalmology, leveraging large amounts of data to create frameworks to aid clinical decision-making. In this thesis, several techniques to quantify the retinal microvasculature are explored. First, high-quality, averaged, 6x6mm OCT-A enface images are used to produce manual segmentations for the corresponding lower-quality, single-frame images to produce more training data. Using transfer learning, the resulting convolutional neural network (CNN) segmented the superficial capillary plexus and deep vascular complex with performance exceeding inter-rater comparisons. Next, a federated learning framework was designed to allow for collaborative training by multiple participants on a de-centralized data corpus. When trained for microvasculature segmentation, the framework achieved comparable performance to a CNN trained on a fully-centralized dataset

CAD system for early diagnosis of diabetic retinopathy based on 3D extracted imaging markers.

This dissertation makes significant contributions to the field of ophthalmology, addressing the segmentation of retinal layers and the diagnosis of diabetic retinopathy (DR). The first contribution is a novel 3D segmentation approach that leverages the patientspecific anatomy of retinal layers. This approach demonstrates superior accuracy in segmenting all retinal layers from a 3D retinal image compared to current state-of-the-art methods. It also offers enhanced speed, enabling potential clinical applications. The proposed segmentation approach holds great potential for supporting surgical planning and guidance in retinal procedures such as retinal detachment repair or macular hole closure. Surgeons can benefit from the accurate delineation of retinal layers, enabling better understanding of the anatomical structure and more effective surgical interventions. Moreover, real-time guidance systems can be developed to assist surgeons during procedures, improving overall patient outcomes. The second contribution of this dissertation is the introduction of a novel computeraided diagnosis (CAD) system for precise identification of diabetic retinopathy. The CAD system utilizes 3D-OCT imaging and employs an innovative approach that extracts two distinct features: first-order reflectivity and 3D thickness. These features are then fused and used to train and test a neural network classifier. The proposed CAD system exhibits promising results, surpassing other machine learning and deep learning algorithms commonly employed in DR detection. This demonstrates the effectiveness of the comprehensive analysis approach employed by the CAD system, which considers both low-level and high-level data from the 3D retinal layers. The CAD system presents a groundbreaking contribution to the field, as it goes beyond conventional methods, optimizing backpropagated neural networks to integrate multiple levels of information effectively. By achieving superior performance, the proposed CAD system showcases its potential in accurately diagnosing DR and aiding in the prevention of vision loss. In conclusion, this dissertation presents novel approaches for the segmentation of retinal layers and the diagnosis of diabetic retinopathy. The proposed methods exhibit significant improvements in accuracy, speed, and performance compared to existing techniques, opening new avenues for clinical applications and advancements in the field of ophthalmology. By addressing future research directions, such as testing on larger datasets, exploring alternative algorithms, and incorporating user feedback, the proposed methods can be further refined and developed into robust, accurate, and clinically valuable tools for diagnosing and monitoring retinal diseases

Predicting optical coherence tomography-derived diabetic macular edema grades from fundus photographs using deep learning

Diabetic eye disease is one of the fastest growing causes of preventable blindness. With the advent of anti-VEGF (vascular endothelial growth factor) therapies, it has become increasingly important to detect center-involved diabetic macular edema (ci-DME). However, center-involved diabetic macular edema is diagnosed using optical coherence tomography (OCT), which is not generally available at screening sites because of cost and workflow constraints. Instead, screening programs rely on the detection of hard exudates in color fundus photographs as a proxy for DME, often resulting in high false positive or false negative calls. To improve the accuracy of DME screening, we trained a deep learning model to use color fundus photographs to predict ci-DME. Our model had an ROC-AUC of 0.89 (95% CI: 0.87-0.91), which corresponds to a sensitivity of 85% at a specificity of 80%. In comparison, three retinal specialists had similar sensitivities (82-85%), but only half the specificity (45-50%, p<0.001 for each comparison with model). The positive predictive value (PPV) of the model was 61% (95% CI: 56-66%), approximately double the 36-38% by the retinal specialists. In addition to predicting ci-DME, our model was able to detect the presence of intraretinal fluid with an AUC of 0.81 (95% CI: 0.81-0.86) and subretinal fluid with an AUC of 0.88 (95% CI: 0.85-0.91). The ability of deep learning algorithms to make clinically relevant predictions that generally require sophisticated 3D-imaging equipment from simple 2D images has broad relevance to many other applications in medical imaging

An Ensemble Method to Automatically Grade Diabetic Retinopathy with Optical Coherence Tomography Angiography Images

Diabetic retinopathy (DR) is a complication of diabetes, and one of the major causes of vision impairment in the global population. As the early-stage manifestation of DR is usually very mild and hard to detect, an accurate diagnosis via eye-screening is clinically important to prevent vision loss at later stages. In this work, we propose an ensemble method to automatically grade DR using ultra-wide optical coherence tomography angiography (UW-OCTA) images available from Diabetic Retinopathy Analysis Challenge (DRAC) 2022. First, we adopt the state-of-the-art classification networks, i.e., ResNet, DenseNet, EfficientNet, and VGG, and train them to grade UW-OCTA images with different splits of the available dataset. Ultimately, we obtain 25 models, of which, the top 16 models are selected and ensembled to generate the final predictions. During the training process, we also investigate the multi-task learning strategy, and add an auxiliary classification task, the Image Quality Assessment, to improve the model performance. Our final ensemble model achieved a quadratic weighted kappa (QWK) of 0.9346 and an Area Under Curve (AUC) of 0.9766 on the internal testing dataset, and the QWK of 0.839 and the AUC of 0.8978 on the DRAC challenge testing dataset.Comment: 13 pages, 6 figures, 5 tables. To appear in Diabetic Retinopathy Analysis Challenge (DRAC), Bin Sheng et al., MICCAI 2022 Challenge, Lecture Notes in Computer Science, Springe

Accelerating precision ophthalmology: recent advances

Introduction: The future of ophthalmology is precision medicine. With a growing incidence of lifestyle-associated ophthalmic disease such as diabetic retinopathy, the use of technology has the potential to overcome the burden on clinical specialists. Advances in precision medicine will help improve diagnosis and better triage those with higher clinical need to the appropriate experts, as well as providing a more tailored approach to treatment that could help transform patient management. Areas covered: A detailed literature review was conducted using OVID Medline and PubMed databases to explore advances in precision medicine within the areas of retinal disease, glaucoma, cornea, cataracts and uveitis. Over the last three years [2019–2022] are explored, particularly discussing technological and genomic advances in screening, diagnosis, and management within these fields. Expert opinion: Artificial intelligence and its subspecialty deep learning provide the most substantial ways in which diagnosis and management of ocular diseases can be further developed within the advancing field of precision medicine. Future challenges include optimal training sets for algorithms and further developing pharmacogenetics in more specialized areas

A Review on Machine Learning Methods in Diabetic Retinopathy Detection

Ocular disorders have a broad spectrum. Some of them, such as Diabetic Retinopathy, are more common in low-income or low-resource countries. Diabetic Retinopathy is a cause related to vision loss and ocular impairment in the world. By identifying the symptoms in the early stages, it is possible to prevent the progress of the disease and also reach blindness. Considering the prevalence of different branches of Artificial Intelligence in many fields, including medicine, and the significant progress achieved in the use of big data to investigate ocular impairments, the potential of Artificial Intelligence algorithms to process and analyze Fundus images was used to identify symptoms associated with Diabetic Retinopathy. Under the studies, the proposed models for transformers provide better interpretability for doctors and scientists. Artificial Intelligence algorithms are also helpful in anticipating future health issues after appraising premature cases of the ailment. Especially in ophthalmology, a trustworthy diagnosis of visual outcomes helps physicians in advising disease and clinical decision-making while reducing health management costs