A Deep Learning Approach to Denoise Optical Coherence Tomography Images of the Optic Nerve Head

Purpose: To develop a deep learning approach to de-noise optical coherence tomography (OCT) B-scans of the optic nerve head (ONH). Methods: Volume scans consisting of 97 horizontal B-scans were acquired through the center of the ONH using a commercial OCT device (Spectralis) for both eyes of 20 subjects. For each eye, single-frame (without signal averaging), and multi-frame (75x signal averaging) volume scans were obtained. A custom deep learning network was then designed and trained with 2,328 "clean B-scans" (multi-frame B-scans), and their corresponding "noisy B-scans" (clean B-scans + gaussian noise) to de-noise the single-frame B-scans. The performance of the de-noising algorithm was assessed qualitatively, and quantitatively on 1,552 B-scans using the signal to noise ratio (SNR), contrast to noise ratio (CNR), and mean structural similarity index metrics (MSSIM). Results: The proposed algorithm successfully denoised unseen single-frame OCT B-scans. The denoised B-scans were qualitatively similar to their corresponding multi-frame B-scans, with enhanced visibility of the ONH tissues. The mean SNR increased from $4.02 \pm 0.68$ dB (single-frame) to $8.14 \pm 1.03$ dB (denoised). For all the ONH tissues, the mean CNR increased from $3.50 \pm 0.56$ (single-frame) to $7.63 \pm 1.81$ (denoised). The MSSIM increased from $0.13 \pm 0.02$ (single frame) to $0.65 \pm 0.03$ (denoised) when compared with the corresponding multi-frame B-scans. Conclusions: Our deep learning algorithm can denoise a single-frame OCT B-scan of the ONH in under 20 ms, thus offering a framework to obtain superior quality OCT B-scans with reduced scanning times and minimal patient discomfort

Arbeiten zur Optischen Kohärenztomographie, Magnetresonanzspektroskopie und Ultrahochfeld-Magnetresonanztomographie

Abstrakt (Deutsch) Hintergrund: Die Multiple Sklerose ist eine der häufigsten neurologischen Erkrankungen, die zu Behinderung bereits im jungen Erwachsenenalter führen kann. Hierzu tragen im Krankheitsprozess sowohl neuroinflammatorische wie auch neurodegenerative Komponenten bei. Moderne bildgebende Verfahren wie die Ultrahochfeld-Magnetresonanztomographie (UHF-MRT), die Optische Kohärenztomographie (OCT) und die Magnetresonanzspektroskopie (MRS) können benutzt werden, um diese neurodegenerativen Prozesse näher zu charakterisieren und im zeitlichen Verlauf zu beobachten. Zielsetzung: Ziel ist es, die genannten Verfahren zur Charakterisierung von Kohorten von MS-Patienten einzusetzen und die Verfahren zueinander, sowie mit klinischen Parametern in Beziehung zu setzen oder diagnostisch zu nutzen. Methodik: Patienten mit Multipler Sklerose oder Neuromyelitis optica wurden klinisch-neurologisch, mit Optischer Kohärenztomographie, Sehprüfungen, Untersuchungen der visuell evozierten Potentiale (VEP), (Ultrahochfeld-) Magnetresonanztomographie und Magnetresonanzspektroskopie untersucht. Ergebnisse: Die in der Studie eingesetzten bildgebenden Verfahren konnten dazu beitragen, Neuroinflammation und Neurodegeneration bei an Multiple Sklerose erkrankten Patienten näher zu charakterisieren. So steht eine mittels OCT messbare Verdünnung retinaler Nervenfaserschichten (RNFL) in Zusammenhang mit dem per MRT gemessenen Hirnparenchymvolumen und Neurodegeneration anzeigenden Parametern, die mithilfe der Magnetresonanzspektroskopie untersucht wurden. Mithilfe der UHF-MRT konnte ein Zusammenhang zwischen dem Volumen und der entzündlichen Läsionslast der Sehstrahlung, der RNFL-Dicke, VEP-Latenzen und Einschränkungen des Sehvermögens dargestellt werden. Außerdem ließen sich mit der UHF-MRT auch neurogenerative Aspekte im Sinne von bleibenden Parenchymdefekten innerhalb entzündlicher Läsionen und einer Verschmächtigung der Sehstrahlung nachweisen und die Detektion insbesondere kortikaler MS-Läsionen wurde im Vergleich zur konventionellen MRT verbessert. Zusammenfassung: OCT, MRS und UHF-MRT sind Verfahren, die eine genauere Beschreibung von Neuroinflammation und Neurodegeneration bei MS-Patienten ermöglichen, wie hier vor allem für die Sehbahn gezeigt wurde. Sie sind nichtinvasiv und lassen sich zur näheren Charakterisierung des aktuellen Zustandes und zur Beobachtung des Krankheitsverlaufs von MS-Patienten benutzen.Abstract (English) Background: Multiple sclerosis (MS) is the most common disabling neurologic disease, that causes impairment in younger people. Both neuroinflammatory and neurodegenerative processes contribute to the pathogenesis of multiple sclerosis. Innovative imaging methods, such as ultra-high field magnetic resonance tomography (UHF-MRI), optic coherence tomography (OCT) and magnetic resonance spectroscopy (MRS) can be used for characterizing these neurodegenerative processes in detail and over time course. Objective: To use the imaging methods mentioned above to further characterize cohorts of MS patients and to correlate the parameters with themselves as well as with clinical parameters and to evaluate their prognostic and diagnostic relevance. Methods: Patients with multiple sclerosis were examined clinically, by OCT, visual acuity testing, examination of visually evoked potentials, ultra high field magnetic resonance tomography and magnetic resonance spectroscopy. Results: The imaging methods used in these studies contributed to further characterize neuroinflammation und neurodegeneration in multiple sclerosis patients. A thinning of the retinal nerve fiber layer (RNFL) is correlated with brain parenchyma volume measured by MRI, and markers indicating ongoing neurodegenerative processes as detected by MRS. Using UHF-MRI, a correlation between optic radiation properties (such as inflammatory lesion load and its volume) and RNFL thickness, VEP latencies and visual impairment could be demonstrated. Furthermore, UHF-MRI demonstrated neurodegenerative aspects such as parenchymal defects within inflammatory lesions, an optic radiation thinning and allowed a more precise detection of MS lesions than conventional MRI, in particular cortical grey matter lesions. Summary: OCT, MRS and UHF-MRI are feasible methods to provide a more detailed description of neuroinflammation and neurodegeneration in MS patients, as demonstrated in these studies particularly for the visual pathway. They are non-invasive and can be utilized for clinical to study the disease course and also in differential diagnostic procedures

Machine Learning Techniques, Detection and Prediction of Glaucoma– A Systematic Review

Globally, glaucoma is the most common factor in both permanent blindness and impairment. However, the majority of patients are unaware they have the condition, and clinical practise continues to face difficulties in detecting glaucoma progression using current technology. An expert ophthalmologist examines the retinal portion of the eye to see how the glaucoma is progressing. This method is quite time-consuming, and doing it manually takes more time. Therefore, using deep learning and machine learning techniques, this problem can be resolved by automatically diagnosing glaucoma. This systematic review involved a comprehensive analysis of various automated glaucoma prediction and detection techniques. More than 100 articles on Machine learning (ML) techniques with understandable graph and tabular column are reviewed considering summery, method, objective, performance, advantages and disadvantages. In the ML techniques such as support vector machine (SVM), and K-means. Fuzzy c-means clustering algorithm are widely used in glaucoma detection and prediction. Through the systematic review, the most accurate technique to detect and predict glaucoma can be determined which can be utilized for future betterment

Computational models for stuctural analysis of retinal images

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University LondonThe evaluation of retina structures has been of great interest because it could be used as a non-intrusive diagnosis in modern ophthalmology to detect many important eye diseases as well as cardiovascular disorders. A variety of retinal image analysis tools have been developed to assist ophthalmologists and eye diseases experts by reducing the time required in eye screening, optimising the costs as well as providing efficient disease treatment and management systems. A key component in these tools is the segmentation and quantification of retina structures. However, the imaging artefacts such as noise, intensity homogeneity and the overlapping tissue of retina structures can cause significant degradations to the performance of these automated image analysis tools. This thesis aims to provide robust and reliable automated retinal image analysis technique to allow for early detection of various retinal and other diseases. In particular, four innovative segmentation methods have been proposed, including two for retinal vessel network segmentation, two for optic disc segmentation and one for retina nerve fibre layers detection. First, three pre-processing operations are combined in the segmentation method to remove noise and enhance the appearance of the blood vessel in the image, and a Mixture of Gaussians is used to extract the blood vessel tree. Second, a graph cut segmentation approach is introduced, which incorporates the mechanism of vectors flux into the graph formulation to allow for the segmentation of very narrow blood vessels. Third, the optic disc segmentation is performed using two alternative methods: the Markov random field image reconstruction approach detects the optic disc by removing the blood vessels from the optic disc area, and the graph cut with compensation factor method achieves that using prior information of the blood vessels. Fourth, the boundaries of the retinal nerve fibre layer (RNFL) are detected by adapting a graph cut segmentation technique that includes a kernel-induced space and a continuous multiplier based max-flow algorithm. The strong experimental results of our retinal blood vessel segmentation methods including Mixture of Gaussian, Graph Cut achieved an average accuracy of 94:33%, 94:27% respectively. Our optic disc segmentation methods including Markov Random Field and Compensation Factor also achieved an average sensitivity of 92:85% and 85:70% respectively. These results obtained on several public datasets and compared with existing methods have shown that our proposed methods are robust and efficient in the segmenting retinal structures such the blood vessels and the optic disc.Brunel University Londonhttp://bura.brunel.ac.uk/bitstream/2438/10387/1/FulltextThesis.pd

Una revisión sistemática de métodos de aprendizaje profundo aplicados a imágenes oculares

Artificial intelligence is having an important effect on different areas of medicine, and ophthalmology has not been the exception. In particular, deep learning methods have been applied successfully to the detection of clinical signs and the classification of ocular diseases. This represents a great potential to increase the number of people correctly diagnosed. In ophthalmology, deep learning methods have primarily been applied to eye fundus images and optical coherence tomography. On the one hand, these methods have achieved an outstanding performance in the detection of ocular diseases such as: diabetic retinopathy, glaucoma, diabetic macular degeneration and age-related macular degeneration.  On the other hand, several worldwide challenges have shared big eye imaging datasets with segmentation of part of the eyes, clinical signs and the ocular diagnostic performed by experts. In addition, these methods are breaking the stigma of black-box models, with the delivering of interpretable clinically information. This review provides an overview of the state-of-the-art deep learning methods used in ophthalmic images, databases and potential challenges for ocular diagnosisLa inteligencia artificial está teniendo un importante impacto en diversas áreas de la medicina y a la oftalmología no ha sido la excepción. En particular, los métodos de aprendizaje profundo han sido aplicados con éxito en la detección de signos clínicos y la clasificación de enfermedades oculares. Esto representa un potencial impacto en el incremento de pacientes correctamente y oportunamente diagnosticados. En oftalmología, los métodos de aprendizaje profundo se han aplicado principalmente a imágenes de fondo de ojo y tomografía de coherencia óptica. Por un lado, estos métodos han logrado un rendimiento sobresaliente en la detección de enfermedades oculares tales como: retinopatía diabética, glaucoma, degeneración macular diabética y degeneración macular relacionada con la edad. Por otro lado, varios desafíos mundiales han compartido grandes conjuntos de datos con segmentación de parte de los ojos, signos clínicos y el diagnóstico ocular realizado por expertos. Adicionalmente, estos métodos están rompiendo el estigma de los modelos de caja negra, con la entrega de información clínica interpretable. Esta revisión proporciona una visión general de los métodos de aprendizaje profundo de última generación utilizados en imágenes oftálmicas, bases de datos y posibles desafíos para los diagnósticos oculare

A method for quantifying sectoral optic disc pallor in fundus photographs and its association with peripapillary RNFL thickness

Purpose: To develop an automatic method of quantifying optic disc pallor in fundus photographs and determine associations with peripapillary retinal nerve fibre layer (pRNFL) thickness. Methods: We used deep learning to segment the optic disc, fovea, and vessels in fundus photographs, and measured pallor. We assessed the relationship between pallor and pRNFL thickness derived from optical coherence tomography scans in 118 participants. Separately, we used images diagnosed by clinical inspection as pale (N=45) and assessed how measurements compared to healthy controls (N=46). We also developed automatic rejection thresholds, and tested the software for robustness to camera type, image format, and resolution. Results: We developed software that automatically quantified disc pallor across several zones in fundus photographs. Pallor was associated with pRNFL thickness globally (\b{eta} = -9.81 (SE = 3.16), p < 0.05), in the temporal inferior zone (\b{eta} = -29.78 (SE = 8.32), p < 0.01), with the nasal/temporal ratio (\b{eta} = 0.88 (SE = 0.34), p < 0.05), and in the whole disc (\b{eta} = -8.22 (SE = 2.92), p < 0.05). Furthermore, pallor was significantly higher in the patient group. Lastly, we demonstrate the analysis to be robust to camera type, image format, and resolution. Conclusions: We developed software that automatically locates and quantifies disc pallor in fundus photographs and found associations between pallor measurements and pRNFL thickness. Translational relevance: We think our method will be useful for the identification, monitoring and progression of diseases characterized by disc pallor/optic atrophy, including glaucoma, compression, and potentially in neurodegenerative disorders.Comment: 44 pages, 20 figures, 7 tables, submitte

Optic Disc and Macula Localization from Retinal Optical Coherence Tomography and Fundus Image

This research used images from Optical Coherence Tomography (OCT) examination as well as fundus images to localize the optical disc and macular layer of retina. The researchers utilized the OCT and fundus image to interpret the distance between macular center and optic disc in the image. The distance will express the area of macula that can be employed for further research. This distance could recognize the thickness of macula parameters diameter that will be used in localizing process of optic disc and macula. The parameters are the circle radius, the size of window’s filter, the constant value and the size of optic disc element structure as well as the size of macula. The results of this study are expected to improve the accuracy of macula detection that experience the edema