Simultaneous Multiple Surface Segmentation Using Deep Learning

The task of automatically segmenting 3-D surfaces representing boundaries of objects is important for quantitative analysis of volumetric images, and plays a vital role in biomedical image analysis. Recently, graph-based methods with a global optimization property have been developed and optimized for various medical imaging applications. Despite their widespread use, these require human experts to design transformations, image features, surface smoothness priors, and re-design for a different tissue, organ or imaging modality. Here, we propose a Deep Learning based approach for segmentation of the surfaces in volumetric medical images, by learning the essential features and transformations from training data, without any human expert intervention. We employ a regional approach to learn the local surface profiles. The proposed approach was evaluated on simultaneous intraretinal layer segmentation of optical coherence tomography (OCT) images of normal retinas and retinas affected by age related macular degeneration (AMD). The proposed approach was validated on 40 retina OCT volumes including 20 normal and 20 AMD subjects. The experiments showed statistically significant improvement in accuracy for our approach compared to state-of-the-art graph based optimal surface segmentation with convex priors (G-OSC). A single Convolution Neural Network (CNN) was used to learn the surfaces for both normal and diseased images. The mean unsigned surface positioning errors obtained by G-OSC method 2.31 voxels (95% CI 2.02-2.60 voxels) was improved to $1.27$ voxels (95% CI 1.14-1.40 voxels) using our new approach. On average, our approach takes 94.34 s, requiring 95.35 MB memory, which is much faster than the 2837.46 s and 6.87 GB memory required by the G-OSC method on the same computer system.Comment: 8 page

Open Source Software for Automatic Detection of Cone Photoreceptors in Adaptive Optics Ophthalmoscopy Using Convolutional Neural Networks

Imaging with an adaptive optics scanning light ophthalmoscope (AOSLO) enables direct visualization of the cone photoreceptor mosaic in the living human retina. Quantitative analysis of AOSLO images typically requires manual grading, which is time consuming, and subjective; thus, automated algorithms are highly desirable. Previously developed automated methods are often reliant on ad hoc rules that may not be transferable between different imaging modalities or retinal locations. In this work, we present a convolutional neural network (CNN) based method for cone detection that learns features of interest directly from training data. This cone-identifying algorithm was trained and validated on separate data sets of confocal and split detector AOSLO images with results showing performance that closely mimics the gold standard manual process. Further, without any need for algorithmic modifications for a specific AOSLO imaging system, our fully-automated multi-modality CNN-based cone detection method resulted in comparable results to previous automatic cone segmentation methods which utilized ad hoc rules for different applications. We have made free open-source software for the proposed method and the corresponding training and testing datasets available online

Automatic Detection of Cone Photoreceptors In Split Detector Adaptive Optics Scanning Light Ophthalmoscope Images

Quantitative analysis of the cone photoreceptor mosaic in the living retina is potentially useful for early diagnosis and prognosis of many ocular diseases. Non-confocal split detector based adaptive optics scanning light ophthalmoscope (AOSLO) imaging reveals the cone photoreceptor inner segment mosaics often not visualized on confocal AOSLO imaging. Despite recent advances in automated cone segmentation algorithms for confocal AOSLO imagery, quantitative analysis of split detector AOSLO images is currently a time-consuming manual process. In this paper, we present the fully automatic adaptive filtering and local detection (AFLD) method for detecting cones in split detector AOSLO images. We validated our algorithm on 80 images from 10 subjects, showing an overall mean Dice’s coefficient of 0.95 (standard deviation 0.03), when comparing our AFLD algorithm to an expert grader. This is comparable to the inter-observer Dice’s coefficient of 0.94 (standard deviation 0.04). To the best of our knowledge, this is the first validated, fully-automated segmentation method which has been applied to split detector AOSLO images

In Vivo Multimodal Imaging of Drusenoid Lesions in Rhesus Macaques.

Nonhuman primates are the only mammals to possess a true macula similar to humans, and spontaneously develop drusenoid lesions which are hallmarks of age-related macular degeneration (AMD). Prior studies demonstrated similarities between human and nonhuman primate drusen based on clinical appearance and histopathology. Here, we employed fundus photography, spectral domain optical coherence tomography (SD-OCT), fundus autofluorescence (FAF), and infrared reflectance (IR) to characterize drusenoid lesions in aged rhesus macaques. Of 65 animals evaluated, we identified lesions in 20 animals (30.7%). Using the Age-Related Eye Disease Study 2 (AREDS2) grading system and multimodal imaging, we identified two distinct drusen phenotypes - 1) soft drusen that are larger and appear as hyperreflective deposits between the retinal pigment epithelium (RPE) and Bruchs membrane on SD-OCT, and 2) hard, punctate lesions that are smaller and undetectable on SD-OCT. Both exhibit variable FAF intensities and are poorly visualized on IR. Eyes with drusen exhibited a slightly thicker RPE compared with control eyes (+3.4 μm, P=0.012). Genetic polymorphisms associated with drusenoid lesions in rhesus monkeys in ARMS2 and HTRA1 were similar in frequency between the two phenotypes. These results refine our understanding of drusen development, and provide insight into the absence of advanced AMD in nonhuman primates

Effect of Uveal Melanocytes on Choroidal Morphology in Rhesus Macaques and Humans on Enhanced-Depth Imaging Optical Coherence Tomography.

PurposeTo compare cross-sectional choroidal morphology in rhesus macaque and human eyes using enhanced-depth imaging optical coherence tomography (EDI-OCT) and histologic analysis.MethodsEnhanced-depth imaging-OCT images from 25 rhesus macaque and 30 human eyes were evaluated for choriocapillaris and choroidal-scleral junction (CSJ) visibility in the central macula based on OCT reflectivity profiles, and compared with age-matched histologic sections. Semiautomated segmentation of the choriocapillaris and CSJ was used to measure choriocapillary and choroidal thickness, respectively. Multivariate regression was performed to determine the association of age, refractive error, and race with choriocapillaris and CSJ visibility.ResultsRhesus macaques exhibit a distinct hyporeflective choriocapillaris layer on EDI-OCT, while the CSJ cannot be visualized. In contrast, humans show variable reflectivities of the choriocapillaris, with a distinct CSJ seen in many subjects. Histologic sections demonstrate large, darkly pigmented melanocytes that are densely distributed in the macaque choroid, while melanocytes in humans are smaller, less pigmented, and variably distributed. Optical coherence tomography reflectivity patterns of the choroid appear to correspond to the density, size, and pigmentation of choroidal melanocytes. Mean choriocapillary thickness was similar between the two species (19.3 ± 3.4 vs. 19.8 ± 3.4 μm, P = 0.615), but choroidal thickness may be lower in macaques than in humans (191.2 ± 43.0 vs. 266.8 ± 78.0 μm, P < 0.001). Racial differences in uveal pigmentation also appear to affect the visibility of the choriocapillaris and CSJ on EDI-OCT.ConclusionsPigmented uveal melanocytes affect choroidal morphology on EDI-OCT in rhesus macaque and human eyes. Racial differences in pigmentation may affect choriocapillaris and CSJ visibility, and may influence the accuracy of choroidal thickness measurements

Single image example-based super-resolution using cross-scale patch matching and Markov random field modelling

Example-based super-resolution has become increasingly popular over the last few years for its ability to overcome the limitations of classical multi-frame approach. In this paper we present a new example-based method that uses the input low-resolution image itself as a search space for high-resolution patches by exploiting self-similarity across different resolution scales. Found examples are combined in a high-resolution image by the means of Markov Random Field modelling that forces their global agreement. Additionally, we apply back-projection and steering kernel regression as post-processing techniques. In this way, we are able to produce sharp and artefact-free results that are comparable or better than standard interpolation and state-of-the-art super-resolution techniques

Vascular Response to Sildenafil Citrate in Aging and Age-Related Macular Degeneration.

Age-related macular degeneration (AMD) - the leading cause of vision loss in the elderly - share many risks factors as atherosclerosis, which exhibits loss of vascular compliance resulting from aging and oxidative stress. Here, we attempt to explore choroidal and retinal vascular compliance in patients with AMD by evaluating dynamic vascular changes using live ocular imaging following treatment with oral sildenafil citrate, a phosphodiesterase type 5 (PDE5) inhibitor and potent vasodilator. Enhanced-depth imaging optical coherence tomography (EDI-OCT) and OCT angiography (OCT-A) were performed on 46 eyes of 23 subjects, including 15 patients with non-exudative AMD in one eye and exudative AMD in the fellow eye, and 8 age-matched control subjects. Choroidal thickness, choroidal vascularity, and retinal vessel density were measured across the central macula at 1 and 3 hours after a 100 mg oral dose of sildenafil citrate. Baseline choroidal thickness was 172.1 ± 60.0 μm in non-exudative AMD eyes, 196.4 ± 89.8 μm in exudative AMD eyes, and 207.4 ± 77.7 μm in control eyes, with no difference between the 3 groups (P = 0.116). After sildenafil, choroidal thickness increased by 6.0% to 9.0% at 1 and 3 hours in all groups (P = 0.001-0.014). Eyes from older subjects were associated with choroidal thinning at baseline (P = 0.005) and showed less choroidal expansion at 1 hour and 3 hours after sildenafil (P = 0.001) regardless of AMD status (P = 0.666). The choroidal thickening appeared to be primarily attributed to expansion of the stroma rather than luminal component. Retinal vascular density remained unchanged after sildenafil in all 3 groups (P = 0.281-0.587). Together, our studies suggest that vascular response of the choroid to sildenafil decreases with age, but is not affected by the presence of non-exudative or exudative AMD, providing insight into changes in vessel compliance in aging and AMD

RetiFluidNet: A Self-Adaptive and Multi-Attention Deep Convolutional Network for Retinal OCT Fluid Segmentation

Optical coherence tomography (OCT) helps ophthalmologists assess macular edema, accumulation of fluids, and lesions at microscopic resolution. Quantification of retinal fluids is necessary for OCT-guided treatment management, which relies on a precise image segmentation step. As manual analysis of retinal fluids is a time-consuming, subjective, and error-prone task, there is increasing demand for fast and robust automatic solutions. In this study, a new convolutional neural architecture named RetiFluidNet is proposed for multi-class retinal fluid segmentation. The model benefits from hierarchical representation learning of textural, contextual, and edge features using a new self-adaptive dual-attention (SDA) module, multiple self-adaptive attention-based skip connections (SASC), and a novel multi-scale deep self supervision learning (DSL) scheme. The attention mechanism in the proposed SDA module enables the model to automatically extract deformation-aware representations at different levels, and the introduced SASC paths further consider spatial-channel interdependencies for concatenation of counterpart encoder and decoder units, which improve representational capability. RetiFluidNet is also optimized using a joint loss function comprising a weighted version of dice overlap and edge-preserved connectivity-based losses, where several hierarchical stages of multi-scale local losses are integrated into the optimization process. The model is validated based on three publicly available datasets: RETOUCH, OPTIMA, and DUKE, with comparisons against several baselines. Experimental results on the datasets prove the effectiveness of the proposed model in retinal OCT fluid segmentation and reveal that the suggested method is more effective than existing state-of-the-art fluid segmentation algorithms in adapting to retinal OCT scans recorded by various image scanning instruments.Comment: 11 pages, Early Access Version, IEEE Transactions on Medical Imagin