M2U-net: Effective and efficient retinal vessel segmentation for real-world applications

In this paper, we present a novel neural network architecture for retinal vessel segmentation that improves over the state of the art on two benchmark datasets, is the first to run in real time on high resolution images, and its small memory and processing requirements make it deployable in mobile and embedded systems. The M2U-Net has a new encoder-decoder architecture that is inspired by the U-Net. It adds pretrained components of MobileNetV2 in the encoder part and novel contractive bottleneck blocks in the decoder part that, combined with bilinear upsampling, drastically reduce the parameter count to 0.55M compared to 31.03M in the original U-Net. We have evaluated its performance against a wide body of previously published results on three public datasets. On two of them, the M2U-Net achieves new state-of-the-art performance by a considerable margin. When implemented on a GPU, our method is the first to achieve real-time inference speeds on high-resolution fundus images. We also implemented our proposed network on an ARM-based embedded system where it segments images in between 0.6 and 15 sec, depending on the resolution. Thus, the M2U-Net enables a number of applications of retinal vessel structure extraction, such as early diagnosis of eye diseases, retinal biometric authentication systems, and robot assisted microsurgery

Retinal blood vessel segmentation for macula detachment surgery monitoring instruments

Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/144261/1/cta2462_am.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/144261/2/cta2462.pd

Retinal blood vessel segmentation: methods and implementations

Since the retinal blood vessel has been acknowledged as an indispensable element in both ophthalmological and cardiovascular disease diagnosis, the accurate segmentation of the retinal vessel tree has become the prerequisite step for automatic or computer-aided diagnosis systems. This thesis, therefore, has investigated different works of image segmentation algorithms and techniques, including unsupervised and supervised methods. Further, the thesis has developed and implemented two systems of the accurate retinal vessel segmentation. The methodologies explained and analyzed in this thesis, have been selected as the most efficient approaches to achieve higher precision, better robustness, and faster execution speed, to meet the strict standard of the modern medical imaging. Based on the intensive investigation and experiments, this thesis has proposed two outstanding implementations of the retinal blood vessel segmentation. The first implementation focuses on the fast, accurate and robust extraction of the retinal vessels using unsupervised techniques, by applying morphology-based global thresholding to draw the retinal venule structure and centerline detection to extract the capillaries. Besides, this system has been designed to minimize the computing complexity and to process multiple independent procedures in parallel. The second proposed system has especially focused on robustness and accuracy in regardless of execution time. This method has utilized the full convolutional neural network trained from a pre-trained semantic segmentation model, which is also called the transfer deep learning. This proposed method has simplified the typical retinal vessel segmentation problem from full-size image segmentation to regional vessel element recognition. Both of the implementations have outperformed their related works and have presented a remarkable scientific value for future computer-aided diagnosis applications. What’s more, this thesis is also a research guide which provide readers with the comprehensive knowledge on how to research on the task of retinal vessel segmentation

Retinal blood vessel segmentation: methods and implementations

Since the retinal blood vessel has been acknowledged as an indispensable element in both ophthalmological and cardiovascular disease diagnosis, the accurate segmentation of the retinal vessel tree has become the prerequisite step for automatic or computer-aided diagnosis systems. This thesis, therefore, has investigated different works of image segmentation algorithms and techniques, including unsupervised and supervised methods. Further, the thesis has developed and implemented two systems of the accurate retinal vessel segmentation. The methodologies explained and analyzed in this thesis, have been selected as the most efficient approaches to achieve higher precision, better robustness, and faster execution speed, to meet the strict standard of the modern medical imaging. Based on the intensive investigation and experiments, this thesis has proposed two outstanding implementations of the retinal blood vessel segmentation. The first implementation focuses on the fast, accurate and robust extraction of the retinal vessels using unsupervised techniques, by applying morphology-based global thresholding to draw the retinal venule structure and centerline detection to extract the capillaries. Besides, this system has been designed to minimize the computing complexity and to process multiple independent procedures in parallel. The second proposed system has especially focused on robustness and accuracy in regardless of execution time. This method has utilized the full convolutional neural network trained from a pre-trained semantic segmentation model, which is also called the transfer deep learning. This proposed method has simplified the typical retinal vessel segmentation problem from full-size image segmentation to regional vessel element recognition. Both of the implementations have outperformed their related works and have presented a remarkable scientific value for future computer-aided diagnosis applications. What’s more, this thesis is also a research guide which provide readers with the comprehensive knowledge on how to research on the task of retinal vessel segmentation

Retinal blood vessel segmentation: methods and implementations

Since the retinal blood vessel has been acknowledged as an indispensable element in both ophthalmological and cardiovascular disease diagnosis, the accurate segmentation of the retinal vessel tree has become the prerequisite step for automatic or computer-aided diagnosis systems. This thesis, therefore, has investigated different works of image segmentation algorithms and techniques, including unsupervised and supervised methods. Further, the thesis has developed and implemented two systems of the accurate retinal vessel segmentation. The methodologies explained and analyzed in this thesis, have been selected as the most efficient approaches to achieve higher precision, better robustness, and faster execution speed, to meet the strict standard of the modern medical imaging. Based on the intensive investigation and experiments, this thesis has proposed two outstanding implementations of the retinal blood vessel segmentation. The first implementation focuses on the fast, accurate and robust extraction of the retinal vessels using unsupervised techniques, by applying morphology-based global thresholding to draw the retinal venule structure and centerline detection to extract the capillaries. Besides, this system has been designed to minimize the computing complexity and to process multiple independent procedures in parallel. The second proposed system has especially focused on robustness and accuracy in regardless of execution time. This method has utilized the full convolutional neural network trained from a pre-trained semantic segmentation model, which is also called the transfer deep learning. This proposed method has simplified the typical retinal vessel segmentation problem from full-size image segmentation to regional vessel element recognition. Both of the implementations have outperformed their related works and have presented a remarkable scientific value for future computer-aided diagnosis applications. What’s more, this thesis is also a research guide which provide readers with the comprehensive knowledge on how to research on the task of retinal vessel segmentation

Universal digital filtering for denoising volumetric retinal OCT and OCT angiography in 3D shearlet domain

Retinal optical coherence tomography (OCT) and OCT angiography (OCTA) suffer from the degeneration of image quality due to speckle noise and bulk-motion noise, respectively. Because the cross-sectional retina has distinct features in OCT and OCTA B-scans, existing digital filters that can denoise OCT efficiently are unable to handle the bulk-motion noise in OCTA. In this Letter, we propose a universal digital filtering approach that is capable of minimizing both types of noise. Considering the retinal capillaries in OCTA are hard to differentiate in B-scans while having distinct curvilinear structures in 3D volumes, we decompose the volumetric OCT and OCTA data with 3D shearlets thus efficiently separate the retinal tissue and vessels from the noise in this transform domain. Compared with wavelets and curvelets, the shearlets provide better representation of the layer edges in OCT and the vasculature in OCTA. Qualitative and quantitative results show the proposed method outperforms the state-of-the-art OCT and OCTA denoising methods. Besides, the superiority of 3D denoising is demonstrated by comparing the 3D shearlet filtering with its 2D counterpart.Comment: This version has been accepted for publication in Opt. Let

On the Indeterminates of Glaucoma:the Controversy of Arterial Blood Pressure and Retinal Perfusion

Glaucoma is a chronic eye disease characterized by thinning of the retina, death of ganglion cells, and progressive loss of vision, eventually leading to blindness. The prevalence of glaucoma is estimated at 1-3% of those over 40 years old. With a constantly aging population, this number is expected to increase significantly over the next 10 years. Even with treatment, about 15% of people with glaucoma currently develop residual vision or tunnel vision and eventually become blind or partially sighted. The mechanisms behind ganglion cell death are poorly understood. Elevated eye pressure is the main risk factor for glaucoma, but treatment in the form of medication, laser, or surgery can only slow the decline, not stop it. In addition, high intraocular pressure is neither necessary nor sufficient for the development of glaucoma, indicating the existence of other unknown risk factors. It has been established that the death of ganglion cells results in a decreased oxygen demand and a concomitant decrease in blood flow. However, there is also a hypothesis that reduced or unstable blood supply is not only a consequence, but also a cause of glaucoma. This is known as the ‘chicken-egg’ dilemma in glaucoma. It is supported by the observation that the risk of developing glaucoma is higher in people with very low blood pressure (sometimes even as a result of overtreatment of high blood pressure).This dissertation is an attempt to methodically examine whether blood pressure can be linked to changes in the retina that could suggest susceptibility to glaucoma. For this purpose, we analyze epidemiological data from the Groningen Longitudinal Glaucoma Study, we use advanced imaging techniques to model the microcirculation, and we describe its relationship with the neural structure and oxygen consumption of the retina. We provide evidence leaning towards the existence of a vascular component, likely pertinent to glaucoma

Neural Representations of Visual Motion Processing in the Human Brain Using Laminar Imaging at 9.4 Tesla

During natural behavior, much of the motion signal falling into our eyes is due to our own movements. Therefore, in order to correctly perceive motion in our environment, it is important to parse visual motion signals into those caused by self-motion such as eye- or head-movements and those caused by external motion. Neural mechanisms underlying this task, which are also required to allow for a stable perception of the world during pursuit eye movements, are not fully understood. Both, perceptual stability as well as perception of real-world (i.e. objective) motion are the product of integration between motion signals on the retina and efference copies of eye movements. The central aim of this thesis is to examine whether different levels of cortical depth or distinct columnar structures of visual motion regions are differentially involved in disentangling signals related to self-motion, objective, or object motion. Based on previous studies reporting segregated populations of voxels in high level visual areas such as V3A, V6, and MST responding predominantly to either retinal or extra- retinal (‘real’) motion, we speculated such voxels to reside within laminar or columnar functional units. We used ultra-high field (9.4T) fMRI along with an experimental paradigm that independently manipulated retinal and extra-retinal motion signals (smooth pursuit) while controlling for effects of eye-movements, to investigate whether processing of real world motion in human V5/MT, putative MST (pMST), and V1 is associated to differential laminar signal intensities. We also examined motion integration across cortical depths in human motion areas V3A and V6 that have strong objective motion responses. We found a unique, condition specific laminar profile in human area V6, showing reduced mid-layer responses for retinal motion only, suggestive of an inhibitory retinal contribution to motion integration in mid layers or alternatively an excitatory contribution in deep and superficial layers. We also found evidence indicating that in V5/MT and pMST, processing related to retinal, objective, and pursuit motion are either integrated or colocalized at the scale of our resolution. In contrast, in V1, independent functional processes seem to be driving the response to retinal and objective motion on the one hand, and to pursuit signals on the other. The lack of differential signals across depth in these regions suggests either that a columnar rather than laminar segregation governs these functions in these areas, or that the methods used were unable to detect differential neural laminar processing. Furthermore, the thesis provides a thorough analysis of the relevant technical modalities used for data acquisition and data analysis at ultra-high field in the context of laminar fMRI. Relying on our technical implementations we were able to conduct two high-resolution fMRI experiments that helped us to further investigate the laminar organization of self-induced and externally induced motion cues in human high-level visual areas and to form speculations about the site and the mechanisms of their integration