Uncertainty quantification in medical image segmentation with normalizing flows

Medical image segmentation is inherently an ambiguous task due to factors such as partial volumes and variations in anatomical definitions. While in most cases the segmentation uncertainty is around the border of structures of interest, there can also be considerable inter-rater differences. The class of conditional variational autoencoders (cVAE) offers a principled approach to inferring distributions over plausible segmentations that are conditioned on input images. Segmentation uncertainty estimated from samples of such distributions can be more informative than using pixel level probability scores. In this work, we propose a novel conditional generative model that is based on conditional Normalizing Flow (cFlow). The basic idea is to increase the expressivity of the cVAE by introducing a cFlow transformation step after the encoder. This yields improved approximations of the latent posterior distribution, allowing the model to capture richer segmentation variations. With this we show that the quality and diversity of samples obtained from our conditional generative model is enhanced. Performance of our model, which we call cFlow Net, is evaluated on two medical imaging datasets demonstrating substantial improvements in both qualitative and quantitative measures when compared to a recent cVAE based model.Comment: 12 pages. Accepted to be presented at 11th International Workshop on Machine Learning in Medical Imaging. Source code will be updated at https://github.com/raghavian/cFlo

A Rule Based Segmentation Approaches to Extract Retinal Blood Vessels in Fundus Image

The physiological structures of the retinal blood vessel are one of the key features that visible in the retinal images and contain the information associate with the anatomical abnormalities. It is accepted all over the world to judge the cardiovascular and retinal disease. To avoid the risk of visual impairment, appropriate vessel segmentation is mandatory. Here has proposed a segmentation algorithm that efficiently extracts the blood vessels from the retinal fundus image. The proposed segmentation algorithm is performed Lab and Principle Component (PC) based gray level conversion, Contrast Limited Adaptive Histogram Equalization (CLAHE), morphological operations, Local Property-Based Pixel Correction (LPBPC). For appropriate detection proposed vessels correction algorithm LPBPC that check the feature of the vessels and remove the wrong vessel detection. To measure the appropriateness of the proposed algorithm, the experimental results are compared with the corresponding ground truth images. The experimental results have shown that the proposed blood vessel algorithm is more accurate than the existing algorithms

Retinal blood vessel segmentation: methods and implementations

Since the retinal blood vessel has been acknowledged as an indispensable element in both ophthalmological and cardiovascular disease diagnosis, the accurate segmentation of the retinal vessel tree has become the prerequisite step for automatic or computer-aided diagnosis systems. This thesis, therefore, has investigated different works of image segmentation algorithms and techniques, including unsupervised and supervised methods. Further, the thesis has developed and implemented two systems of the accurate retinal vessel segmentation. The methodologies explained and analyzed in this thesis, have been selected as the most efficient approaches to achieve higher precision, better robustness, and faster execution speed, to meet the strict standard of the modern medical imaging. Based on the intensive investigation and experiments, this thesis has proposed two outstanding implementations of the retinal blood vessel segmentation. The first implementation focuses on the fast, accurate and robust extraction of the retinal vessels using unsupervised techniques, by applying morphology-based global thresholding to draw the retinal venule structure and centerline detection to extract the capillaries. Besides, this system has been designed to minimize the computing complexity and to process multiple independent procedures in parallel. The second proposed system has especially focused on robustness and accuracy in regardless of execution time. This method has utilized the full convolutional neural network trained from a pre-trained semantic segmentation model, which is also called the transfer deep learning. This proposed method has simplified the typical retinal vessel segmentation problem from full-size image segmentation to regional vessel element recognition. Both of the implementations have outperformed their related works and have presented a remarkable scientific value for future computer-aided diagnosis applications. What’s more, this thesis is also a research guide which provide readers with the comprehensive knowledge on how to research on the task of retinal vessel segmentation

Self-Supervised Multimodal Reconstruction of Retinal Images Over Paired Datasets

[Abstract] Data scarcity represents an important constraint for the training of deep neural networks in medical imaging. Medical image labeling, especially if pixel-level annotations are required, is an expensive task that needs expert intervention and usually results in a reduced number of annotated samples. In contrast, extensive amounts of unlabeled data are produced in the daily clinical practice, including paired multimodal images from patients that were subjected to multiple imaging tests. This work proposes a novel self-supervised multimodal reconstruction task that takes advantage of this unlabeled multimodal data for learning about the domain without human supervision. Paired multimodal data is a rich source of clinical information that can be naturally exploited by trying to estimate one image modality from others. This multimodal reconstruction requires the recognition of domain-specific patterns that can be used to complement the training of image analysis tasks in the same domain for which annotated data is scarce. In this work, a set of experiments is performed using a multimodal setting of retinography and fluorescein angiography pairs that offer complementary information about the eye fundus. The evaluations performed on different public datasets, which include pathological and healthy data samples, demonstrate that a network trained for self-supervised multimodal reconstruction of angiography from retinography achieves unsupervised recognition of important retinal structures. These results indicate that the proposed self-supervised task provides relevant cues for image analysis tasks in the same domain.This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project, and by Ministerio de Economía, Industria y Competitividad, Government of Spain, through the DPI2015-69948-R research project. The authors of this work also receive financial support from the ERDF and Xunta de Galicia through Grupo de Referencia Competitiva, Ref. ED431C 2016-047, and from the European Social Fund (ESF) of the EU and Xunta de Galicia through the predoctoral grant contract Ref. ED481A-2017/328. CITIC, Centro de Investigación de Galicia Ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%)Xunta de Galicia; ED431C 2016-047Xunta de Galicia; ED481A-2017/328Xunta de Galicia; ED431G 2019/0

Retinal blood vessel segmentation: methods and implementations

Since the retinal blood vessel has been acknowledged as an indispensable element in both ophthalmological and cardiovascular disease diagnosis, the accurate segmentation of the retinal vessel tree has become the prerequisite step for automatic or computer-aided diagnosis systems. This thesis, therefore, has investigated different works of image segmentation algorithms and techniques, including unsupervised and supervised methods. Further, the thesis has developed and implemented two systems of the accurate retinal vessel segmentation. The methodologies explained and analyzed in this thesis, have been selected as the most efficient approaches to achieve higher precision, better robustness, and faster execution speed, to meet the strict standard of the modern medical imaging. Based on the intensive investigation and experiments, this thesis has proposed two outstanding implementations of the retinal blood vessel segmentation. The first implementation focuses on the fast, accurate and robust extraction of the retinal vessels using unsupervised techniques, by applying morphology-based global thresholding to draw the retinal venule structure and centerline detection to extract the capillaries. Besides, this system has been designed to minimize the computing complexity and to process multiple independent procedures in parallel. The second proposed system has especially focused on robustness and accuracy in regardless of execution time. This method has utilized the full convolutional neural network trained from a pre-trained semantic segmentation model, which is also called the transfer deep learning. This proposed method has simplified the typical retinal vessel segmentation problem from full-size image segmentation to regional vessel element recognition. Both of the implementations have outperformed their related works and have presented a remarkable scientific value for future computer-aided diagnosis applications. What’s more, this thesis is also a research guide which provide readers with the comprehensive knowledge on how to research on the task of retinal vessel segmentation

Retinal blood vessel segmentation: methods and implementations

Since the retinal blood vessel has been acknowledged as an indispensable element in both ophthalmological and cardiovascular disease diagnosis, the accurate segmentation of the retinal vessel tree has become the prerequisite step for automatic or computer-aided diagnosis systems. This thesis, therefore, has investigated different works of image segmentation algorithms and techniques, including unsupervised and supervised methods. Further, the thesis has developed and implemented two systems of the accurate retinal vessel segmentation. The methodologies explained and analyzed in this thesis, have been selected as the most efficient approaches to achieve higher precision, better robustness, and faster execution speed, to meet the strict standard of the modern medical imaging. Based on the intensive investigation and experiments, this thesis has proposed two outstanding implementations of the retinal blood vessel segmentation. The first implementation focuses on the fast, accurate and robust extraction of the retinal vessels using unsupervised techniques, by applying morphology-based global thresholding to draw the retinal venule structure and centerline detection to extract the capillaries. Besides, this system has been designed to minimize the computing complexity and to process multiple independent procedures in parallel. The second proposed system has especially focused on robustness and accuracy in regardless of execution time. This method has utilized the full convolutional neural network trained from a pre-trained semantic segmentation model, which is also called the transfer deep learning. This proposed method has simplified the typical retinal vessel segmentation problem from full-size image segmentation to regional vessel element recognition. Both of the implementations have outperformed their related works and have presented a remarkable scientific value for future computer-aided diagnosis applications. What’s more, this thesis is also a research guide which provide readers with the comprehensive knowledge on how to research on the task of retinal vessel segmentation

Deep learning for optical coherence tomography angiography: Quantifying microvascular changes in diabetic retinopathy

Optical Coherence Tomography Angiography (OCT-A) permits visualization of the changes to the retinal circulation due to diabetic retinopathy (DR), a microvascular complication of diabetes. Machine learning applications have directly benefited ophthalmology, leveraging large amounts of data to create frameworks to aid clinical decision-making. In this thesis, several techniques to quantify the retinal microvasculature are explored. First, high-quality, averaged, 6x6mm OCT-A enface images are used to produce manual segmentations for the corresponding lower-quality, single-frame images to produce more training data. Using transfer learning, the resulting convolutional neural network (CNN) segmented the superficial capillary plexus and deep vascular complex with performance exceeding inter-rater comparisons. Next, a federated learning framework was designed to allow for collaborative training by multiple participants on a de-centralized data corpus. When trained for microvasculature segmentation, the framework achieved comparable performance to a CNN trained on a fully-centralized dataset