Exudate segmentation using fully convolutional neural networks and inception modules

Diabetic retinopathy is an eye disease associated with diabetes mellitus and also it is the leading cause of preventable blindness in working-age population. Early detection and treatment of DR is essential to prevent vision loss. Exudates are one of the earliest signs of diabetic retinopathy. This paper proposes an automatic method for the detection and segmentation of exudates in fundus photographies. A novel fully convolutional neural network architecture with Inception modules is proposed. Compared to other methods it does not require the removal of other anatomical structures. Furthermore, a transfer learning approach is applied between small datasets of different modalities from the same domain. To the best of authors’ knowledge, it is the first time that such approach has been used in the exudate segmentation domain. The proposed method was evaluated using publicly available E-Ophtha datasets. It achieved better results than the state-of-the-art methods in terms of sensitivity and specificity metrics. The proposed algorithm accomplished better results using a diseased/not diseased evaluation scenario which indicates its applicability for screening purposes. Simplicity, performance, efficiency and robustness of the proposed method demonstrate its suitability for diabetic retinopathy screening applications

Different Exudates Segmentation Techniques in Fundus Images of Diabetic Retinopathy

Now a day’s Diabetic retinopathy is a serious medical issue that mainly harm the human retina and finely vision blindness. The analysis of the Retinal images is done through different diagnosis methods in modern Ophthalmology. There are different methods available for segmentation of the exudates in the fundus retinal images. These methods are used for non-intrusive diagnosis for the eye diseases. Exudates are the manifestations of DR. This paper has demonstrated different methods of exudates segmentation with its advantages and constraints. Accordingly in this paper overview the various main elements of the retina. All examined systems have enhanced the execution in terms of accuracy, specificity and sensitivity. The examination has demonstrated that ant colony optimization based segmentation has better outcomes over each systems

Color Feature Segmentation Image for Identification of Cotton Wool Spots on Diabetic Retinopathy Fundus

Fundus is an image of the inner eye surface in the form of a colored image. This image has a lot of pixel values because it consists of three basic color components. The three colors are red, green, and blue, so they need a good technique in analyzing this image. This image can be used to diagnose diabetic retinal disease caused by diabetes mellitus. This disease can interfere with human vision because objects that cover the retina of the eye is called Cotton Wool Spot (CWS). The severity of this disease can be observed from the large area of the CWS covering the retina. This study aims to calculate the exact area ratio of CWS with the retina area. The method used in this research is Image Color Feature Segmentation (ICFS). This method has four stages, namely preprocessing, segmentation, feature extraction, and feature areas. The dataset processed in this study was sourced from the Radiology Department, General Hospital of M. Djamil Padang. The dataset consists of 16 fundus images of patients who were treated at the hospital. The results of this study can identify and calculate the percentage of retinal damage is very well. Therefore, this study can be a reference in measuring the severity of diabetic retinopathy for prevention and subsequent treatment for patients and doctors

Ant Colony Optimization Based Exudates Segmentation of Fundus Images

Now a days, Diabetic Retinopathy is a deadly form of disease. Diabetic retinopathy is a complication of diabetes and a leading cause of blindness. It occurs when diabetes damages the tiny blood vessels inside the retina, the light-sensitive tissue at the back of the eye. Exudates of diabetic retinopathy appears as white or yellow in color. Early detection of diabetic retinopathy is not possible as patients are generally asymptomatic.  Exudates are frequently observed with microaneurysms. These methods are noise presence, low contrast, uneven illumination, and color variation. Therefore, in order to overcome the above stated issues computer aided diagnosis for exudates segmentation is needed. This proposed system first preprocesses the fundus image of human retina which is followed by image segmentation in which exudates are segmented. Proposed study segments the exudates using Ant Colony optimization Algorithm. The algorithm’s performance was evaluated with a dataset available online. Classification is performed on segmented image to classifying the image as Normal retina and diabetic retinopathy retina

Diabetic retinopathy diagnosis through multi-agent approaches

Programa Doutoral em Engenharia BiomédicaDiabetic retinopathy has been revealed as a serious public health problem in occidental world, since it is the most common cause of vision impairment among people of working age. The early diagnosis and an adequate treatment can prevent loss of vision. Thus, a regular screening program to detect diabetic retinopathy in the early stages could be efficient for the prevention of blindness. Due to its characteristics, digital color fundus photographs have been the preferred eye examination method adopted in these programs. Nevertheless, due to the growing incidence of diabetes in population, ophthalmologists have to observe a huge number of images. Therefore, the development of computational tools that can assist the diagnosis is of major importance. Several works have been published in the recent past years for this purpose; but an automatic system for clinical practice has yet to come. In general, these algorithms are used to normalize, segment and extract information from images to be utilized by classifiers which aim to classify the regions of the fundus image. These methods are mostly based on global approaches that cannot be locally adapted to the image properties and therefore, none of them perform as needed because of fundus images complexity. This thesis focuses on the development of new tools based on multi-agent approaches, to assist the diabetic retinopathy early diagnosis. The fundus image automatic segmentation concerning the diabetic retinopathy diagnosis should comprise both pathological (dark and bright lesions) and anatomical features (optic disc, blood vessels and fovea). In that way, systems for the optic disc detection, bright lesions segmentation, blood vessels segmentation and dark lesions segmentation were implemented and, when possible, compared to those approaches already described in literature. Two kinds of agent based systems were investigated and applied to digital color fundus photographs: ant colony system and multi-agent system composed of reactive agents with interaction mechanisms between them. The ant colony system was used to the optic disc detection and for bright lesion segmentation. Multi-agent system models were developed for the blood vessel segmentation and for small dark lesion segmentation. The multi-agent system models created in this study are not image processing techniques on their own, but they are used as tools to improve the traditional algorithms results at the micro level. The results of all the proposed approaches are very promising and reveal that the systems created perform better than other recent methods described in the literature. Therefore, the main scientific contribution of this thesis is to prove that multi-agent systems based approaches can be efficient in segmenting structures in retinal images. Such an approach overcomes the classic image processing algorithms that are limited to macro results and do not consider the local characteristics of images. Hence, multi-agent systems based approaches could be a fundamental tool, responsible for a very efficient system development to be used in screening programs concerning diabetic retinopathy early diagnosis.A retinopatia diabética tem-se revelado como um problema sério de saúde pública no mundo ocidental, uma vez que é a principal causa de cegueira entre as pessoas em idade ativa. Contudo, a perda de visão pode ser prevenida através da deteção precoce da doença e de um tratamento adequado. Por isso, um programa regular de rastreio e monitorização da retinopatia diabética pode ser eficiente na prevenção da deterioração da visão. Devido às suas características, a fotografia digital colorida do fundo do olho tem sido o exame adotado neste tipo de programas. No entanto, devido ao aumento da incidência da diabetes na população, o número de imagens a serem analisadas pelos oftalmologistas é elevado. Assim sendo, é muito importante o desenvolvimento de ferramentas computacionais para auxiliar no diagnóstico desta patologia. Nos últimos anos, têm sido vários os trabalhos publicados com este propósito; porém, não existe ainda um sistema automático (ou recomendável) para ser usado nas práticas clínicas. No geral, estes algoritmos são usados para normalizar, segmentar e extrair informação das imagens que vai ser utilizada por classificadores, cujo objetivo é identificar as regiões da imagem que se procuram. Estes métodos são maioritariamente baseados em abordagens globais que não podem ser localmente adaptadas às propriedades das imagens e, portanto, nenhum apresenta a performance necessária devido à complexidade das imagens do fundo do olho. Esta tese foca-se no desenvolvimento de novas ferramentas computacionais baseadas em sistemas multi-agente, para auxiliar na deteção precoce da retinopatia diabética. A segmentação automática das imagens do fundo do olho com o objetivo de diagnosticar a retinopatia diabética, deve englobar características patológicas (lesões claras e escuras) e anatómicas (disco ótico, vasos sanguíneos e fóvea). Deste modo, foram criados sistemas para a deteção do disco ótico e para a segmentação das lesões claras, dos vasos sanguíneos e das lesões escuras e, quando possível, estes foram comparados com abordagens já descritas na literatura. Dois tipos de sistemas baseados em agentes foram investigados e aplicados nas imagens digitais coloridas do fundo do olho: sistema de colónia de formigas e sistema multi-agente constituído por agentes reativos e com mecanismos de interação entre eles. O sistema de colónia de formigas foi usado para a deteção do disco ótico e para a segmentação das lesões claras. Modelos de sistemas multi-agente foram desenvolvidos para a segmentação dos vasos sanguíneos e das lesões escuras. Os modelos multi-agentes criados ao longo deste estudo não são por si só técnicas de processamento de imagem, mas são sim usados como ferramentas para melhorar os resultados dos algoritmos tradicionais no baixo nível. Os resultados de todas as abordagens propostas são muito promissores e revelam que os sistemas criados apresentam melhor performance que outras abordagens recentes descritas na literatura. Posto isto, a maior contribuição científica desta tese é provar que abordagens baseadas em sistemas multi-agente podem ser eficientes na segmentação de estruturas em imagens da retina. Uma abordagem deste tipo ultrapassa os algoritmos clássicos de processamento de imagem, que se limitam aos resultados de alto nível e não têm em consideração as propriedades locais das imagens. Portanto, as abordagens baseadas em sistemas multi-agente podem ser uma ferramenta fundamental, responsável pelo desenvolvimento de um sistema eficiente para ser usado nos programas de rastreio e monitorização da retinopatia diabética.Work supported by FEDER funds through the "Programa Operacional Factores de Competitividade – COMPETE" and by national funds by FCT- Fundação para a Ciência e a Tecnologia. C. Pereira thanks the FCT for the SFRH / BD / 61829 / 2009 grant

Automatic segmentation of exudates in colour retinal fundus images

This work aims at the development of an algorithm that allows the automatic detection of exudates in retinal fundus images. The detection of exudates allows diabetic retinopathy (DR) to be diagnosed, consequently it is an important task for the control and the treatment of people suffering DR. In addition, an increase of 35\% of people suffering from diabetes is predicted and, therefore, of people who will suffer from DR in the coming years. As a result, an important burden for ophthalmologists will be expected. For all this, it's highly needed the development of an automatic system for the detection of exudates. Two different algorithms are proposed. Background subtraction to deal with uneven illumination and mathematical morphology operators are used for exudate location. Finally, dynamic thresholding is applied for exudate segmentation. In the first algorithm dynamic thresholding is combined with the Kirsch edge detector. In the second one, a template and morphological operators are used to differentiate bright elements from exudates is used. The methods have been validated in three public datasets named e-ophta-EX, HEI-MED and DiaretDB1. The first two datasets have been used to validated the algorithms both at lesion level and image-level. However, DiaretDB1 was only used to validate the algorithms at image-level due to its ground truth does not mark exact boundaries of exudates. The results for the image-level validation are better for the second algorithm obtaining an AUC of 0.84, 0.75 and 0.84 for e-ophta-EX, HEI-MED and DiaretDB1, respectively. The results obtained with the evaluation at lesion-level are the same for the two methods and are quantified in terms of sensitivity and PPV. We have achieved values of sensitivity and PPV of 0.54 and 0.52, respectively, in e-ophta-EX and, 0.52 and 0.52, respectively, in HEI-MED for method 1. For method 2, we have obtained values for sensitivity and PPV of 0.5 and 0.57, respectively, for e-ophta-EX and 0.42 and 0.76, respectively, for HEI-MED.Outgoin

Computational Analysis of Fundus Images: Rule-Based and Scale-Space Models

Fundus images are one of the most important imaging examinations in modern ophthalmology because they are simple, inexpensive and, above all, noninvasive. Nowadays, the acquisition and storage of highresolution fundus images is relatively easy and fast. Therefore, fundus imaging has become a fundamental investigation in retinal lesion detection, ocular health monitoring and screening programmes. Given the large volume and clinical complexity associated with these images, their analysis and interpretation by trained clinicians becomes a timeconsuming task and is prone to human error. Therefore, there is a growing interest in developing automated approaches that are affordable and have high sensitivity and specificity. These automated approaches need to be robust if they are to be used in the general population to diagnose and track retinal diseases. To be effective, the automated systems must be able to recognize normal structures and distinguish them from pathological clinical manifestations. The main objective of the research leading to this thesis was to develop automated systems capable of recognizing and segmenting retinal anatomical structures and retinal pathological clinical manifestations associated with the most common retinal diseases. In particular, these automated algorithms were developed on the premise of robustness and efficiency to deal with the difficulties and complexity inherent in these images. Four objectives were considered in the analysis of fundus images. Segmentation of exudates, localization of the optic disc, detection of the midline of blood vessels, segmentation of the vascular network and detection of microaneurysms. In addition, we also evaluated the detection of diabetic retinopathy on fundus images using the microaneurysm detection method. An overview of the state of the art is presented to compare the performance of the developed approaches with the main methods described in the literature for each of the previously described objectives. To facilitate the comparison of methods, the state of the art has been divided into rulebased methods and machine learningbased methods. In the research reported in this paper, rulebased methods based on image processing methods were preferred over machine learningbased methods. In particular, scalespace methods proved to be effective in achieving the set goals. Two different approaches to exudate segmentation were developed. The first approach is based on scalespace curvature in combination with the local maximum of a scalespace blob detector and dynamic thresholds. The second approach is based on the analysis of the distribution function of the maximum values of the noise map in combination with morphological operators and adaptive thresholds. Both approaches perform a correct segmentation of the exudates and cope well with the uneven illumination and contrast variations in the fundus images. Optic disc localization was achieved using a new technique called cumulative sum fields, which was combined with a vascular enhancement method. The algorithm proved to be reliable and efficient, especially for pathological images. The robustness of the method was tested on 8 datasets. The detection of the midline of the blood vessels was achieved using a modified corner detector in combination with binary philtres and dynamic thresholding. Segmentation of the vascular network was achieved using a new scalespace blood vessels enhancement method. The developed methods have proven effective in detecting the midline of blood vessels and segmenting vascular networks. The microaneurysm detection method relies on a scalespace microaneurysm detection and labelling system. A new approach based on the neighbourhood of the microaneurysms was used for labelling. Microaneurysm detection enabled the assessment of diabetic retinopathy detection. The microaneurysm detection method proved to be competitive with other methods, especially with highresolution images. Diabetic retinopathy detection with the developed microaneurysm detection method showed similar performance to other methods and human experts. The results of this work show that it is possible to develop reliable and robust scalespace methods that can detect various anatomical structures and pathological features of the retina. Furthermore, the results obtained in this work show that although recent research has focused on machine learning methods, scalespace methods can achieve very competitive results and typically have greater independence from image acquisition. The methods developed in this work may also be relevant for the future definition of new descriptors and features that can significantly improve the results of automated methods.As imagens do fundo do olho são hoje um dos principais exames imagiológicos da oftalmologia moderna, pela sua simplicidade, baixo custo e acima de tudo pelo seu carácter nãoinvasivo. A aquisição e armazenamento de imagens do fundo do olho com alta resolução é também relativamente simples e rápida. Desta forma, as imagens do fundo do olho são um exame fundamental na identificação de alterações retinianas, monitorização da saúde ocular, e em programas de rastreio. Considerando o elevado volume e complexidade clínica associada a estas imagens, a análise e interpretação das mesmas por clínicos treinados tornase uma tarefa morosa e propensa a erros humanos. Assim, há um interesse crescente no desenvolvimento de abordagens automatizadas, acessíveis em custo, e com uma alta sensibilidade e especificidade. Estas devem ser robustas para serem aplicadas à população em geral no diagnóstico e seguimento de doenças retinianas. Para serem eficazes, os sistemas de análise têm que conseguir detetar e distinguir estruturas normais de sinais patológicos. O objetivo principal da investigação que levou a esta tese de doutoramento é o desenvolvimento de sistemas automáticos capazes de detetar e segmentar as estruturas anatómicas da retina, e os sinais patológicos retinianos associados às doenças retinianas mais comuns. Em particular, estes algoritmos automatizados foram desenvolvidos segundo as premissas de robustez e eficácia para lidar com as dificuldades e complexidades inerentes a estas imagens. Foram considerados quatro objetivos de análise de imagens do fundo do olho. São estes, a segmentação de exsudados, a localização do disco ótico, a deteção da linha central venosa dos vasos sanguíneos e segmentação da rede vascular, e a deteção de microaneurismas. De acrescentar que usando o método de deteção de microaneurismas, avaliouse também a capacidade de deteção da retinopatia diabética em imagens do fundo do olho. Para comparar o desempenho das metodologias desenvolvidas neste trabalho, foi realizado um levantamento do estado da arte, onde foram considerados os métodos mais relevantes descritos na literatura para cada um dos objetivos descritos anteriormente. Para facilitar a comparação entre métodos, o estado da arte foi dividido em metodologias de processamento de imagem e baseadas em aprendizagem máquina. Optouse no trabalho de investigação desenvolvido pela utilização de metodologias de análise espacial de imagem em detrimento de metodologias baseadas em aprendizagem máquina. Em particular, as metodologias baseadas no espaço de escalas mostraram ser efetivas na obtenção dos objetivos estabelecidos. Para a segmentação de exsudados foram usadas duas abordagens distintas. A primeira abordagem baseiase na curvatura em espaço de escalas em conjunto com a resposta máxima local de um detetor de manchas em espaço de escalas e limiares dinâmicos. A segunda abordagem baseiase na análise do mapa de distribuição de ruído em conjunto com operadores morfológicos e limiares adaptativos. Ambas as abordagens fazem uma segmentação dos exsudados de elevada precisão, além de lidarem eficazmente com a iluminação nãouniforme e a variação de contraste presente nas imagens do fundo do olho. A localização do disco ótico foi conseguida com uma nova técnica designada por campos de soma acumulativos, combinada com métodos de melhoramento da rede vascular. O algoritmo revela ser fiável e eficiente, particularmente em imagens patológicas. A robustez do método foi verificada pela sua avaliação em oito bases de dados. A deteção da linha central dos vasos sanguíneos foi obtida através de um detetor de cantos modificado em conjunto com filtros binários e limiares dinâmicos. A segmentação da rede vascular foi conseguida com um novo método de melhoramento de vasos sanguíneos em espaço de escalas. Os métodos desenvolvidos mostraram ser eficazes na deteção da linha central dos vasos sanguíneos e na segmentação da rede vascular. Finalmente, o método para a deteção de microaneurismas assenta num formalismo de espaço de escalas na deteção e na rotulagem dos microaneurismas. Para a rotulagem foi utilizada uma nova abordagem da vizinhança dos candidatos a microaneurismas. A deteção de microaneurismas permitiu avaliar também a deteção da retinopatia diabética. O método para a deteção de microaneurismas mostrou ser competitivo quando comparado com outros métodos, em particular em imagens de alta resolução. A deteção da retinopatia diabética exibiu um desempenho semelhante a outros métodos e a especialistas humanos. Os trabalhos descritos nesta tese mostram ser possível desenvolver uma abordagem fiável e robusta em espaço de escalas capaz de detetar diferentes estruturas anatómicas e sinais patológicos da retina. Além disso, os resultados obtidos mostram que apesar de a pesquisa mais recente concentrarse em metodologias de aprendizagem máquina, as metodologias de análise espacial apresentam resultados muito competitivos e tipicamente independentes do equipamento de aquisição das imagens. As metodologias desenvolvidas nesta tese podem ser importantes na definição de novos descritores e características, que podem melhorar significativamente o resultado de métodos automatizados