Combining Fine- and Coarse-Grained Classifiers for Diabetic Retinopathy Detection

Visual artefacts of early diabetic retinopathy in retinal fundus images are usually small in size, inconspicuous, and scattered all over retina. Detecting diabetic retinopathy requires physicians to look at the whole image and fixate on some specific regions to locate potential biomarkers of the disease. Therefore, getting inspiration from ophthalmologist, we propose to combine coarse-grained classifiers that detect discriminating features from the whole images, with a recent breed of fine-grained classifiers that discover and pay particular attention to pathologically significant regions. To evaluate the performance of this proposed ensemble, we used publicly available EyePACS and Messidor datasets. Extensive experimentation for binary, ternary and quaternary classification shows that this ensemble largely outperforms individual image classifiers as well as most of the published works in most training setups for diabetic retinopathy detection. Furthermore, the performance of fine-grained classifiers is found notably superior than coarse-grained image classifiers encouraging the development of task-oriented fine-grained classifiers modelled after specialist ophthalmologists.Comment: Pages 12, Figures

Automated retinal analysis

Diabetes is a chronic disease affecting over 2% of the population in the UK [1]. Long-term complications of diabetes can affect many different systems of the body including the retina of the eye. In the retina, diabetes can lead to a disease called diabetic retinopathy, one of the leading causes of blindness in the working population of industrialised countries. The risk of visual loss from diabetic retinopathy can be reduced if treatment is given at the onset of sight-threatening retinopathy. To detect early indicators of the disease, the UK National Screening Committee have recommended that diabetic patients should receive annual screening by digital colour fundal photography [2]. Manually grading retinal images is a subjective and costly process requiring highly skilled staff. This thesis describes an automated diagnostic system based oil image processing and neural network techniques, which analyses digital fundus images so that early signs of sight threatening retinopathy can be identified. Within retinal analysis this research has concentrated on the development of four algorithms: optic nerve head segmentation, lesion segmentation, image quality assessment and vessel width measurements. This research amalgamated these four algorithms with two existing techniques to form an integrated diagnostic system. The diagnostic system when used as a 'pre-filtering' tool successfully reduced the number of images requiring human grading by 74.3%: this was achieved by identifying and excluding images without sight threatening maculopathy from manual screening

Automatic segmentation of exudates in colour retinal fundus images

This work aims at the development of an algorithm that allows the automatic detection of exudates in retinal fundus images. The detection of exudates allows diabetic retinopathy (DR) to be diagnosed, consequently it is an important task for the control and the treatment of people suffering DR. In addition, an increase of 35\% of people suffering from diabetes is predicted and, therefore, of people who will suffer from DR in the coming years. As a result, an important burden for ophthalmologists will be expected. For all this, it's highly needed the development of an automatic system for the detection of exudates. Two different algorithms are proposed. Background subtraction to deal with uneven illumination and mathematical morphology operators are used for exudate location. Finally, dynamic thresholding is applied for exudate segmentation. In the first algorithm dynamic thresholding is combined with the Kirsch edge detector. In the second one, a template and morphological operators are used to differentiate bright elements from exudates is used. The methods have been validated in three public datasets named e-ophta-EX, HEI-MED and DiaretDB1. The first two datasets have been used to validated the algorithms both at lesion level and image-level. However, DiaretDB1 was only used to validate the algorithms at image-level due to its ground truth does not mark exact boundaries of exudates. The results for the image-level validation are better for the second algorithm obtaining an AUC of 0.84, 0.75 and 0.84 for e-ophta-EX, HEI-MED and DiaretDB1, respectively. The results obtained with the evaluation at lesion-level are the same for the two methods and are quantified in terms of sensitivity and PPV. We have achieved values of sensitivity and PPV of 0.54 and 0.52, respectively, in e-ophta-EX and, 0.52 and 0.52, respectively, in HEI-MED for method 1. For method 2, we have obtained values for sensitivity and PPV of 0.5 and 0.57, respectively, for e-ophta-EX and 0.42 and 0.76, respectively, for HEI-MED.Outgoin

Rapid detection of diabetic retinopathy in retinal images: a new approach using transfer learning and synthetic minority over-sampling technique

The challenge of early detection of diabetic retinopathy (DR), a leading cause of vision loss in working-age individuals in developed nations, was addressed in this study. Current manual analysis of digital color fundus photographs by clinicians, although thorough, suffers from slow result turnaround, delaying necessary treatment. To expedite detection and improve treatment timeliness, a novel automated detection system for DR was developed. This system utilized convolutional neural networks. Visual geometry group 16-layer network (VGG16), a pre-trained deep learning model, for feature extraction from retinal images and the synthetic minority over-sampling technique (SMOTE) to handle class imbalance in the dataset. The system was designed to classify images into five categories: normal, mild DR, moderate DR, severe DR, and proliferative DR (PDR). Assessment of the system using the Kaggle diabetic retinopathy dataset resulted in a promising 93.94% accuracy during the training phase and 88.19% during validation. These results highlight the system's potential to enhance DR diagnosis speed and efficiency, leading to improved patient outcomes. The study concluded that automation and artificial intelligence (AI) could play a significant role in timely and efficient disease detection and management

Automatic delimitation of the clinical region of interest in ultra-wide field of view images of the retina

Retinal ultra-wide field of view images (fundus images) provides the visu-alization of a large part of the retina though, artifacts may appear in those images. Eyelashes and eyelids often cover the clinical region of interest and worse, eye-lashes can be mistaken with arteries and/or veins when those images are put through automatic diagnosis or segmentation software creating, in those cases, the appearance of false positives results. Correcting this problem, the first step in the development of qualified auto-matic diseases diagnosis programs can be done and in that way the development of an objective tool to assess diseases eradicating the human error from those processes can also be achieved. In this work the development of a tool that automatically delimitates the clinical region of interest is proposed by retrieving features from the images that will be analyzed by an automatic classifier. This automatic classifier will evaluate the information and will decide which part of the image is of interest and which part contains artifacts. The results were validated by implementing a software in C# language and validated through a statistical analysis. From those results it was confirmed that the methodology presented is capable of detecting artifacts and selecting the clin-ical region of interest in fundus images of the retina

Psychiatric Case Record

Bipolar Disorder-Mania: Patient was apparently normal one-month back, Then all of a sudden he developed sleep disturbances –mainly difficult in initiation of sleep. He also started abusing his family members for unwanted things. Subsequently, he started talking excessively and irritable. Sometimes he sings film songs and dances. He used to say that God Supreme exists in himself and so he has all the powers of Almighty. With that superior power he says that he can solve all the problems in this world. He also says that he has invented herbs to keep people young. For the past one week, he talks excessively without having an hour of sleep & wanders here and there & found excessively smoking. He becomes excessively spiritual and goes to near by villages for offering prayers to God. He takes only a little food everyday and he is very much keen in personal cleanliness. Paranoid Schizophrenia: She was apparently normal 8 months back, then she developed sleep disturbances in the form of difficult in falling asleep. She was found talking & smiling to herself at night & day with mirror gazing. She started saying that her neighbour & relatives are planning to kill herself by poisoning. In this context she had frequent quarrels with them and she refused to take food prepared by her mother in law. She left the home at night without informing any one and started wandering in the road side near her home. She was complaining that she hears voices as if her neighbour & relatives were talking about her among themselves She was not doing house hold activities for past 6 months and she was not taking care of her child. Her personal hygiene was very much deteriorated slowly as she used to take bath & brush, only if she was asked to do so. She started abusing & assaulting the strangers and family members. Generalised Anxiety Disorder: Six months back he was apparently normal. He is working as a system analyst in a private bank . He had once, made a mistake in his bank work for which he was given charges by his employer, followed this event he becomes very tense and afraid whenever his boss called him. He is very cautious that he should not commit any mistakes. Even though he is not doing so, he fears that he may commit some mistake in his work. At that moment he develops palpitation, giddiness, breathlessness, excessive sweating over palms and soles. Slowly these symptoms present through out the day even when he was not in his office, and he could not control his fearfulness. For the past 6 months he didn’t sleep well. His sleep is disturbed by bad dreams. Recurrent Depressive Disorder: Patient was apparently alright 2 months back. Then she developed sleep disturbances particularly early morning awakening, she use to wake up by 3.00 am and use to brood about herself and started crying. She was not doing her domestic work as before, as she felt excess tiredness and use to take frequent rests. She developed poor communication. She had lost her interest in pleasurable activities and was not interested in watching TV, and attending family gatherings. She stayed aloof most of the time & calm, quiet and withdrawn. She was expressing her helplessness and hopelessness about the future. She started to have decline in maintaining self care. 15 days back, she frequently expressed suicidal ideas and she had attempted suicide by hanging herself and was rescued by neighbours. 5 days back, she started talking in an irrelevant manner. She was smiling to self. She was assaulting her family members. She was suspicious that her neighbour had done black magic on her and also saying that people are talking about her. She reported hearing the voice of her neighbour scolding and threatening her. Organic Brain Syndrome – Dementia: Ten months back he was apparently alright. Then his relatives noticed himself frequently misplaces things inside his home. Then he started behaving aggressively. He was beating his wife without reason. He was roaming here and there, running out of home and wandering aimlessly. He was not able to come back home when he goes out. He was brought back to home by his relatives. Slowly he developed fearfulness and tremulousness while he was staying alone. He also started saying that his family members & neighbours were talking about himself, in this context he would make frequent quarrels with them. He also started hearing voices of known male voices abusing himself in third person. He sleeps for few hour only. He is passing urine and motion inside the house. He is asking about his brother and mother-in-law who were expired long back. He behaves abnormally such as pouring water in the plate while eating. And his relatives found the symptoms were worsened by evening. All these symptoms started insidiously, increased in severity through time and attained the present state. No history of loss of appetite / crying spells / suicidal tendencies / convulsions / fever / head injury

Klasifikasi Penyakit Diabetik Retinopathy dengan Metode Naïve Bayes pada Citra Retina

Diabetik retinopathy (DR) merupakan efek dari diabetes yang terjadi karena kerusakan pembuluh darah retina dengan memperbesar dan mengeluarkan cairan komplikasi diabetes yang mempengaruhi mata. Deteksi penyakit ini dapat dilihat melalui eksudat dan mikroaneurisma. Pada penelitian ini kami menggunakan metode Naïve Bayes untuk pengklasifikasian  menggunakan tiga kelas klasifikasi yaitu Normal, NPDR, dan PDR. Dari hasil penelitian mendapatkan akurasi 93%

Computational Analysis of Fundus Images: Rule-Based and Scale-Space Models

Fundus images are one of the most important imaging examinations in modern ophthalmology because they are simple, inexpensive and, above all, noninvasive. Nowadays, the acquisition and storage of highresolution fundus images is relatively easy and fast. Therefore, fundus imaging has become a fundamental investigation in retinal lesion detection, ocular health monitoring and screening programmes. Given the large volume and clinical complexity associated with these images, their analysis and interpretation by trained clinicians becomes a timeconsuming task and is prone to human error. Therefore, there is a growing interest in developing automated approaches that are affordable and have high sensitivity and specificity. These automated approaches need to be robust if they are to be used in the general population to diagnose and track retinal diseases. To be effective, the automated systems must be able to recognize normal structures and distinguish them from pathological clinical manifestations. The main objective of the research leading to this thesis was to develop automated systems capable of recognizing and segmenting retinal anatomical structures and retinal pathological clinical manifestations associated with the most common retinal diseases. In particular, these automated algorithms were developed on the premise of robustness and efficiency to deal with the difficulties and complexity inherent in these images. Four objectives were considered in the analysis of fundus images. Segmentation of exudates, localization of the optic disc, detection of the midline of blood vessels, segmentation of the vascular network and detection of microaneurysms. In addition, we also evaluated the detection of diabetic retinopathy on fundus images using the microaneurysm detection method. An overview of the state of the art is presented to compare the performance of the developed approaches with the main methods described in the literature for each of the previously described objectives. To facilitate the comparison of methods, the state of the art has been divided into rulebased methods and machine learningbased methods. In the research reported in this paper, rulebased methods based on image processing methods were preferred over machine learningbased methods. In particular, scalespace methods proved to be effective in achieving the set goals. Two different approaches to exudate segmentation were developed. The first approach is based on scalespace curvature in combination with the local maximum of a scalespace blob detector and dynamic thresholds. The second approach is based on the analysis of the distribution function of the maximum values of the noise map in combination with morphological operators and adaptive thresholds. Both approaches perform a correct segmentation of the exudates and cope well with the uneven illumination and contrast variations in the fundus images. Optic disc localization was achieved using a new technique called cumulative sum fields, which was combined with a vascular enhancement method. The algorithm proved to be reliable and efficient, especially for pathological images. The robustness of the method was tested on 8 datasets. The detection of the midline of the blood vessels was achieved using a modified corner detector in combination with binary philtres and dynamic thresholding. Segmentation of the vascular network was achieved using a new scalespace blood vessels enhancement method. The developed methods have proven effective in detecting the midline of blood vessels and segmenting vascular networks. The microaneurysm detection method relies on a scalespace microaneurysm detection and labelling system. A new approach based on the neighbourhood of the microaneurysms was used for labelling. Microaneurysm detection enabled the assessment of diabetic retinopathy detection. The microaneurysm detection method proved to be competitive with other methods, especially with highresolution images. Diabetic retinopathy detection with the developed microaneurysm detection method showed similar performance to other methods and human experts. The results of this work show that it is possible to develop reliable and robust scalespace methods that can detect various anatomical structures and pathological features of the retina. Furthermore, the results obtained in this work show that although recent research has focused on machine learning methods, scalespace methods can achieve very competitive results and typically have greater independence from image acquisition. The methods developed in this work may also be relevant for the future definition of new descriptors and features that can significantly improve the results of automated methods.As imagens do fundo do olho são hoje um dos principais exames imagiológicos da oftalmologia moderna, pela sua simplicidade, baixo custo e acima de tudo pelo seu carácter nãoinvasivo. A aquisição e armazenamento de imagens do fundo do olho com alta resolução é também relativamente simples e rápida. Desta forma, as imagens do fundo do olho são um exame fundamental na identificação de alterações retinianas, monitorização da saúde ocular, e em programas de rastreio. Considerando o elevado volume e complexidade clínica associada a estas imagens, a análise e interpretação das mesmas por clínicos treinados tornase uma tarefa morosa e propensa a erros humanos. Assim, há um interesse crescente no desenvolvimento de abordagens automatizadas, acessíveis em custo, e com uma alta sensibilidade e especificidade. Estas devem ser robustas para serem aplicadas à população em geral no diagnóstico e seguimento de doenças retinianas. Para serem eficazes, os sistemas de análise têm que conseguir detetar e distinguir estruturas normais de sinais patológicos. O objetivo principal da investigação que levou a esta tese de doutoramento é o desenvolvimento de sistemas automáticos capazes de detetar e segmentar as estruturas anatómicas da retina, e os sinais patológicos retinianos associados às doenças retinianas mais comuns. Em particular, estes algoritmos automatizados foram desenvolvidos segundo as premissas de robustez e eficácia para lidar com as dificuldades e complexidades inerentes a estas imagens. Foram considerados quatro objetivos de análise de imagens do fundo do olho. São estes, a segmentação de exsudados, a localização do disco ótico, a deteção da linha central venosa dos vasos sanguíneos e segmentação da rede vascular, e a deteção de microaneurismas. De acrescentar que usando o método de deteção de microaneurismas, avaliouse também a capacidade de deteção da retinopatia diabética em imagens do fundo do olho. Para comparar o desempenho das metodologias desenvolvidas neste trabalho, foi realizado um levantamento do estado da arte, onde foram considerados os métodos mais relevantes descritos na literatura para cada um dos objetivos descritos anteriormente. Para facilitar a comparação entre métodos, o estado da arte foi dividido em metodologias de processamento de imagem e baseadas em aprendizagem máquina. Optouse no trabalho de investigação desenvolvido pela utilização de metodologias de análise espacial de imagem em detrimento de metodologias baseadas em aprendizagem máquina. Em particular, as metodologias baseadas no espaço de escalas mostraram ser efetivas na obtenção dos objetivos estabelecidos. Para a segmentação de exsudados foram usadas duas abordagens distintas. A primeira abordagem baseiase na curvatura em espaço de escalas em conjunto com a resposta máxima local de um detetor de manchas em espaço de escalas e limiares dinâmicos. A segunda abordagem baseiase na análise do mapa de distribuição de ruído em conjunto com operadores morfológicos e limiares adaptativos. Ambas as abordagens fazem uma segmentação dos exsudados de elevada precisão, além de lidarem eficazmente com a iluminação nãouniforme e a variação de contraste presente nas imagens do fundo do olho. A localização do disco ótico foi conseguida com uma nova técnica designada por campos de soma acumulativos, combinada com métodos de melhoramento da rede vascular. O algoritmo revela ser fiável e eficiente, particularmente em imagens patológicas. A robustez do método foi verificada pela sua avaliação em oito bases de dados. A deteção da linha central dos vasos sanguíneos foi obtida através de um detetor de cantos modificado em conjunto com filtros binários e limiares dinâmicos. A segmentação da rede vascular foi conseguida com um novo método de melhoramento de vasos sanguíneos em espaço de escalas. Os métodos desenvolvidos mostraram ser eficazes na deteção da linha central dos vasos sanguíneos e na segmentação da rede vascular. Finalmente, o método para a deteção de microaneurismas assenta num formalismo de espaço de escalas na deteção e na rotulagem dos microaneurismas. Para a rotulagem foi utilizada uma nova abordagem da vizinhança dos candidatos a microaneurismas. A deteção de microaneurismas permitiu avaliar também a deteção da retinopatia diabética. O método para a deteção de microaneurismas mostrou ser competitivo quando comparado com outros métodos, em particular em imagens de alta resolução. A deteção da retinopatia diabética exibiu um desempenho semelhante a outros métodos e a especialistas humanos. Os trabalhos descritos nesta tese mostram ser possível desenvolver uma abordagem fiável e robusta em espaço de escalas capaz de detetar diferentes estruturas anatómicas e sinais patológicos da retina. Além disso, os resultados obtidos mostram que apesar de a pesquisa mais recente concentrarse em metodologias de aprendizagem máquina, as metodologias de análise espacial apresentam resultados muito competitivos e tipicamente independentes do equipamento de aquisição das imagens. As metodologias desenvolvidas nesta tese podem ser importantes na definição de novos descritores e características, que podem melhorar significativamente o resultado de métodos automatizados

Optic Nerve Changes in Diabetic Retinopathy

Diabetic retinopathy (DR) is a devastating sight-threatening complication of diabetes mellitus (DM). Besides damaging the vascular system of the retina, DM will also destruct the tissue surrounding the retina, including the optic nerve. DR impairs the optic nerve by damaging its conduction and integrity. There are few clinical manifestations of optic nerve changes in DR such as diabetic papillopathy, neovascularization of optic disc, and optic nerve atrophy. These involve metabolic alterations related to DM, production of advanced glycation end products (AGEs), oxidative stress, and hemodynamic changes. Diagnostic tests including visual evoked potential (VEP) and optical coherence tomography (OCT) can detect functional and structural changes. This finding is important as it may reflect the early loss of retinal ganglion cell axons. As the neuronal loss is irreversible, it is pivotal to be able to screen these nervous system changes in the early stage of DR and prevent further deterioration