76 research outputs found
Recommended from our members
A model of ganglion axon pathways accounts for percepts elicited by retinal implants.
Degenerative retinal diseases such as retinitis pigmentosa and macular degeneration cause irreversible vision loss in more than 10 million people worldwide. Retinal prostheses, now implanted in over 250 patients worldwide, electrically stimulate surviving cells in order to evoke neuronal responses that are interpreted by the brain as visual percepts ('phosphenes'). However, instead of seeing focal spots of light, current implant users perceive highly distorted phosphenes that vary in shape both across subjects and electrodes. We characterized these distortions by asking users of the Argus retinal prosthesis system (Second Sight Medical Products Inc.) to draw electrically elicited percepts on a touchscreen. Using ophthalmic fundus imaging and computational modeling, we show that elicited percepts can be accurately predicted by the topographic organization of optic nerve fiber bundles in each subject's retina, successfully replicating visual percepts ranging from 'blobs' to oriented 'streaks' and 'wedges' depending on the retinal location of the stimulating electrode. This provides the first evidence that activation of passing axon fibers accounts for the rich repertoire of phosphene shape commonly reported in psychophysical experiments, which can severely distort the quality of the generated visual experience. Overall our findings argue for more detailed modeling of biological detail across neural engineering applications
Segmentation and Characterization of Small Retinal Vessels in Fundus Images Using the Tensor Voting Approach
RÉSUMÉ
La rétine permet de visualiser facilement une partie du réseau vasculaire humain. Elle offre
ainsi un aperçu direct sur le développement et le résultat de certaines maladies liées au réseau
vasculaire dans son entier. Chaque complication visible sur la rétine peut avoir un impact sur
la capacité visuelle du patient. Les plus petits vaisseaux sanguins sont parmi les premières
structures anatomiques affectées par la progression d’une maladie, être capable de les analyser
est donc crucial. Les changements dans l’état, l’aspect, la morphologie, la fonctionnalité, ou
même la croissance des petits vaisseaux indiquent la gravité des maladies.
Le diabète est une maladie métabolique qui affecte des millions de personnes autour
du monde. Cette maladie affecte le taux de glucose dans le sang et cause des changements
pathologiques dans différents organes du corps humain. La rétinopathie diabétique décrit l’en-
semble des conditions et conséquences du diabète au niveau de la rétine. Les petits vaisseaux
jouent un rôle dans le déclenchement, le développement et les conséquences de la rétinopa-
thie. Dans les dernières étapes de cette maladie, la croissance des nouveaux petits vaisseaux,
appelée néovascularisation, présente un risque important de provoquer la cécité. Il est donc
crucial de détecter tous les changements qui ont lieu dans les petits vaisseaux de la rétine
dans le but de caractériser les vaisseaux sains et les vaisseaux anormaux. La caractérisation
en elle-même peut faciliter la détection locale d’une rétinopathie spécifique.
La segmentation automatique des structures anatomiques comme le réseau vasculaire est
une étape cruciale. Ces informations peuvent être fournies à un médecin pour qu’elles soient
considérées lors de son diagnostic. Dans les systèmes automatiques d’aide au diagnostic, le
rôle des petits vaisseaux est significatif. Ne pas réussir à les détecter automatiquement peut
conduire à une sur-segmentation du taux de faux positifs des lésions rouges dans les étapes
ultérieures. Les efforts de recherche se sont concentrés jusqu’à présent sur la localisation
précise des vaisseaux de taille moyenne. Les modèles existants ont beaucoup plus de difficultés
à extraire les petits vaisseaux sanguins. Les modèles existants ne sont pas robustes à la grande
variance d’apparence des vaisseaux ainsi qu’à l’interférence avec l’arrière-plan. Les modèles de
la littérature existante supposent une forme générale qui n’est pas suffisante pour s’adapter
à la largeur étroite et la courbure qui caractérisent les petits vaisseaux sanguins. De plus, le
contraste avec l’arrière-plan dans les régions des petits vaisseaux est très faible. Les méthodes
de segmentation ou de suivi produisent des résultats fragmentés ou discontinus. Par ailleurs,
la segmentation des petits vaisseaux est généralement faite aux dépends de l’amplification
du bruit. Les modèles déformables sont inadéquats pour segmenter les petits vaisseaux. Les
forces utilisées ne sont pas assez flexibles pour compenser le faible contraste, la largeur, et
vii
la variance des vaisseaux. Enfin, les approches de type apprentissage machine nécessitent un
entraînement avec une base de données étiquetée. Il est très difficile d’obtenir ces bases de
données dans le cas des petits vaisseaux.
Cette thèse étend les travaux de recherche antérieurs en fournissant une nouvelle mé-
thode de segmentation des petits vaisseaux rétiniens. La détection de ligne à échelles multiples
(MSLD) est une méthode récente qui démontre une bonne performance de segmentation dans
les images de la rétine, tandis que le vote tensoriel est une méthode proposée pour reconnecter
les pixels. Une approche combinant un algorithme de détection de ligne et de vote tensoriel est
proposée. L’application des détecteurs de lignes a prouvé son efficacité à segmenter les vais-
seaux de tailles moyennes. De plus, les approches d’organisation perceptuelle comme le vote
tensoriel ont démontré une meilleure robustesse en combinant les informations voisines d’une
manière hiérarchique. La méthode de vote tensoriel est plus proche de la perception humain
que d’autres modèles standards. Comme démontré dans ce manuscrit, c’est un outil pour
segmenter les petits vaisseaux plus puissant que les méthodes existantes. Cette combinaison
spécifique nous permet de surmonter les défis de fragmentation éprouvés par les méthodes de
type modèle déformable au niveau des petits vaisseaux. Nous proposons également d’utiliser
un seuil adaptatif sur la réponse de l’algorithme de détection de ligne pour être plus robuste
aux images non-uniformes. Nous illustrons Ă©galement comment une combinaison des deux
méthodes individuelles, à plusieurs échelles, est capable de reconnecter les vaisseaux sur des
distances variables. Un algorithme de reconstruction des vaisseaux est également proposé.
Cette dernière étape est nécessaire car l’information géométrique complète est requise pour
pouvoir utiliser la segmentation dans un système d’aide au diagnostic.
La segmentation a été validée sur une base de données d’images de fond d’oeil à haute
résolution. Cette base contient des images manifestant une rétinopathie diabétique. La seg-
mentation emploie des mesures de désaccord standards et aussi des mesures basées sur la
perception. En considérant juste les petits vaisseaux dans les images de la base de données,
l’amélioration dans le taux de sensibilité que notre méthode apporte par rapport à la méthode
standard de détection multi-niveaux de lignes est de 6.47%. En utilisant les mesures basées
sur la perception, l’amélioration est de 7.8%.
Dans une seconde partie du manuscrit, nous proposons également une méthode pour
caractériser les rétines saines ou anormales. Certaines images contiennent de la néovascula-
risation. La caractérisation des vaisseaux en bonne santé ou anormale constitue une étape
essentielle pour le développement d’un système d’aide au diagnostic. En plus des défis que
posent les petits vaisseaux sains, les néovaisseaux démontrent eux un degré de complexité
encore plus élevé. Ceux-ci forment en effet des réseaux de vaisseaux à la morphologie com-
plexe et inhabituelle, souvent minces et Ă fortes courbures. Les travaux existants se limitent
viii
à l’utilisation de caractéristiques de premier ordre extraites des petits vaisseaux segmentés.
Notre contribution est d’utiliser le vote tensoriel pour isoler les jonctions vasculaires et d’uti-
liser ces jonctions comme points d’intérêts. Nous utilisons ensuite une statistique spatiale
de second ordre calculée sur les jonctions pour caractériser les vaisseaux comme étant sains
ou pathologiques. Notre méthode améliore la sensibilité de la caractérisation de 9.09% par
rapport à une méthode de l’état de l’art.
La méthode développée s’est révélée efficace pour la segmentation des vaisseaux réti-
niens. Des tenseurs d’ordre supérieur ainsi que la mise en œuvre d’un vote par tenseur via
un filtrage orientable pourraient être étudiés pour réduire davantage le temps d’exécution et
résoudre les défis encore présents au niveau des jonctions vasculaires. De plus, la caractéri-
sation pourrait être améliorée pour la détection de la rétinopathie proliférative en utilisant
un apprentissage supervisé incluant des cas de rétinopathie diabétique non proliférative ou
d’autres pathologies. Finalement, l’incorporation des méthodes proposées dans des systèmes
d’aide au diagnostic pourrait favoriser le dépistage régulier pour une détection précoce des
rétinopathies et d’autres pathologies oculaires dans le but de réduire la cessité au sein de la
population.----------ABSTRACT
As an easily accessible site for the direct observation of the circulation system, human retina
can offer a unique insight into diseases development or outcome. Retinal vessels are repre-
sentative of the general condition of the whole systematic circulation, and thus can act as
a "window" to the status of the vascular network in the whole body. Each complication on
the retina can have an adverse impact on the patient’s sight. In this direction, small vessels’
relevance is very high as they are among the first anatomical structures that get affected
as diseases progress. Moreover, changes in the small vessels’ state, appearance, morphology,
functionality, or even growth indicate the severity of the diseases.
This thesis will focus on the retinal lesions due to diabetes, a serious metabolic disease
affecting millions of people around the world. This disorder disturbs the natural blood glucose
levels causing various pathophysiological changes in different systems across the human body.
Diabetic retinopathy is the medical term that describes the condition when the fundus and
the retinal vessels are affected by diabetes. As in other diseases, small vessels play a crucial
role in the onset, the development, and the outcome of the retinopathy. More importantly,
at the latest stage, new small vessels, or neovascularizations, growth constitutes a factor of
significant risk for blindness. Therefore, there is a need to detect all the changes that occur
in the small retinal vessels with the aim of characterizing the vessels to healthy or abnormal.
The characterization, in turn, can facilitate the detection of a specific retinopathy locally,
like the sight-threatening proliferative diabetic retinopathy.
Segmentation techniques can automatically isolate important anatomical structures like
the vessels, and provide this information to the physician to assist him in the final decision. In
comprehensive systems for the automatization of DR detection, small vessels role is significant
as missing them early in a CAD pipeline might lead to an increase in the false positive rate
of red lesions in subsequent steps. So far, the efforts have been concentrated mostly on the
accurate localization of the medium range vessels. In contrast, the existing models are weak
in case of the small vessels. The required generalization to adapt an existing model does not
allow the approaches to be flexible, yet robust to compensate for the increased variability in
the appearance as well as the interference with the background. So far, the current template
models (matched filtering, line detection, and morphological processing) assume a general
shape for the vessels that is not enough to approximate the narrow, curved, characteristics
of the small vessels. Additionally, due to the weak contrast in the small vessel regions,
the current segmentation and the tracking methods produce fragmented or discontinued
results. Alternatively, the small vessel segmentation can be accomplished at the expense of
x
background noise magnification, in the case of using thresholding or the image derivatives
methods. Furthermore, the proposed deformable models are not able to propagate a contour
to the full extent of the vasculature in order to enclose all the small vessels. The deformable
model external forces are ineffective to compensate for the low contrast, the low width, the
high variability in the small vessel appearance, as well as the discontinuities. Internal forces,
also, are not able to impose a global shape constraint to the contour that could be able to
approximate the variability in the appearance of the vasculature in different categories of
vessels. Finally, machine learning approaches require the training of a classifier on a labelled
set. Those sets are difficult to be obtained, especially in the case of the smallest vessels. In
the case of the unsupervised methods, the user has to predefine the number of clusters and
perform an effective initialization of the cluster centers in order to converge to the global
minimum.
This dissertation expanded the previous research work and provides a new segmentation
method for the smallest retinal vessels. Multi-scale line detection (MSLD) is a recent method
that demonstrates good segmentation performance in the retinal images, while tensor voting
is a method first proposed for reconnecting pixels. For the first time, we combined the
line detection with the tensor voting framework. The application of the line detectors has
been proved an effective way to segment medium-sized vessels. Additionally, perceptual
organization approaches like tensor voting, demonstrate increased robustness by combining
information coming from the neighborhood in a hierarchical way. Tensor voting is closer than
standard models to the way human perception functions. As we show, it is a more powerful
tool to segment small vessels than the existing methods. This specific combination allows us
to overcome the apparent fragmentation challenge of the template methods at the smallest
vessels. Moreover, we thresholded the line detection response adaptively to compensate for
non-uniform images. We also combined the two individual methods in a multi-scale scheme
in order to reconnect vessels at variable distances. Finally, we reconstructed the vessels
from their extracted centerlines based on pixel painting as complete geometric information
is required to be able to utilize the segmentation in a CAD system.
The segmentation was validated on a high-resolution fundus image database that in-
cludes diabetic retinopathy images of varying stages, using standard discrepancy as well as
perceptual-based measures. When only the smallest vessels are considered, the improve-
ments in the sensitivity rate for the database against the standard multi-scale line detection
method is 6.47%. For the perceptual-based measure, the improvement is 7.8% against the
basic method.
The second objective of the thesis was to implement a method for the characterization of
isolated retinal areas into healthy or abnormal cases. Some of the original images, from which
xi
these patches are extracted, contain neovascularizations. Investigation of image features
for the vessels characterization to healthy or abnormal constitutes an essential step in the
direction of developing CAD system for the automatization of DR screening. Given that the
amount of data will significantly increase under CAD systems, the focus on this category of
vessels can facilitate the referral of sight-threatening cases to early treatment. In addition
to the challenges that small healthy vessels pose, neovessels demonstrate an even higher
degree of complexity as they form networks of convolved, twisted, looped thin vessels. The
existing work is limited to the use of first-order characteristics extracted from the small
segmented vessels that limits the study of patterns. Our contribution is in using the tensor
voting framework to isolate the retinal vascular junctions and in turn using those junctions
as points of interests. Second, we exploited second-order statistics computed on the junction
spatial distribution to characterize the vessels as healthy or neovascularizations. In fact, the
second-order spatial statistics extracted from the junction distribution are combined with
widely used features to improve the characterization sensitivity by 9.09% over the state of
art.
The developed method proved effective for the segmentation of the retinal vessels. Higher
order tensors along with the implementation of tensor voting via steerable filtering could
be employed to further reduce the execution time, and resolve the challenges at vascular
junctions. Moreover, the characterization could be advanced to the detection of prolifera-
tive retinopathy by extending the supervised learning to include non-proliferative diabetic
retinopathy cases or other pathologies. Ultimately, the incorporation of the methods into
CAD systems could facilitate screening for the effective reduction of the vision-threatening
diabetic retinopathy rates, or the early detection of other than ocular pathologies
Automatic analysis of retinal images to aid in the diagnosis and grading of diabetic retinopathy
Diabetic retinopathy (DR) is the most common complication of diabetes mellitus and one of the leading causes of preventable blindness in the adult working population. Visual loss can be prevented from the early stages of DR, when the treatments are effective. Therefore, early diagnosis is paramount. However, DR may be clinically asymptomatic until the advanced stage, when vision is already affected and treatment may become difficult. For this reason, diabetic patients should undergo regular eye examinations through screening programs. Traditionally, DR screening programs are run by trained specialists through visual inspection of the retinal images. However, this manual analysis is time consuming and expensive. With the increasing incidence of diabetes and the limited number of clinicians and sanitary resources, the early detection of DR becomes non-viable. For this reason, computed-aided diagnosis (CAD) systems are required to assist specialists for a fast, reliable diagnosis, allowing to reduce the workload and the associated costs.
We hypothesize that the application of novel, automatic algorithms for fundus image analysis could contribute to the early diagnosis of DR. Consequently, the main objective of the present Doctoral Thesis is to study, design and develop novel methods based on the automatic analysis of fundus images to aid in the screening, diagnosis, and treatment of DR.
In order to achieve the main goal, we built a private database and used five retinal public databases: DRIMDB, DIARETDB1, DRIVE, Messidor and Kaggle. The stages of fundus image processing covered in this Thesis are: retinal image quality assessment (RIQA), the location of the optic disc (OD) and the fovea, the segmentation of RLs and EXs, and the DR severity grading.
RIQA was studied with two different approaches. The first approach was based on the combination of novel, global features. Results achieved 91.46% accuracy, 92.04% sensitivity, and 87.92% specificity using the private database. We developed a second approach aimed at RIQA based on deep learning. We achieved 95.29% accuracy with the private database and 99.48% accuracy with the DRIMDB database.
The location of the OD and the fovea was performed using a combination of saliency maps. The proposed methods were evaluated over the private database and the public databases DRIVE, DIARETDB1 and Messidor. For the OD, we achieved 100% accuracy for all databases except Messidor (99.50%). As for the fovea location, we also reached 100% accuracy for all databases except Messidor (99.67%).
The joint segmentation of RLs and EXs was accomplished by decomposing the fundus image into layers. Results were computed per pixel and per image. Using the private database, 88.34% per-image accuracy (ACCi) was reached for the RL detection and 95.41% ACCi for EX detection. An additional method was proposed for the segmentation of RLs based on superpixels. Evaluating this method with the private database, we obtained 84.45% ACCi. Results were validated using the DIARETDB1 database.
Finally, we proposed a deep learning framework for the automatic DR severity grading. The method was based on a novel attention mechanism which performs a separate attention of the dark and the bright structures of the retina. The Kaggle DR detection dataset was used for development and validation. The International Clinical DR Scale was considered, which is made up of 5 DR severity levels. Classification results for all classes achieved 83.70% accuracy and a Quadratic Weighted Kappa of 0.78.
The methods proposed in this Doctoral Thesis form a complete, automatic DR screening system, contributing to aid in the early detection of DR. In this way, diabetic patients could receive better attention for their ocular health avoiding vision loss. In addition, the workload of specialists could be relieved while healthcare costs are reduced.La retinopatĂa diabĂ©tica (RD) es la complicaciĂłn más comĂşn de la diabetes mellitus y una de las principales causas de ceguera prevenible en la poblaciĂłn activa adulta. El diagnĂłstico precoz es primordial para prevenir la pĂ©rdida visual. Sin embargo, la RD es clĂnicamente asintomática hasta etapas avanzadas, cuando la visiĂłn ya está afectada. Por eso, los pacientes diabĂ©ticos deben someterse a exámenes oftalmolĂłgicos periĂłdicos a travĂ©s de programas de cribado. Tradicionalmente, estos programas están a cargo de especialistas y se basan de la inspecciĂłn visual de retinografĂas. Sin embargo, este análisis manual requiere mucho tiempo y es costoso. Con la creciente incidencia de la diabetes y la escasez de recursos sanitarios, la detecciĂłn precoz de la RD se hace inviable. Por esta razĂłn, se necesitan sistemas de diagnĂłstico asistido por ordenador (CAD) que ayuden a los especialistas a realizar un diagnĂłstico rápido y fiable, que permita reducir la carga de trabajo y los costes asociados.
El objetivo principal de la presente Tesis Doctoral es estudiar, diseñar y desarrollar nuevos mĂ©todos basados en el análisis automático de retinografĂas para ayudar en el cribado, diagnĂłstico y tratamiento de la RD. Las etapas estudiadas fueron: la evaluaciĂłn de la calidad de la imagen retiniana (RIQA), la localizaciĂłn del disco Ăłptico (OD) y la fĂłvea, la segmentaciĂłn de RL y EX y la graduaciĂłn de la severidad de la RD.
RIQA se estudiĂł con dos enfoques diferentes. El primer enfoque se basĂł en la combinaciĂłn de caracterĂsticas globales. Los resultados lograron una precisiĂłn del 91,46% utilizando la base de datos privada. El segundo enfoque se basĂł en aprendizaje profundo. Logramos un 95,29% de precisiĂłn con la base de datos privada y un 99,48% con la base de datos DRIMDB.
La localización del OD y la fóvea se realizó mediante una combinación de mapas de saliencia. Los métodos propuestos fueron evaluados sobre la base de datos privada y las bases de datos públicas DRIVE, DIARETDB1 y Messidor. Para el OD, logramos una precisión del 100% para todas las bases de datos excepto Messidor (99,50%). En cuanto a la ubicación de la fóvea, también alcanzamos un 100% de precisión para todas las bases de datos excepto Messidor (99,67%).
La segmentaciĂłn conjunta de RL y EX se logrĂł descomponiendo la imagen del fondo de ojo en capas. Utilizando la base de datos privada, se alcanzĂł un 88,34% de precisiĂłn por imagen (ACCi) para la detecciĂłn de RL y un 95,41% de ACCi para la detecciĂłn de EX. Se propuso un mĂ©todo adicional para la segmentaciĂłn de RL basado en superpĂxeles. Evaluando este mĂ©todo con la base de datos privada, obtuvimos 84.45% ACCi. Los resultados se validaron utilizando la base de datos DIARETDB1.
Finalmente, propusimos un mĂ©todo de aprendizaje profundo para la graduaciĂłn automática de la gravedad de la DR. El mĂ©todo se basĂł en un mecanismo de atenciĂłn. Se utilizĂł la base de datos Kaggle y la Escala ClĂnica Internacional de RD (5 niveles de severidad). Los resultados de clasificaciĂłn para todas las clases alcanzaron una precisiĂłn del 83,70% y un Kappa ponderado cuadrático de 0,78.
Los mĂ©todos propuestos en esta Tesis Doctoral forman un sistema completo y automático de cribado de RD, contribuyendo a ayudar en la detecciĂłn precoz de la RD. De esta forma, los pacientes diabĂ©ticos podrĂan recibir una mejor atenciĂłn para su salud ocular evitando la pĂ©rdida de visiĂłn. Además, se podrĂa aliviar la carga de trabajo de los especialistas al mismo tiempo que se reducen los costes sanitarios.Escuela de DoctoradoDoctorado en TecnologĂas de la InformaciĂłn y las Telecomunicacione
Quantitative Assessment of Experimental Ocular Inflammatory Disease
Ocular inflammation imposes a high medical burden on patients and substantial costs on the health-care systems that mange these often chronic and debilitating diseases. Many clinical phenotypes are recognized and classifying the severity of inflammation in an eye with uveitis is an ongoing challenge. With the widespread application of optical coherence tomography in the clinic has come the impetus for more robust methods to compare disease between different patients and different treatment centers. Models can recapitulate many of the features seen in the clinic, but until recently the quality of imaging available has lagged that applied in humans. In the model experimental autoimmune uveitis (EAU), we highlight three linked clinical states that produce retinal vulnerability to inflammation, all different from healthy tissue, but distinct from each other. Deploying longitudinal, multimodal imaging approaches can be coupled to analysis in the tissue of changes in architecture, cell content and function. This can enrich our understanding of pathology, increase the sensitivity with which the impacts of therapeutic interventions are assessed and address questions of tissue regeneration and repair. Modern image processing, including the application of artificial intelligence, in the context of such models of disease can lay a foundation for new approaches to monitoring tissue health
Generalizable automated pixel-level structural segmentation of medical and biological data
Over the years, the rapid expansion in imaging techniques and equipments has driven the demand for more automation in handling large medical and biological data sets. A wealth of approaches have been suggested as optimal solutions for their respective imaging types. These
solutions span various image resolutions, modalities and contrast (staining) mechanisms. Few approaches generalise well across multiple image types, contrasts or resolution.
This thesis proposes an automated pixel-level framework that addresses 2D, 2D+t and 3D
structural segmentation in a more generalizable manner, yet has enough adaptability to address
a number of specific image modalities, spanning retinal funduscopy, sequential
fluorescein angiography and two-photon microscopy.
The pixel-level segmentation scheme involves: i ) constructing a phase-invariant orientation field of the local spatial neighbourhood; ii ) combining local feature maps with intensity-based
measures in a structural patch context; iii ) using a complex supervised learning process to interpret the combination of all the elements in the patch in order to reach a classification decision. This has the advantage of transferability from retinal blood vessels in 2D to neural structures in 3D.
To process the temporal components in non-standard 2D+t retinal angiography sequences, we first introduce a co-registration procedure: at the pairwise level, we combine projective
RANSAC with a quadratic homography transformation to map the coordinate systems between any two frames. At the joint level, we construct a hierarchical approach in order for each individual frame to be registered to the global reference intra- and inter- sequence(s). We then take a non-training approach that searches in both the spatial neighbourhood of each pixel and the filter output across varying scales to locate and link microvascular centrelines to (sub-)
pixel accuracy. In essence, this \link while extract" piece-wise segmentation approach combines the local phase-invariant orientation field information with additional local phase estimates to obtain a soft classification of the centreline (sub-) pixel locations.
Unlike retinal segmentation problems where vasculature is the main focus, 3D neural segmentation requires additional
exibility, allowing a variety of structures of anatomical importance yet with different geometric properties to be differentiated both from the background and against other structures. Notably, cellular structures, such as Purkinje cells, neural dendrites and interneurons, all display certain elongation along their medial axes, yet each class has a characteristic shape captured by an orientation field that distinguishes it from other structures. To take this
into consideration, we introduce a 5D orientation mapping to capture these orientation properties.
This mapping is incorporated into the local feature map description prior to a learning
machine. Extensive performance evaluations and validation of each of the techniques presented in this thesis is carried out. For retinal fundus images, we compute Receiver Operating Characteristic (ROC) curves on existing public databases (DRIVE & STARE) to assess and compare our algorithms with other benchmark methods. For 2D+t retinal angiography sequences, we compute the error metrics ("Centreline Error") of our scheme with other benchmark methods.
For microscopic cortical data stacks, we present segmentation results on both surrogate data with known ground-truth and experimental rat cerebellar cortex two-photon microscopic tissue stacks.Open Acces
Melanopsin Sensitivity in the Human Visual System
The human retina contains long [L]-wavelength, medium [M]-wavelength, and short [S]-wavelength cones, rods, and intrinsically photosensitive retinal ganglion cells expressing the blue-sensitive (λmax = ~480 nm) photopigment melanopsin. Previous animal studies have pointed to a role of melanopsin in advancing circadian phase, melatonin suppression, the pupillary light reflex (PLR), light avoidance, and brightness discrimination, often relying on genetic tools to study melanopsin in isolation in animal models. This work addresses the question of human melanopsin sensitivity and function in vivo using a spectrally tunable light source and the method of silent substitution, allowing for the selective stimulation of melanopsin in the human retina, in combination of pupillometry, psychophysics, and BOLD functional neuroimaging (fMRI). In three studies, we find (1) that the temporal transfer function of melanopsin in controlling the pupil in humans is low-pass, peaking at slow temporal frequencies (0.01 Hz), with a sharp drop off at higher frequencies (1-2 Hz); (2) that signals originating from S cones get combined in an antagonistic fashion with melanopsin signals and signals from L and M cones cones, demonstrating spectral opponency in the control of the human PLR; (3) that nominally cone-silent melanopsin-directed spectral modulations stimulate cones in the partial shadow of the retinal blood vessels (termed penumbral cones), leading to the entoptic percept of the subjective retinal vasculature; and (4) that there is no measurable signal due to melanopsin stimulation in human visual cortical areas (V1, V2/V3, MT, LOC; measured with BOLD fMRI) at temporal frequencies most relevant to spatial vision (0.5–64 Hz) while modulations directed at L+M, L–M and S photoreceptor combinations yield characteristic temporal transfer functions in these areas. This work advances to our understanding of the functional significance of melanopsin function in the human visual system, contributing to the study of human health in relation to light and color
An Automatic Cognitive Graph-Based Segmentation for Detection of Blood Vessels in Retinal Images
This paper presents a hierarchical graph-based segmentation for blood vessel detection in digital retinal images. This segmentation employs some of perceptual Gestalt principles: similarity, closure, continuity, and proximity to merge segments into coherent connected vessel-like patterns. The integration of Gestalt principles is based on object-based features (e.g., color and black top-hat (BTH) morphology and context) and graph-analysis algorithms (e.g., Dijkstra path). The segmentation framework consists of two main steps: preprocessing and multiscale graph-based segmentation. Preprocessing is to enhance lighting condition, due to low illumination contrast, and to construct necessary features to enhance vessel structure due to sensitivity of vessel patterns to multiscale/multiorientation structure. Graph-based segmentation is to decrease computational processing required for region of interest into most semantic objects. The segmentation was evaluated on three publicly available datasets. Experimental results show that preprocessing stage achieves better results compared to state-of-the-art enhancement methods. The performance of the proposed graph-based segmentation is found to be consistent and comparable to other existing methods, with improved capability of detecting small/thin vessels
Image Quality Improvement of Medical Images using Deep Learning for Computer-aided Diagnosis
Retina image analysis is an important screening tool for early detection of multiple dis eases such as diabetic retinopathy which greatly impairs visual function. Image analy sis and pathology detection can be accomplished both by ophthalmologists and by the
use of computer-aided diagnosis systems. Advancements in hardware technology led to
more portable and less expensive imaging devices for medical image acquisition. This
promotes large scale remote diagnosis by clinicians as well as the implementation of
computer-aided diagnosis systems for local routine disease screening. However, lower cost equipment generally results in inferior quality images. This may jeopardize the
reliability of the acquired images and thus hinder the overall performance of the diagnos tic tool. To solve this open challenge, we carried out an in-depth study on using different
deep learning-based frameworks for improving retina image quality while maintaining
the underlying morphological information for the diagnosis. Our results demonstrate
that using a Cycle Generative Adversarial Network for unpaired image-to-image trans lation leads to successful transformations of retina images from a low- to a high-quality
domain. The visual evidence of this improvement was quantitatively affirmed by the two
proposed validation methods. The first used a retina image quality classifier to confirm a
significant prediction label shift towards a quality enhance. On average, a 50% increase
of images being classified as high-quality was verified. The second analysed the perfor mance modifications of a diabetic retinopathy detection algorithm upon being trained
with the quality-improved images. The latter led to strong evidence that the proposed
solution satisfies the requirement of maintaining the images’ original information for
diagnosis, and that it assures a pathology-assessment more sensitive to the presence of
pathological signs. These experimental results confirm the potential effectiveness of our
solution in improving retina image quality for diagnosis. Along with the addressed con tributions, we analysed how the construction of the data sets representing the low-quality
domain impacts the quality translation efficiency. Our findings suggest that by tackling
the problem more selectively, that is, constructing data sets more homogeneous in terms
of their image defects, we can obtain more accentuated quality transformations
Fundus-controlled perimetry (microperimetry): Application as outcome measure in clinical trials
YesFundus-controlled perimetry (FCP, also called 'microperimetry') allows for spatially-resolved mapping of visual sensitivity and measurement of fixation stability, both in clinical practice as well as research. The accurate spatial characterization of visual function enabled by FCP can provide insightful information about disease severity and progression not reflected by best-corrected visual acuity in a large range of disorders. This is especially important for monitoring of retinal diseases that initially spare the central retina in earlier disease stages. Improved intra- and inter-session retest-variability through fundus-tracking and precise point-wise follow-up examinations even in patients with unstable fixation represent key advantages of these technique. The design of disease-specific test patterns and protocols reduces the burden of extensive and time-consuming FCP testing, permitting a more meaningful and focused application. Recent developments also allow for photoreceptor-specific testing through implementation of dark-adapted chromatic and photopic testing. A detailed understanding of the variety of available devices and test settings is a key prerequisite for the design and optimization of FCP protocols in future natural history studies and clinical trials. Accordingly, this review describes the theoretical and technical background of FCP, its prior application in clinical and research settings, data that qualify the application of FCP as an outcome measure in clinical trials as well as ongoing and future developments
- …