Trainable COSFIRE filters for vessel delineation with application to retinal images

Retinal imaging provides a non-invasive opportunity for the diagnosis of several medical pathologies. The automatic segmentation of the vessel tree is an important pre-processing step which facilitates subsequent automatic processes that contribute to such diagnosis. We introduce a novel method for the automatic segmentation of vessel trees in retinal fundus images. We propose a filter that selectively responds to vessels and that we call B-COSFIRE with B standing for bar which is an abstraction for a vessel. It is based on the existing COSFIRE (Combination Of Shifted Filter Responses) approach. A B-COSFIRE filter achieves orientation selectivity by computing the weighted geometric mean of the output of a pool of Difference-of-Gaussians filters, whose supports are aligned in a collinear manner. It achieves rotation invariance efficiently by simple shifting operations. The proposed filter is versatile as its selectivity is determined from any given vessel-like prototype pattern in an automatic configuration process. We configure two B-COSFIRE filters, namely symmetric and asymmetric, that are selective for bars and bar-endings, respectively. We achieve vessel segmentation by summing up the responses of the two rotation-invariant B-COSFIRE filters followed by thresholding. The results that we achieve on three publicly available data sets (DRIVE: Se = 0.7655, Sp = 0.9704; STARE: Se = 0.7716, Sp = 0.9701; CHASE_DB1: Se = 0.7585, Sp = 0.9587) are higher than many of the state-of-the-art methods. The proposed segmentation approach is also very efficient with a time complexity that is significantly lower than existing methods.peer-reviewe

Color Fundus Image Registration Using a Learning-Based Domain-Specific Landmark Detection Methodology

Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG[Abstract] Medical imaging, and particularly retinal imaging, allows to accurately diagnose many eye pathologies as well as some systemic diseases such as hypertension or diabetes. Registering these images is crucial to correctly compare key structures, not only within patients, but also to contrast data with a model or among a population. Currently, this field is dominated by complex classical methods because the novel deep learning methods cannot compete yet in terms of results and commonly used methods are difficult to adapt to the retinal domain. In this work, we propose a novel method to register color fundus images based on previous works which employed classical approaches to detect domain-specific landmarks. Instead, we propose to use deep learning methods for the detection of these highly-specific domain-related landmarks. Our method uses a neural network to detect the bifurcations and crossovers of the retinal blood vessels, whose arrangement and location are unique to each eye and person. This proposal is the first deep learning feature-based registration method in fundus imaging. These keypoints are matched using a method based on RANSAC (Random Sample Consensus) without the requirement to calculate complex descriptors. Our method was tested using the public FIRE dataset, although the landmark detection network was trained using the DRIVE dataset. Our method provides accurate results, a registration score of 0.657 for the whole FIRE dataset (0.908 for category S, 0.293 for category P and 0.660 for category A). Therefore, our proposal can compete with complex classical methods and beat the deep learning methods in the state of the art.This research was funded by Instituto de Salud Carlos III, Government of Spain, DTS18/00 136 research project; Ministerio de Ciencia e Innovación y Universidades, Government of Spain, RTI2018-095 894-B-I00 research project; Consellería de Cultura, Educación e Universidade, Xunta de Galicia through the predoctoral grant contract ref. ED481A 2021/147 and Grupos de Referencia Competitiva, grant ref. ED431C 2020/24; CITIC, Centro de Investigación de Galicia ref. ED431G 2019/01, receives financial support from Consellería de Educación, Universidade e Formación Profesional, Xunta de Galicia, through the ERDF (80%) and Secretaría Xeral de Universidades (20%). The funding institutions had no involvement in the study design, in the collection, analysis and interpretation of data; in the writing of the manuscript; or in the decision to submit the manuscript for publication. Funding for open access charge: Universidade da Coruña/CISUGXunta de Galicia; ED481A 2021/147Xunta de Galicia; ED431C 2020/24Xunta de Galicia; ED431G 2019/0

Detection of retinal vascular bifurcations by rotation-, scale- and reflection-invariant COSFIRE filters

We propose trainable filters, which we call COSFIRE (Combination Of Shifted FIlter REsponses), and use to de- tect vascular bifurcations in retinal images. We configure a COSFIRE filter to be selective for a bifurcation that is speci- fied by a user in a single-step training phase. The automatic configuration comprises the selection of channels of a bank of Gabor filters and the determination of certain blur and shift parameters. A COSFIRE filter response is computed as the geometric mean of the blurred and shifted responses of the selected Gabor filters. The proposed filters share sim- ilar properties with some shape-selective neurons in visual cortex. With only five filters we achieve a recall of 98.57% at a precision of 95.37% on the 40 binary retinal images (from DRIVE), containing more than 5000 bifurcations.peer-reviewe

Retinal network characterization through fundus image processing: Significant point identification on vessel centerline

[EN] This paper describes a new approach for significant point identification on vessel centerline. Significant points such as bifurcations and crossovers are able to define and characterize the retinal vascular network. In particular, hit-or-miss transformation is used to detect terminal, bifurcation and simple crossing points but a post-processing stage is needed to identify complex intersections. This stage focuses on the idea that the intersection of two vessels creates a sort of close loop formed by the vessels and this effect can be used to differentiate a bifurcation from a crossover. Experimental results show quantitative improvements by increasing the number of true positives and reducing the false positives and negatives in the significant point detection when the proposed method is compared with another state-of-the-art work. A sensitivity equal to 1 and a predictive positive value of 0.908 was achieved in the analyzed cases. Hit-or-miss transformation must be applied on a binary skeleton image. Therefore, a method to extract the vessel skeleton in a direct way is also proposed. Although the identification of the significant points of the retinal tree can be useful by itself for multiple applications such as biometrics and image registration, this paper presents an algorithm that makes use of the significant points to measure the bifurcation angles of the retinal network which can be related to cardiovascular risk determination.This work was supported by the Ministerio de Economia y Conipetitividad of Spain, Project ACRIMA (TIN2013-46751-R). The authors would like to thank people who provide the public databases used in this work (DRIVE, STARE and VARIA).Morales, S.; Naranjo Ornedo, V.; Angulo, J.; Legaz-Aparicio, A.; Verdu-Monedero, R. (2017). Retinal network characterization through fundus image processing: Significant point identification on vessel centerline. Signal Processing: Image Communication. 59:50-64. https://doi.org/10.1016/j.image.2017.03.013S50645

Deep multi-instance heatmap regression for the detection of retinal vessel crossings and bifurcations in eye fundus images

©2020. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/. This version of the article: Hervella, Á. S., Rouco, J., Novo, J., Penedo, M. G., & Ortega, M. (2020). “Deep multi-instance heatmap regression for the detection of retinal vessel crossings and bifurcations in eye fundus images” has been accepted for publication in Computer Methods and Programs in Biomedicine, 186(105201), 105201. The Version of Record is available online at: https://doi.org/10.1016/j.cmpb.2019.105201.[Abstract]: Background and objectives:The analysis of the retinal vasculature plays an important role in the diagnosis of many ocular and systemic diseases. In this context, the accurate detection of the vessel crossings and bifurcations is an important requirement for the automated extraction of relevant biomarkers. In that regard, we propose a novel approach that addresses the simultaneous detection of vessel crossings and bifurcations in eye fundus images. Method: We propose to formulate the detection of vessel crossings and bifurcations in eye fundus images as a multi-instance heatmap regression. In particular, a deep neural network is trained in the prediction of multi-instance heatmaps that model the likelihood of a pixel being a landmark location. This novel approach allows to make predictions using full images and integrates into a single step the detection and distinction of the vascular landmarks. Results: The proposed method is validated on two public datasets of reference that include detailed annotations for vessel crossings and bifurcations in eye fundus images. The conducted experiments evidence that the proposed method offers a satisfactory performance. In particular, the proposed method achieves 74.23% and 70.90% F-score for the detection of crossings and bifurcations, respectively, in color fundus images. Furthermore, the proposed method outperforms previous works by a significant margin. Conclusions: The proposed multi-instance heatmap regression allows to successfully exploit the potential of modern deep learning algorithms for the simultaneous detection of retinal vessel crossings and bifurcations. Consequently, this results in a significant improvement over previous methods, which will further facilitate the automated analysis of the retinal vasculature in many pathological conditions.This work is supported by Instituto de Salud Carlos III, Government of Spain, and the European Regional Development Fund (ERDF) of the European Union (EU) through the DTS18/00136 research project, and by Ministerio de Ciencia, Innovación y Universidades, Government of Spain, through the DPI2015-69948-R and RTI2018-095894-B-I00 research projects. The authors of this work also receive financial support from the ERDF and European Social Fund (ESF) of the EU, and Xunta de Galicia through Centro Singular de Investigación de Galicia, accreditation 2016–2019, ref. ED431G/01, Grupo de Referencia Competitiva, ref. ED431C 2016-047, and the predoctoral grant contract ref. ED481A-2017/328.Xunta de Galicia; ED431G/01Xunta de Galicia; ED431C 2016-047Xunta de Galicia; ED481A-2017/32

Artery/Vein Vessel Tree Identification in Near-Infrared Reflectance Retinographies

This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/s10278-019-00235-x[Abstract]: An accurate identification of the retinal arteries and veins is a relevant issue in the development of automatic computer-aided diagnosis systems that facilitate the analysis of different relevant diseases that affect the vascular system as diabetes or hypertension, among others. The proposed method offers a complete analysis of the retinal vascular tree structure by its identification and posterior classification into arteries and veins using optical coherence tomography (OCT) scans. These scans include the near-infrared reflectance retinography images, the ones we used in this work, in combination with the corresponding histological sections. The method, firstly, segments the vessel tree and identifies its characteristic points. Then, Global Intensity-Based Features (GIBS) are used to measure the differences in the intensity profiles between arteries and veins. A k-means clustering classifier employs these features to evaluate the potential of artery/vein identification of the proposed method. Finally, a post-processing stage is applied to correct misclassifications using context information and maximize the performance of the classification process. The methodology was validated using an OCT image dataset retrieved from 46 different patients, where 2,392 vessel segments and 97,294 vessel points were manually labeled by an expert clinician. The method achieved satisfactory results, reaching a best accuracy of 93.35% in the identification of arteries and veins, being the first proposal that faces this issue in this image modality.This work is supported by the Instituto de Salud Carlos III, Government of Spain and FEDER funds of the European Union through the DTS18/00136 research project and by the Ministerio de Economía y Competitividad, Government of Spain through the DPI2015-69948-R research project. Also, this work has received financial support from the European Union (European Regional Development Fund—ERDF); the Xunta de Galicia, Centro singular de investigación de Galicia accreditation 2016–2019, Ref. ED431G/01; and Grupos de Referencia Competitiva, Ref. ED431C 2016-047.Xunta de Galicia; ED431G/01Xunta de Galicia; ED431C 2016-04

Retinal Vascular Network Topology Reconstruction and Artery/Vein Classification via Dominant Set Clustering

The estimation of vascular network topology in complex networks is important in understanding the relationship between vascular changes and a wide spectrum of diseases. Automatic classification of the retinal vascular trees into arteries and veins is of direct assistance to the ophthalmologist in terms of diagnosis and treatment of eye disease. However, it is challenging due to their projective ambiguity and subtle changes in appearance, contrast and geometry in the imaging process. In this paper, we propose a novel method that is capable of making the artery/vein (A/V) distinction in retinal color fundus images based on vascular network topological properties. To this end, we adapt the concept of dominant set clustering and formalize the retinal blood vessel topology estimation and the A/V classification as a pairwise clustering problem. The graph is constructed through image segmentation, skeletonization and identification of significant nodes. The edge weight is defined as the inverse Euclidean distance between its two end points in the feature space of intensity, orientation, curvature, diameter, and entropy. The reconstructed vascular network is classified into arteries and veins based on their intensity and morphology. The proposed approach has been applied to five public databases, INSPIRE, IOSTAR, VICAVR, DRIVE and WIDE, and achieved high accuracies of 95.1%, 94.2%, 93.8%, 91.1%, and 91.0%, respectively. Furthermore, we have made manual annotations of the blood vessel topologies for INSPIRE, IOSTAR, VICAVR, and DRIVE datasets, and these annotations are released for public access so as to facilitate researchers in the community

Retinal vascular segmentation using superpixel-based line operator and its application to vascular topology estimation

Purpose: Automatic methods of analyzing of retinal vascular networks, such as retinal blood vessel detection, vascular network topology estimation, and arteries / veins classi cation are of great assistance to the ophthalmologist in terms of diagnosis and treatment of a wide spectrum of diseases. Methods: We propose a new framework for precisely segmenting retinal vasculatures, constructing retinal vascular network topology, and separating the arteries and veins. A non-local total variation inspired Retinex model is employed to remove the image intensity inhomogeneities and relatively poor contrast. For better generalizability and segmentation performance, a superpixel based line operator is proposed as to distinguish between lines and the edges, thus allowing more tolerance in the position of the respective contours. The concept of dominant sets clustering is adopted to estimate retinal vessel topology and classify the vessel network into arteries and veins. Results: The proposed segmentation method yields competitive results on three pub- lic datasets (STARE, DRIVE, and IOSTAR), and it has superior performance when com- pared with unsupervised segmentation methods, with accuracy of 0.954, 0.957, and 0.964, respectively. The topology estimation approach has been applied to ve public databases 1 (DRIVE,STARE, INSPIRE, IOSTAR, and VICAVR) and achieved high accuracy of 0.830, 0.910, 0.915, 0.928, and 0.889, respectively. The accuracies of arteries / veins classi cation based on the estimated vascular topology on three public databases (INSPIRE, DRIVE and VICAVR) are 0.90.9, 0.910, and 0.907, respectively. Conclusions: The experimental results show that the proposed framework has e ectively addressed crossover problem, a bottleneck issue in segmentation and vascular topology recon- struction. The vascular topology information signi cantly improves the accuracy on arteries / veins classi cation