Joint segmentation and classification of retinal arteries/veins from fundus images

Objective Automatic artery/vein (A/V) segmentation from fundus images is required to track blood vessel changes occurring with many pathologies including retinopathy and cardiovascular pathologies. One of the clinical measures that quantifies vessel changes is the arterio-venous ratio (AVR) which represents the ratio between artery and vein diameters. This measure significantly depends on the accuracy of vessel segmentation and classification into arteries and veins. This paper proposes a fast, novel method for semantic A/V segmentation combining deep learning and graph propagation. Methods A convolutional neural network (CNN) is proposed to jointly segment and classify vessels into arteries and veins. The initial CNN labeling is propagated through a graph representation of the retinal vasculature, whose nodes are defined as the vessel branches and edges are weighted by the cost of linking pairs of branches. To efficiently propagate the labels, the graph is simplified into its minimum spanning tree. Results The method achieves an accuracy of 94.8% for vessels segmentation. The A/V classification achieves a specificity of 92.9% with a sensitivity of 93.7% on the CT-DRIVE database compared to the state-of-the-art-specificity and sensitivity, both of 91.7%. Conclusion The results show that our method outperforms the leading previous works on a public dataset for A/V classification and is by far the fastest. Significance The proposed global AVR calculated on the whole fundus image using our automatic A/V segmentation method can better track vessel changes associated to diabetic retinopathy than the standard local AVR calculated only around the optic disc.Comment: Preprint accepted in Artificial Intelligence in Medicin

Automatic classification of skin lesions using color mathematical morphology-based texture descriptors

SPIE : Society of Photo-Optical Instrumentation EngineersInternational audienceIn this paper an automatic classification method of skin lesions from dermoscopic images is proposed. This method is based on color texture analysis based both on color mathematical morphology and Kohonen Self-Organizing Maps (SOM), and it does not need any previous segmentation process. More concretely, mathematical morphology is used to compute a local descriptor for each pixel of the image, while the SOM is used to cluster them and, thus, create the texture descriptor of the global image. Two approaches are proposed, depending on whether the pixel descriptor is computed using classical (i.e. spatially invariant) or adaptive (i.e. spatially variant) mathematical morphology by means of the Color Adaptive Neighborhoods (CANs) framework. Both approaches obtained similar areas under the ROC curve (AUC): 0.854 and 0.859 outperforming the AUC built upon dermatologists' predictions (0.792)

Unsupervised Retinal Blood Vessel Segmentation Technique using pdAPSO and Difference Image Methods for Detection of Diabetic Retinopathy

Retinal vessel segmentation is a practice that has the potential of enhancing accuracy in the diagnosis and timely prevention of illnesses that are related to blood vessels. Acute damage to the retinal vessel has been identified to be the main cause of blindness and impaired vision. A timely detection and control of these illnesses can greatly decrease the number of loss of sight cases. However, the manual protocol for such detection is laborious and although autonomous methods have been recommended, the accuracy of these methods is often unreliable. We propose the utilization of the Primal-Dual Asynchronous Particle Swarm Optimisation (pdAPSO) and differential image methods in addressing the drawbacks associated with segmentation of retinal vessels in this study. The fusion of pdAPSO and differential image (which focuses on the median filter) produced a significant enhancement in the segmentation of huge and miniscule retinal vessels. In addition, the method also decreased erroneous detection near the edge of the retinal (that is not sensitive to light). The results are favourable for the median filter when compared to mean filter and Gaussian filter. The accuracy rate of 0.9559 (with a specificity of sensitivity rate of 0.9855), and a sensitivity rate of 0.7218 were obtained when tested using the Digital Retinal Images for Vessel Extraction database. The above result is a pointer that our approach will help in detecting and diagnosing the damage done to the retinal and thereby preventing loss of sight

Two and three dimensional segmentation of multimodal imagery

The role of segmentation in the realms of image understanding/analysis, computer vision, pattern recognition, remote sensing and medical imaging in recent years has been significantly augmented due to accelerated scientific advances made in the acquisition of image data. This low-level analysis protocol is critical to numerous applications, with the primary goal of expediting and improving the effectiveness of subsequent high-level operations by providing a condensed and pertinent representation of image information. In this research, we propose a novel unsupervised segmentation framework for facilitating meaningful segregation of 2-D/3-D image data across multiple modalities (color, remote-sensing and biomedical imaging) into non-overlapping partitions using several spatial-spectral attributes. Initially, our framework exploits the information obtained from detecting edges inherent in the data. To this effect, by using a vector gradient detection technique, pixels without edges are grouped and individually labeled to partition some initial portion of the input image content. Pixels that contain higher gradient densities are included by the dynamic generation of segments as the algorithm progresses to generate an initial region map. Subsequently, texture modeling is performed and the obtained gradient, texture and intensity information along with the aforementioned initial partition map are used to perform a multivariate refinement procedure, to fuse groups with similar characteristics yielding the final output segmentation. Experimental results obtained in comparison to published/state-of the-art segmentation techniques for color as well as multi/hyperspectral imagery, demonstrate the advantages of the proposed method. Furthermore, for the purpose of achieving improved computational efficiency we propose an extension of the aforestated methodology in a multi-resolution framework, demonstrated on color images. Finally, this research also encompasses a 3-D extension of the aforementioned algorithm demonstrated on medical (Magnetic Resonance Imaging / Computed Tomography) volumes

Artificial Intelligence Techniques in Medical Imaging: A Systematic Review

This scientific review presents a comprehensive overview of medical imaging modalities and their diverse applications in artificial intelligence (AI)-based disease classification and segmentation. The paper begins by explaining the fundamental concepts of AI, machine learning (ML), and deep learning (DL). It provides a summary of their different types to establish a solid foundation for the subsequent analysis. The prmary focus of this study is to conduct a systematic review of research articles that examine disease classification and segmentation in different anatomical regions using AI methodologies. The analysis includes a thorough examination of the results reported in each article, extracting important insights and identifying emerging trends. Moreover, the paper critically discusses the challenges encountered during these studies, including issues related to data availability and quality, model generalization, and interpretability. The aim is to provide guidance for optimizing technique selection. The analysis highlights the prominence of hybrid approaches, which seamlessly integrate ML and DL techniques, in achieving effective and relevant results across various disease types. The promising potential of these hybrid models opens up new opportunities for future research in the field of medical diagnosis. Additionally, addressing the challenges posed by the limited availability of annotated medical images through the incorporation of medical image synthesis and transfer learning techniques is identified as a crucial focus for future research efforts

Artificial neural network-statistical approach for PET volume analysis and classification

Copyright © 2012 The Authors. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.This article has been made available through the Brunel Open Access Publishing Fund.The increasing number of imaging studies and the prevailing application of positron emission tomography (PET) in clinical oncology have led to a real need for efficient PET volume handling and the development of new volume analysis approaches to aid the clinicians in the clinical diagnosis, planning of treatment, and assessment of response to therapy. A novel automated system for oncological PET volume analysis is proposed in this work. The proposed intelligent system deploys two types of artificial neural networks (ANNs) for classifying PET volumes. The first methodology is a competitive neural network (CNN), whereas the second one is based on learning vector quantisation neural network (LVQNN). Furthermore, Bayesian information criterion (BIC) is used in this system to assess the optimal number of classes for each PET data set and assist the ANN blocks to achieve accurate analysis by providing the best number of classes. The system evaluation was carried out using experimental phantom studies (NEMA IEC image quality body phantom), simulated PET studies using the Zubal phantom, and clinical studies representative of nonsmall cell lung cancer and pharyngolaryngeal squamous cell carcinoma. The proposed analysis methodology of clinical oncological PET data has shown promising results and can successfully classify and quantify malignant lesions.This study was supported by the Swiss National Science Foundation under Grant SNSF 31003A-125246, Geneva Cancer League, and the Indo Swiss Joint Research Programme ISJRP 138866. This article is made available through the Brunel Open Access Publishing Fund

Texture descriptors based on adaptive neighborhoods for classification of pigmented skin lesions

art. 061104Se proponen diferentes descriptores de textura para la clasificación automática de lesiones cutáneas a partir de imágenes dermoscópicas. Se basan en el análisis de textura de color obtenido de (1) morfología matemática del color (MM) y mapas autoorganizativos de Kohonen (SOM) o (2) patrones binarios locales (LBP), calculados con el uso de barrios adaptativos locales de la imagen. Ninguno de estos dos enfoques necesita un proceso de segmentación anterior. En el primer descriptor propuesto, los barrios adaptativos se utilizan como elementos de estructuración para llevar a cabo operaciones MM adaptables que se combinan aún más mediante el uso de KOhonen SOM; esto se ha comparado con una versión no adaptativa. En la segunda, las vecindades adaptables permiten definir mapas de entidades geométricas, a partir de los cuales se calculan histogramas LBP. Esto también se ha comparado con un enfoque clásico de LBP. Un análisis de las características operativas del receptor de los resultados experimentales muestra que el enfoque adaptativo de LBP basado en la vecindad produce los mejores resultados. Supera a las versiones no adaptativas de los descriptores propuestos y las predicciones visuales de los dermatólogos.S

A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Images

In line with the development of Industry 4.0, surface defect detection/anomaly detection becomes a topical subject in the industry field. Improving efficiency as well as saving labor costs has steadily become a matter of great concern in practice, where deep learning-based algorithms perform better than traditional vision inspection methods in recent years. While existing deep learning-based algorithms are biased towards supervised learning, which not only necessitates a huge amount of labeled data and human labor, but also brings about inefficiency and limitations. In contrast, recent research shows that unsupervised learning has great potential in tackling the above disadvantages for visual industrial anomaly detection. In this survey, we summarize current challenges and provide a thorough overview of recently proposed unsupervised algorithms for visual industrial anomaly detection covering five categories, whose innovation points and frameworks are described in detail. Meanwhile, publicly available datasets for industrial anomaly detection are introduced. By comparing different classes of methods, the advantages and disadvantages of anomaly detection algorithms are summarized. Based on the current research framework, we point out the core issue that remains to be resolved and provide further improvement directions. Meanwhile, based on the latest technological trends, we offer insights into future research directions. It is expected to assist both the research community and industry in developing a broader and cross-domain perspective