Analysis of the Relevance of Evaluation Criteria for Multicomponent Image Segmentation

Image segmentation is an important stage in many applications such as image, video and computer processing. Gener-ally image interpretation depends on it. The materials and methods used to demonstrate are described. The results are presented and analyzed. Several approaches and algorithms for image segmentation have been developed, but it is dif-ficult to evaluate the efficiency and to make an objective comparison of different segmentation methods. This general problem has been addressed for the evaluation of a segmentation result and the results are available in the literature. In this work, we first presented some criteria of evaluation of segmentation commonly used in image processing with reviews of their models. Then multicomponent synthetic images of known composition are applied to these criteria to explore the operation and evaluate its relevance. The results show that choosing an assessment method depends on the purpose, however the criterion of Zeboudj appears powerful for the evaluation of region segmentations for properly separated classes, on the contrary the criteria of Levine-Nazif and Borsotti are adapted to the methods of classification and permit to build homogeneous regions or classes. The values of the Rosenbeger criterion are generally low and similar, so hard to make a comparison of segmentations with this criterion

A Semi-Vectorial Hybrid Morphological Segmentation of Multicomponent Images Based on Multithreshold Analysis of Multidimensional Compact Histogram

In this work, we propose an original approach of semi-vectorial hybrid morphological segmentation for multicomponent images or multidimensional data by analyzing compact multidimensional histograms based on different orders. Its principle consists first of segment marginally each component of the multicomponent image into different numbers of classes fixed at K. The segmentation of each component of the image uses a scalar segmentation strategy by histogram analysis; we mainly count the methods by searching for peaks or modes of the histogram and those based on a multi-thresholding of the histogram. It is the latter that we have used in this paper, it relies particularly on the multi-thresholding method of OTSU. Then, in the case where i) each component of the image admits exactly K classes, K vector thresholds are constructed by an optimal pairing of which each component of the vector thresholds are those resulting from the marginal segmentations. In addition, the multidimensional compact histogram of the multicomponent image is computed and the attribute tuples or ‘colors’ of the histogram are ordered relative to the threshold vectors to produce (K + 1) intervals in the partial order giving rise to a segmentation of the multidimensional histogram into K classes. The remaining colors of the histogram are assigned to the closest class relative to their center of gravity. ii) In the contrary case, a vectorial spatial matching between the classes of the scalar components of the image is produced to obtain an over-segmentation, then an interclass fusion is performed to obtain a maximum of K classes. Indeed, the relevance of our segmentation method has been highlighted in relation to other methods, such as K-means, using unsupervised and supervised quantitative segmentation evaluation criteria. So the robustness of our method relatively to noise has been tested

Multichannel analysis of normal and continuous adventitious respiratory sounds for the assessment of pulmonary function in respiratory diseases

Premi extraordinari doctorat UPC curs 2015-2016, àmbit d’Enginyeria IndustrialRespiratory sounds (RS) are produced by turbulent airflows through the airways and are inhomogeneously transmitted through different media to the chest surface, where they can be recorded in a non-invasive way. Due to their mechanical nature and airflow dependence, RS are affected by respiratory diseases that alter the mechanical properties of the respiratory system. Therefore, RS provide useful clinical information about the respiratory system structure and functioning. Recent advances in sensors and signal processing techniques have made RS analysis a more objective and sensitive tool for measuring pulmonary function. However, RS analysis is still rarely used in clinical practice. Lack of a standard methodology for recording and processing RS has led to several different approaches to RS analysis, with some methodological issues that could limit the potential of RS analysis in clinical practice (i.e., measurements with a low number of sensors, no controlled airflows, constant airflows, or forced expiratory manoeuvres, the lack of a co-analysis of different types of RS, or the use of inaccurate techniques for processing RS signals). In this thesis, we propose a novel integrated approach to RS analysis that includes a multichannel recording of RS using a maximum of five microphones placed over the trachea and the chest surface, which allows RS to be analysed at the most commonly reported lung regions, without requiring a large number of sensors. Our approach also includes a progressive respiratory manoeuvres with variable airflow, which allows RS to be analysed depending on airflow. Dual RS analyses of both normal RS and continuous adventitious sounds (CAS) are also proposed. Normal RS are analysed through the RS intensity–airflow curves, whereas CAS are analysed through a customised Hilbert spectrum (HS), adapted to RS signal characteristics. The proposed HS represents a step forward in the analysis of CAS. Using HS allows CAS to be fully characterised with regard to duration, mean frequency, and intensity. Further, the high temporal and frequency resolutions, and the high concentrations of energy of this improved version of HS, allow CAS to be more accurately characterised with our HS than by using spectrogram, which has been the most widely used technique for CAS analysis. Our approach to RS analysis was put into clinical practice by launching two studies in the Pulmonary Function Testing Laboratory of the Germans Trias i Pujol University Hospital for assessing pulmonary function in patients with unilateral phrenic paralysis (UPP), and bronchodilator response (BDR) in patients with asthma. RS and airflow signals were recorded in 10 patients with UPP, 50 patients with asthma, and 20 healthy participants. The analysis of RS intensity–airflow curves proved to be a successful method to detect UPP, since we found significant differences between these curves at the posterior base of the lungs in all patients whereas no differences were found in the healthy participants. To the best of our knowledge, this is the first study that uses a quantitative analysis of RS for assessing UPP. Regarding asthma, we found appreciable changes in the RS intensity–airflow curves and CAS features after bronchodilation in patients with negative BDR in spirometry. Therefore, we suggest that the combined analysis of RS intensity–airflow curves and CAS features—including number, duration, mean frequency, and intensity—seems to be a promising technique for assessing BDR and improving the stratification of BDR levels, particularly among patients with negative BDR in spirometry. The novel approach to RS analysis developed in this thesis provides a sensitive tool to obtain objective and complementary information about pulmonary function in a simple and non-invasive way. Together with spirometry, this approach to RS analysis could have a direct clinical application for improving the assessment of pulmonary function in patients with respiratory diseases.Los sonidos respiratorios (SR) se generan con el paso del flujo de aire a través de las vías respiratorias y se transmiten de forma no homogénea hasta la superficie torácica. Dada su naturaleza mecánica, los SR se ven afectados en gran medida por enfermedades que alteran las propiedades mecánicas del sistema respiratorio. Por lo tanto, los SR proporcionan información clínica relevante sobre la estructura y el funcionamiento del sistema respiratorio. La falta de una metodología estándar para el registro y procesado de los SR ha dado lugar a la aparición de diferentes estrategias de análisis de SR con ciertas limitaciones metodológicas que podrían haber restringido el potencial y el uso de esta técnica en la práctica clínica (medidas con pocos sensores, flujos no controlados o constantes y/o maniobras forzadas, análisis no combinado de distintos tipos de SR o uso de técnicas poco precisas para el procesado de los SR). En esta tesis proponemos un método innovador e integrado de análisis de SR que incluye el registro multicanal de SR mediante un máximo de cinco micrófonos colocados sobre la tráquea yla superficie torácica, los cuales permiten analizar los SR en las principales regiones pulmonares sin utilizar un número elevado de sensores . Nuestro método también incluye una maniobra respiratoria progresiva con flujo variable que permite analizar los SR en función del flujo respiratorio. También proponemos el análisis combinado de los SR normales y los sonidos adventicios continuos (SAC), mediante las curvas intensidad-flujo y un espectro de Hilbert (EH) adaptado a las características de los SR, respectivamente. El EH propuesto representa un avance importante en el análisis de los SAC, pues permite su completa caracterización en términos de duración, frecuencia media e intensidad. Además, la alta resolución temporal y frecuencial y la alta concentración de energía de esta versión mejorada del EH permiten caracterizar los SAC de forma más precisa que utilizando el espectrograma, el cual ha sido la técnica más utilizada para el análisis de SAC en estudios previos. Nuestro método de análisis de SR se trasladó a la práctica clínica a través de dos estudios que se iniciaron en el laboratorio de pruebas funcionales del hospital Germans Trias i Pujol, para la evaluación de la función pulmonar en pacientes con parálisis frénica unilateral (PFU) y la respuesta broncodilatadora (RBD) en pacientes con asma. Las señales de SR y flujo respiratorio se registraron en 10 pacientes con PFU, 50 pacientes con asma y 20 controles sanos. El análisis de las curvas intensidad-flujo resultó ser un método apropiado para detectar la PFU , pues encontramos diferencias significativas entre las curvas intensidad-flujo de las bases posteriores de los pulmones en todos los pacientes , mientras que en los controles sanos no encontramos diferencias significativas. Hasta donde sabemos, este es el primer estudio que utiliza el análisis cuantitativo de los SR para evaluar la PFU. En cuanto al asma, encontramos cambios relevantes en las curvas intensidad-flujo yen las características de los SAC tras la broncodilatación en pacientes con RBD negativa en la espirometría. Por lo tanto, sugerimos que el análisis combinado de las curvas intensidad-flujo y las características de los SAC, incluyendo número, duración, frecuencia media e intensidad, es una técnica prometedora para la evaluación de la RBD y la mejora en la estratificación de los distintos niveles de RBD, especialmente en pacientes con RBD negativa en la espirometría. El método innovador de análisis de SR que se propone en esta tesis proporciona una nueva herramienta con una alta sensibilidad para obtener información objetiva y complementaria sobre la función pulmonar de una forma sencilla y no invasiva. Junto con la espirometría, este método puede tener una aplicación clínica directa en la mejora de la evaluación de la función pulmonar en pacientes con enfermedades respiratoriasAward-winningPostprint (published version

A supervised visual model for finding regions of interest in basal cell carcinoma images

This paper introduces a supervised learning method for finding diagnostic regions of interest in histopathological images. The method is based on the cognitive process of visual selection of relevant regions that arises during a pathologist's image examination. The proposed strategy emulates the interaction of the visual cortex areas V1, V2 and V4, being the V1 cortex responsible for assigning local levels of relevance to visual inputs while the V2 cortex gathers together these small regions according to some weights modulated by the V4 cortex, which stores some learned rules. This novel strategy can be considered as a complex mix of "bottom-up" and "top-down" mechanisms, integrated by calculating a unique index inside each region. The method was evaluated on a set of 338 images in which an expert pathologist had drawn the Regions of Interest. The proposed method outperforms two state-of-the-art methods devised to determine Regions of Interest (RoIs) in natural images. The quality gain with respect to an adaptated Itti's model which found RoIs was 3.6 dB in average, while with respect to the Achanta's proposal was 4.9 dB

Investigation of Microstructural and Carbon Deposition Effects in SOFC Anodes Through Modelling and Experiments

The investigation of the SOFC anode microstructural properties affected by microstructural parameters and degradation is the focus of this research. Imaging and image processing techniques are developed to achieve quantification of the anode microstructural information. The analytical and Computational Fluid Dynamics based modelling of the microstructure including the degradation effects developed in this work will enable the microstructure optimisation for achieving performance enhancements

Are visual working memory and episodic memory distinct processes? Insight from stroke patients by lesion-symptom mapping

Working memory and episodic memory are two different processes, although the nature of their interrelationship is debated. As these processes are predominantly studied in isolation, it is unclear whether they crucially rely on different neural substrates. To obtain more insight in this, 81 adults with sub-acute ischemic stroke and 29 elderly controls were assessed on a visual working memory task, followed by a surprise subsequent memory test for the same stimuli. Multivariate, atlas- and track-based lesion-symptom mapping (LSM) analyses were performed to identify anatomical correlates of visual memory. Behavioral results gave moderate evidence for independence between discriminability in working memory and subsequent memory, and strong evidence for a correlation in response bias on the two tasks in stroke patients. LSM analyses suggested there might be independent regions associated with working memory and episodic memory. Lesions in the right arcuate fasciculus were more strongly associated with discriminability in working memory than in subsequent memory, while lesions in the frontal operculum in the right hemisphere were more strongly associated with criterion setting in subsequent memory. These findings support the view that some processes involved in working memory and episodic memory rely on separate mechanisms, while acknowledging that there might also be shared processes. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00429-021-02281-0

Semi-Automatic Classification of Cementitious Materials using Scanning Electron Microscope Images

International audienceSegmentation and classification are prolific research topics in the image processing community, which have been more and more used in the context of analysis of cementitious materials, on images acquired with Scanning Electron Microscopes (SEM). Indeed, there is a need to be able to detect and to quantify the materials present in a cement paste in order to follow the chemical reactions occurring in the material even days after the solidification. In this paper, we propose a new approach for segmentation and classification of cementitious materials based on the denoising of the data with the Block Matching 3D (BM3D) algorithm, Binary Partition Tree (BPT) segmentation, Support Vector Machines (SVM) classification, and the interactivity with the user. The BPT provides a hierarchical representation of the spatial regions of the data, allowing a segmentation to be selected among the admissible partitions of the image. SVMs are used to obtain a classification map of the image. This approach combines state-of-the-art image processing tools with the interactivity with the user to allow a better segmentation to be performed, or to help the classifier discriminate the classes better. We show that the proposed approach outperforms a previous method on synthetic data and several real datasets coming from cement samples, both qualitatively with visual examination and quantitatively with the comparison of experimental results with theoretical ones

Bayesian analysis of data from segmented super-resolution images for quantifying protein clustering

Super-resolution imaging techniques have largely improved our capabilities to visualize nanometric structures in biological systems. Their application further enables one to potentially quantitate relevant parameters to determine the molecular organization and stoichiometry in cells. However, the inherently stochastic nature of the fluorescence emission and labeling strategies imposes the use of dedicated methods to accurately measure these parameters. Here, we describe a Bayesian approach to precisely quantitate the relative abundance of molecular oligomers from segmented images. The distribution of proxies for the number of molecules in a cluster -- such as the number of localizations or the fluorescence intensity -- is fitted via a nested sampling algorithm to compare mixture models of increasing complexity and determine the optimal number of mixture components and their weights. We test the performance of the algorithm on {\it in silico} data as a function of the number of data points, threshold, and distribution shape. We compare these results to those obtained with other statistical methods, showing the improved performance of our approach. Our method provides a robust tool for model selection in fitting data extracted from fluorescence imaging, thus improving the precision of parameter determination. Importantly, the largest benefit of this method occurs for small-statistics or incomplete datasets, enabling accurate analysis at the single image level. We further present the results of its application to experimental data obtained from the super-resolution imaging of dynein in HeLa cells, confirming the presence of a mixed population of cytoplasmatic single motors and higher-order structures.Comment: 17 pages, 6 figure

White matter changes measured by multi-component MR Fingerprinting in multiple sclerosis

T2-hyperintense lesions are the key imaging marker of multiple sclerosis (MS). Previous studies have shown that the white matter surrounding such lesions is often also affected by MS. Our aim was to develop a new method to visualize and quantify the extent of white matter tissue changes in MS based on relaxometry properties. We applied a fast, multi-parametric quantitative MRI approach and used a multi-component MR Fingerprinting (MC-MRF) analysis. We assessed the differences in the MRF component representing prolongedrelaxation time between patients with MS and controls and studied the relation between this component's volume and structural white matter damage identified on FLAIR MRI scans in patients with MS. A total of 48 MS patients at two different sites and 12 healthy controls were scanned with FLAIR and MRF-EPI MRI scans. MRF scans were analyzed with a joint-sparsity multi-component analysis to obtain magnetization fraction maps of different components, representing tissues such as myelin water, white matter, gray matter and cerebrospinal fluid. In the MS patients, an additional component was identified with increased transverse relaxation times compared to the white matter, likely representing changes in free water content. Patients with MS had a higher volume of the long- component in the white matter of the brain compared to healthy controls (B (95%-CI) = 0.004 (0.0006–0.008), p = 0.02). Furthermore, this MRF component had a moderate correlation (correlation coefficient R 0.47) with visible structural white matter changes on the FLAIR scans. Also, the component was found to be more extensive compared to structural white matter changes in 73% of MS patients. In conclusion, our MRF acquisition and analysis captured white matter tissue changes in MS patients compared to controls. In patients these tissue changes were more extensive compared to visually detectable white matter changes on FLAIR scans. Our method provides a novel way to quantify the extent of white matter changes in MS patients, which is underestimated using only conventional clinical MRI scans.</p