Classification-Driven Stochastic Watershed: Application to Multispectral Segmentation

ISBN 978-0-89208-262-6This product consists of a hardcopy booklet of abstracts and a CD-ROM which contains the full texts of the presentations from the 2008 CGIV conference.issn 2158-6330eissn 2169-2947International audienceThe aim of this paper is to present a general methodology based on multispectral mathematical morphology in order to segment multispectral images. The methods consists in computing a probability density function pdf of contours conditioned by a spectral classification. The pdf is conditioned through regionalized random balls markers thanks to a new algorithm. Therefore the pdf contains spatial and spectral information. Finally, the pdf is segmented by a watershed with seeds (i.e., markers) coming from the classification. Consequently, a complete method, based on a classification-driven stochastic watershed is introduced. This approach requires a unique and robust parameter: the number of classes which is the same for similar images. Moreover, an efficient way to select factor axes, of Factor Correspondence Analysis (FCA), based on signal-to-noise ratio on factor pixels is presented

A New Spatio-Spectral Morphological Segmentation For Multi-Spectral Remote-Sensing Images

International audienceA general framework of spatio-spectral segmentation for multi-spectral images is introduced in this paper. The method is based on classification-driven stochastic watershed (WS) by Monte Carlo simulations, and it gives more regular and reliable contours than standard WS. The present approach is decomposed into several sequential steps. First, a dimensionality-reduction stage is performed using the factor-correspondence analysis method. In this context, a new way to select the factor axes (eigenvectors) according to their spatial information is introduced. Then, a spectral classification produces a spectral pre-segmentation of the image. Subsequently, a probability density function (pdf) of contours containing spatial and spectral information is estimated by simulation using a stochastic WS approach driven by the spectral classification. The pdf of the contours is finally segmented by a WS controlled by markers from a regularization of the initial classification

WPU-Net: Boundary Learning by Using Weighted Propagation in Convolution Network

Deep learning has driven a great progress in natural and biological image processing. However, in material science and engineering, there are often some flaws and indistinctions in material microscopic images induced from complex sample preparation, even due to the material itself, hindering the detection of target objects. In this work, we propose WPU-net that redesigns the architecture and weighted loss of U-Net, which forces the network to integrate information from adjacent slices and pays more attention to the topology in boundary detection task. Then, the WPU-net is applied into a typical material example, i.e., the grain boundary detection of polycrystalline material. Experiments demonstrate that the proposed method achieves promising performance and outperforms state-of-the-art methods. Besides, we propose a new method for object tracking between adjacent slices, which can effectively reconstruct 3D structure of the whole material. Finally, we present a material microscopic image dataset with the goal of advancing the state-of-the-art in image processing for material science.Comment: technical repor

Grounding semantics in robots for Visual Question Answering

In this thesis I describe an operational implementation of an object detection and description system that incorporates in an end-to-end Visual Question Answering system and evaluated it on two visual question answering datasets for compositional language and elementary visual reasoning