13,999 research outputs found
Pattern vectors from algebraic graph theory
Graphstructures have proven computationally cumbersome for pattern analysis. The reason for this is that, before graphs can be converted to pattern vectors, correspondences must be established between the nodes of structures which are potentially of different size. To overcome this problem, in this paper, we turn to the spectral decomposition of the Laplacian matrix. We show how the elements of the spectral matrix for the Laplacian can be used to construct symmetric polynomials that are permutation invariants. The coefficients of these polynomials can be used as graph features which can be encoded in a vectorial manner. We extend this representation to graphs in which there are unary attributes on the nodes and binary attributes on the edges by using the spectral decomposition of a Hermitian property matrix that can be viewed as a complex analogue of the Laplacian. To embed the graphs in a pattern space, we explore whether the vectors of invariants can be embedded in a low- dimensional space using a number of alternative strategies, including principal components analysis ( PCA), multidimensional scaling ( MDS), and locality preserving projection ( LPP). Experimentally, we demonstrate that the embeddings result in well- defined graph clusters. Our experiments with the spectral representation involve both synthetic and real- world data. The experiments with synthetic data demonstrate that the distances between spectral feature vectors can be used to discriminate between graphs on the basis of their structure. The real- world experiments show that the method can be used to locate clusters of graphs
Regularized Wasserstein Means for Aligning Distributional Data
We propose to align distributional data from the perspective of Wasserstein
means. We raise the problem of regularizing Wasserstein means and propose
several terms tailored to tackle different problems. Our formulation is based
on the variational transportation to distribute a sparse discrete measure into
the target domain. The resulting sparse representation well captures the
desired property of the domain while reducing the mapping cost. We demonstrate
the scalability and robustness of our method with examples in domain
adaptation, point set registration, and skeleton layout
Fast and robust curve skeletonization for real-world elongated objects
We consider the problem of extracting curve skeletons of three-dimensional,
elongated objects given a noisy surface, which has applications in agricultural
contexts such as extracting the branching structure of plants. We describe an
efficient and robust method based on breadth-first search that can determine
curve skeletons in these contexts. Our approach is capable of automatically
detecting junction points as well as spurious segments and loops. All of that
is accomplished with only one user-adjustable parameter. The run time of our
method ranges from hundreds of milliseconds to less than four seconds on large,
challenging datasets, which makes it appropriate for situations where real-time
decision making is needed. Experiments on synthetic models as well as on data
from real world objects, some of which were collected in challenging field
conditions, show that our approach compares favorably to classical thinning
algorithms as well as to recent contributions to the field.Comment: 47 pages; IEEE WACV 2018, main paper and supplementary materia
An original framework for understanding human actions and body language by using deep neural networks
The evolution of both fields of Computer Vision (CV) and Artificial Neural Networks (ANNs) has allowed the development of efficient automatic systems for the analysis of people's behaviour.
By studying hand movements it is possible to recognize gestures, often used by people to communicate information in a non-verbal way.
These gestures can also be used to control or interact with devices without physically touching them. In particular, sign language and semaphoric hand gestures are the two foremost areas of interest due to their importance in Human-Human Communication (HHC) and Human-Computer Interaction (HCI), respectively.
While the processing of body movements play a key role in the action recognition and affective computing fields. The former is essential to understand how people act in an environment, while the latter tries to interpret people's emotions based on their poses and movements;
both are essential tasks in many computer vision applications, including event recognition, and video surveillance.
In this Ph.D. thesis, an original framework for understanding Actions and body language is presented. The framework is composed of three main modules: in the first one, a Long Short Term Memory Recurrent Neural Networks (LSTM-RNNs) based method for the Recognition of Sign Language and Semaphoric Hand Gestures is proposed; the second module presents a solution based on 2D skeleton and two-branch stacked LSTM-RNNs for action recognition in video sequences; finally, in the last module, a solution for basic non-acted emotion recognition by using 3D skeleton and Deep Neural Networks (DNNs) is provided.
The performances of RNN-LSTMs are explored in depth, due to their ability to model the long term contextual information of temporal sequences, making them suitable for analysing body movements.
All the modules were tested by using challenging datasets, well known in the state of the art, showing remarkable results compared to the current literature methods
Active skeleton for bacteria modeling
The investigation of spatio-temporal dynamics of bacterial cells and their
molecular components requires automated image analysis tools to track cell
shape properties and molecular component locations inside the cells. In the
study of bacteria aging, the molecular components of interest are protein
aggregates accumulated near bacteria boundaries. This particular location makes
very ambiguous the correspondence between aggregates and cells, since computing
accurately bacteria boundaries in phase-contrast time-lapse imaging is a
challenging task. This paper proposes an active skeleton formulation for
bacteria modeling which provides several advantages: an easy computation of
shape properties (perimeter, length, thickness, orientation), an improved
boundary accuracy in noisy images, and a natural bacteria-centered coordinate
system that permits the intrinsic location of molecular components inside the
cell. Starting from an initial skeleton estimate, the medial axis of the
bacterium is obtained by minimizing an energy function which incorporates
bacteria shape constraints. Experimental results on biological images and
comparative evaluation of the performances validate the proposed approach for
modeling cigar-shaped bacteria like Escherichia coli. The Image-J plugin of the
proposed method can be found online at http://fluobactracker.inrialpes.fr.Comment: Published in Computer Methods in Biomechanics and Biomedical
Engineering: Imaging and Visualizationto appear i
Statistical analysis of the growth and morphology of the filamentous microbe Streptomyces coelicolor
- …