Persistent-homology-based gait recognition

Gait recognition is an important biometric technique for video surveillance tasks, due to the advantage of using it at distance. In this paper, we present a persistent homology-based method to extract topological features (the so-called topological gait signature) from the the body silhouettes of a gait sequence. It has been used before in sev- eral conference papers of the same authors for human identi cation, gender classi cation, carried object detection and monitoring human activities at distance. The novelty of this paper is the study of the sta- bility of the topological gait signature under small perturbations and the number of gait cycles contained in a gait sequence. In other words, we show that the topological gait signature is robust to the presence of noise in the body silhouettes and to the number of gait cycles con- tained in a given gait sequence. We also show that computing our topological gait signature of only the lowest fourth part of the body silhouette, we avoid the upper body movements that are unrelated to the natural dynamic of the gait, caused for example by carrying a bag or wearing a coat.Ministerio de Economía y Competitividad MTM2015-67072-

Persistent homology-based gait recognition robust to upper body variations

Gait recognition is nowadays an important biometric technique for video surveillance tasks, due to the advantage of using it at distance. However, when the upper body movements are unrelated to the natural dynamic of the gait, caused for example by carrying a bag or wearing a coat, the reported results show low accuracy. With the goal of solving this problem, we apply persistent homology to extract topological features from the lowest fourth part of the body silhouettes. To obtain the features, we modify our previous algorithm for gait recognition, to improve its efficacy and robustness to variations in the amount of simplices of the gait complex. We evaluate our approach using the CASIA-B dataset, obtaining a considerable accuracy improvement of 93:8%, achieving at the same time invariance to upper body movements unrelated with the dynamic of the gait.Ministerio de Economía y Competitividad MTM2015-67072-

Topological signature for periodic motion recognition

In this paper, we present an algorithm that computes the topological signature for a given periodic motion sequence. Such signature consists of a vector obtained by persistent homology which captures the topological and geometric changes of the object that models the motion. Two topological signatures are compared simply by the angle between the corresponding vectors. With respect to gait recognition, we have tested our method using only the lowest fourth part of the body's silhouette. In this way, the impact of variations in the upper part of the body, which are very frequent in real scenarios, decreases considerably. We have also tested our method using other periodic motions such as running or jumping. Finally, we formally prove that our method is robust to small perturbations in the input data and does not depend on the number of periods contained in the periodic motion sequence.Comment: arXiv admin note: substantial text overlap with arXiv:1707.0698

Persistent Homology of Attractors For Action Recognition

In this paper, we propose a novel framework for dynamical analysis of human actions from 3D motion capture data using topological data analysis. We model human actions using the topological features of the attractor of the dynamical system. We reconstruct the phase-space of time series corresponding to actions using time-delay embedding, and compute the persistent homology of the phase-space reconstruction. In order to better represent the topological properties of the phase-space, we incorporate the temporal adjacency information when computing the homology groups. The persistence of these homology groups encoded using persistence diagrams are used as features for the actions. Our experiments with action recognition using these features demonstrate that the proposed approach outperforms other baseline methods.Comment: 5 pages, Under review in International Conference on Image Processin

Persistent topology for natural data analysis - A survey

Natural data offer a hard challenge to data analysis. One set of tools is being developed by several teams to face this difficult task: Persistent topology. After a brief introduction to this theory, some applications to the analysis and classification of cells, lesions, music pieces, gait, oil and gas reservoirs, cyclones, galaxies, bones, brain connections, languages, handwritten and gestured letters are shown

Topological features for monitoring human activities at distance

In this paper, a topological approach for monitoring human activities is presented. This approach makes possible to protect the person’s privacy hiding details that are not essential for processing a security alarm. First, a stack of human silhouettes, extracted by background subtraction and thresholding, are glued through their gravity centers, forming a 3D digital binary image I. Secondly, different orders of the simplices are applied on a simplicial complex obtained from I, which capture relations among the parts of the human body when walking. Finally, a topological signature is extracted from the persistence diagrams according to each order. The measure cosine is used to give a similarity value between topological signatures. In this way, the powerful topological tool known as persistent homology is novelty adapted to deal with gender classification, person identification, carrying bag detection and simple action recognition. Four experiments show the strength of the topological feature used; three of they use the CASIA-B database, and the fourth use the KTH database to present the results in the case of simple actions recognition. In the first experiment the named topological signature is evaluated, obtaining 98.8% (lateral view) of correct classification rates for gender identification. In the second one are shown results for person identification, obtaining an average of 98.5%. In the third one the result obtained is 93.8% for carrying bag detection. And in the last experiment the results were 97.7% walking and 97.5% running, which were the actions took from the KTH database

Gait-based gender classification using persistent homology

In this paper, a topological approach for gait-based gender recognition is presented. First, a stack of human silhouettes, extracted by background subtraction and thresholding, were glued through their gravity centers, forming a 3D digital image I. Second, different filters (i.e. particular orders of the simplices) are applied on ∂ K(I) (a simplicial complex obtained from I) which capture relations among the parts of the human body when walking. Finally, a topological signature is extracted from the persistence diagram according to each filter. The measure cosine is used to give a similarity value between topological signatures. The novelty of the paper is a notion of robustness of the provided method (which is also valid for gait recognition). Three experiments are performed using all human-camera view angles provided in CASIA-B database. The first one evaluates the named topological signature obtaining 98.3% (lateral view) of correct classification rates, for gender identification. The second one shows results for different human-camera distances according to training and test (i.e. training with a human-camera distance and test with a different one). The third one shows that upper body is more discriminative than lower body

Human gait identification using persistent homology

This paper shows an image/video application using topological invariants for human gait recognition. Using a background subtraction approach, a stack of silhouettes is extracted from a subsequence and glued through their gravity centers, forming a 3D digital image I. From this 3D representation, the border simplicial complex ∂ K(I) is obtained. We order the triangles of ∂ K(I) obtaining a sequence of subcomplexes of ∂ K(I). The corresponding filtration F captures relations among the parts of the human body when walking. Finally, a topological gait signature is extracted from the persistence barcode according to F. In this work we obtain 98.5% correct classification rates on CASIA-B database

Gait-based carried object detection using persistent homology

There are surveillance scenarios where it is important to emit an alarm when a person carrying an object is detected. In order to detect when a person is carrying an object, we build models of naturally-walking and object-carrying persons using topological features. First, a stack of human silhouettes, extracted by background subtraction and thresholding, are glued through their gravity centers, forming a 3D digital image I. Second, different filters (i.e. orderings of the cells) are applied on ∂ K(I) (cubical complex obtained from I) which capture relations among the parts of the human body when walking. Finally, a topological signature is extracted from the persistence diagrams according to each filter. We build some clusters of persons walking naturally, without carrying object and some clusters of persons carrying bags. We obtain vector prototypes for each cluster. Simple distances to the means are calculated for detecting the presence of carrying object. The measure cosine is used to give a similarity value between topological signatures. The accuracies obtained are 95.7% and 95.9% for naturally-walking and object-carrying respectively