Learning gender from human gaits and faces

Computer vision based gender classification is an important component in visual surveillance systems. In this paper, we investigate gender classification from human gaits in image sequences, a relatively understudied problem. Moreover, we propose to fuse gait and face for improved gender discrimination. We exploit Canonical Correlation Analysis (CCA), a powerful tool that is well suited for relating two sets of measurements, to fuse the two modalities at the feature level. Experiments demonstrate that our multimodal gender recognition system achieves the superior recognition performance of 97.2 % in large datasets. In this paper, we investigate gender classification from human gaits in image sequences using machine learning methods. Considering each modality, face or gait, in isolation has its inherent weakness and limitations, we further propose to fuse gait and face for improved gender discrimination. We exploit Canonical Correlation Analysis (CCA), a powerful tool that is well suited for relating two sets of signals, to fuse the two modalities at the feature level. Experiments on large dataset demonstrate that our multimodal gender recognition system achieves the superior recognition performance of 97.2%. We plot in Figure 1 the flow chart of our multimodal gender recognition system. 1

Gait Recognition By Walking and Running: A Model-Based Approach

Gait is an emerging biometric for which some techniques, mainly holistic, have been developed to recognise people by their walking patterns. However, the possibility of recognising people by the way they run remains largely unexplored. The new analytical model presented in this paper is based on the biomechanics of walking and running, and will serve as the foundation of an automatic person recognition system that is invariant to these distinct gaits. A bilateral and dynamically coupled oscillator is the key concept underlying this work. Analysis shows that this new model can be used to automatically describe walking and running subjects without parameter selection. Temporal template matching that takes into account the whole sequence of a gait cycle is applied to extract the angles of thigh and lower leg rotation. The phase-weighted magnitudes of the lower order Fourier components of these rotations form the gait signature. Classification of walking and running subjects is performed using the k-nearest-neighbour classifier. Recognition rates are similar to that achieved by other techniques with a similarly sized database. Future work will investigate feature set selection to improve the recognition rate and will determine the invariance attributes, for inter- and intra- class, of both walking and running

Gait Classification Based on Micro-Doppler Features

This paper focuses on the classification of human gaits based on micro-Doppler signatures. The micro-Doppler signatures can represent detailed information about the human gaits, which helps in judging the threat of a personnel target. The proposed method consists of three major steps. Firstly, the micro-Doppler signatures are obtained by performing time-frequency analysis on the radar data. Then two micro-Doppler features are extracted from the time-frequency domain. Finally, the one-versus-one support vector machine (SVM) is used to realize multi-class classification. Experiments on real data show that, with the selected features, high classification accuracy of the human gaits of interest can be achieved

Embedded neural network for real-time animal behavior classification

Recent biological studies have focused on understanding animal interactions and welfare. To help biolo- gists to obtain animals’ behavior information, resources like wireless sensor networks are needed. More- over, large amounts of obtained data have to be processed off-line in order to classify different behaviors.There are recent research projects focused on designing monitoring systems capable of measuring someanimals’ parameters in order to recognize and monitor their gaits or behaviors. However, network unre- liability and high power consumption have limited their applicability.In this work, we present an animal behavior recognition, classification and monitoring system based ona wireless sensor network and a smart collar device, provided with inertial sensors and an embeddedmulti-layer perceptron-based feed-forward neural network, to classify the different gaits or behaviorsbased on the collected information. In similar works, classification mechanisms are implemented in aserver (or base station). The main novelty of this work is the full implementation of a reconfigurableneural network embedded into the animal’s collar, which allows a real-time behavior classification andenables its local storage in SD memory. Moreover, this approach reduces the amount of data transmittedto the base station (and its periodicity), achieving a significantly improving battery life. The system hasbeen simulated and tested in a real scenario for three different horse gaits, using different heuristics andsensors to improve the accuracy of behavior recognition, achieving a maximum of 81%.Junta de Andalucía P12-TIC-130

The Muscle-Mechanical Compromise Framework: Implications for the Scaling of Gait and Posture

Many aspects of animal and human gait and posture cannot be predicted from purely mechanical work minimization or entirely based on optimizing muscle efficiency. Here, the Muscle-Mechanical Compromise Framework is introduced as a conceptual paradigm for considering the interactions and compromises between these two objectives. Current assumptions in implementing the Framework are presented. Implications of the compromise are discussed and related to the scaling of running mechanics and animal posture

Statistical Approach to the Characterization and Recognition of Human Gaits

This thesis addresses the final portion of a complete process for human gait recognition. The thesis takes as input information that has been generated from videotaping walking individuals and converting their gaits into numerical data that measures the locations of various points on the body through time. Beginning with this data, this thesis uses a variety of mathematical and statistical methods to create identifying signatures for each individual and identify them on the basis of that signature. The end goal is to achieve under controlled laboratory conditions human gait recognition, an identification method which does not require contact or cooperation with the individual and which can be done unobserved from a distance. Various mathematical models such as the construction of classifiers utilizing Minimum Euclidean Distance, Minimum Mahalanobis Distance and Quadratic Discriminant Functions are employed on both static and dynamic characteristics in order to fully analyze gait data for the purposes of identification. This thesis starts with previously generated numerical data from a videotaped sequence of images of a subject walking across a room that contains the positions through time of a wide variety of different markers on the individual’s body. A MatLab program is initially written to convert the data into a usable format. A variety of mathematical techniques are then employed to generate several classifiers of an individual from a small set of gaits that can be used to identify their gait in any data set

Micro-doppler-based in-home aided and unaided walking recognition with multiple radar and sonar systems

Published in IET Radar, Sonar and Navigation. Online first 21/06/2016.The potential for using micro-Doppler signatures as a basis for distinguishing between aided and unaided gaits is considered in this study for the purpose of characterising normal elderly gait and assessment of patient recovery. In particular, five different classes of mobility are considered: normal unaided walking, walking with a limp, walking using a cane or tripod, walking with a walker, and using a wheelchair. This presents a challenging classification problem as the differences in micro-Doppler for these activities can be quite slight. Within this context, the performance of four different radar and sonar systems – a 40 kHz sonar, a 5.8 GHz wireless pulsed Doppler radar mote, a 10 GHz X-band continuous wave (CW) radar, and a 24 GHz CW radar – is evaluated using a broad range of features. Performance improvements using feature selection is addressed as well as the impact on performance of sensor placement and potential occlusion due to household objects. Results show that nearly 80% correct classification can be achieved with 10 s observations from the 24 GHz CW radar, whereas 86% performance can be achieved with 5 s observations of sonar

Take an Emotion Walk: Perceiving Emotions from Gaits Using Hierarchical Attention Pooling and Affective Mapping

We present an autoencoder-based semi-supervised approach to classify perceived human emotions from walking styles obtained from videos or motion-captured data and represented as sequences of 3D poses. Given the motion on each joint in the pose at each time step extracted from 3D pose sequences, we hierarchically pool these joint motions in a bottom-up manner in the encoder, following the kinematic chains in the human body. We also constrain the latent embeddings of the encoder to contain the space of psychologically-motivated affective features underlying the gaits. We train the decoder to reconstruct the motions per joint per time step in a top-down manner from the latent embeddings. For the annotated data, we also train a classifier to map the latent embeddings to emotion labels. Our semi-supervised approach achieves a mean average precision of 0.84 on the Emotion-Gait benchmark dataset, which contains both labeled and unlabeled gaits collected from multiple sources. We outperform current state-of-art algorithms for both emotion recognition and action recognition from 3D gaits by 7%--23% on the absolute. More importantly, we improve the average precision by 10%--50% on the absolute on classes that each makes up less than 25% of the labeled part of the Emotion-Gait benchmark dataset.Comment: In proceedings of the 16th European Conference on Computer Vision, 2020. Total pages 18. Total figures 5. Total tables

Personnel recognition and gait classification based on multistatic micro-doppler signatures using deep convolutional neural networks

In this letter, we propose two methods for personnel recognition and gait classification using deep convolutional neural networks (DCNNs) based on multistatic radar micro-Doppler signatures. Previous DCNN-based schemes have mainly focused on monostatic scenarios, whereas directional diversity offered by multistatic radar is exploited in this letter to improve classification accuracy. We first propose the voted monostatic DCNN (VMo-DCNN) method, which trains DCNNs on each receiver node separately and fuses the results by binary voting. By merging the fusion step into the network architecture, we further propose the multistatic DCNN (Mul-DCNN) method, which performs slightly better than VMo-DCNN. These methods are validated on real data measured with a 2.4-GHz multistatic radar system. Experimental results show that the Mul-DCNN achieves over 99% accuracy in armed/unarmed gait classification using only 20% training data and similar performance in two-class personnel recognition using 50% training data, which are higher than the accuracy obtained by performing DCNN on a single radar node