Comparative analysis and fusion of spatiotemporal information for footstep recognition

Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. R. Vera-Rodriguez, J. S. D. Mason, J. Fierrez, and J. Ortega-Garcia, "Comparative analysis and fusion of spatiotemporal information for footstep recognition", Pattern Analysis and Machine Intelligence, IEEE Transaction, vol. 35, no. 4, pp. 823-834, August 2012Footstep recognition is a relatively new biometric which aims to discriminate people using walking characteristics extracted from floor-based sensors. This paper reports for the first time a comparative assessment of the spatiotemporal information contained in the footstep signals for person recognition. Experiments are carried out on the largest footstep database collected to date, with almost 20,000 valid footstep signals and more than 120 people. Results show very similar performance for both spatial and temporal approaches (5 to 15 percent EER depending on the experimental setup), and a significant improvement is achieved for their fusion (2.5 to 10 percent EER). The assessment protocol is focused on the influence of the quantity of data used in the reference models, which serves to simulate conditions of different potential applications such as smart homes or security access scenarios.Ruben Vera-Rodriguez, Julian Fierrez and Javier Ortega Garcia are supported by projects Contexts (S2009/TIC-1485), Bio-Challenge (TEC2009-11186), TeraSense (CSD2008-00068) and ‘Catedra UAM-Telefonica’

User Identification Using Gait Patterns on UbiFloorII

This paper presents a system of identifying individuals by their gait patterns. We take into account various distinguishable features that can be extracted from a user’s gait and then divide them into two classes: walking pattern and stepping pattern. The conditions we assume are that our target environments are domestic areas, the number of users is smaller than 10, and all users ambulate with bare feet considering the everyday lifestyle of the Korean home. Under these conditions, we have developed a system that identifies individuals’ gait patterns using our biometric sensor, UbiFloorII. We have created UbiFloorII to collect walking samples and created software modules to extract the user’s gait pattern. To identify the users based on the gait patterns extracted from walking samples over UbiFloorII, we have deployed multilayer perceptron network, a feedforward artificial neural network model. The results show that both walking pattern and stepping pattern extracted from users’ gait over the UbiFloorII are distinguishable enough to identify the users and that fusing two classifiers at the matching score level improves the recognition accuracy. Therefore, our proposed system may provide unobtrusive and automatic user identification methods in ubiquitous computing environments, particularly in domestic areas

Analysis of spatio-temporal representations for robust footstep recognition with deep residual neural networks

IEEE: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible.”Human footsteps can provide a unique behavioural pattern for robust biometric systems. We propose spatio-temporal footstep representations from floor-only sensor data in advanced computational models for automatic biometric verification. Our models deliver an artificial intelligence capable of effectively differentiating the fine-grained variability of footsteps between legitimate users (clients) and impostor users of the biometric system. The methodology is validated in the largest to date footstep database, containing nearly 20,000 footstep signals from more than 120 users. The database is organized by considering a large cohort of impostors and a small set of clients to verify the reliability of biometric systems. We provide experimental results in 3 critical data-driven security scenarios, according to the amount of footstep data made available for model training: at airports security checkpoints (smallest training set), workspace environments (medium training set) and home environments (largest training set). We report state-of-the-art footstep recognition rates with an optimal equal false acceptance and false rejection rate of 0.7% (equal error rate), an improvement ratio of 371% from previous state-of-the-art. We perform a feature analysis of deep residual neural networks showing effective clustering of client's footstep data and provide insights of the feature learning process.This work has been partially supported by Cognimetrics TEC2015-70627-R MINECO/FEDE

Multi-level Adversarial Spatio-temporal Learning for Footstep Pressure based FoG Detection

Freezing of gait (FoG) is one of the most common symptoms of Parkinson's disease, which is a neurodegenerative disorder of the central nervous system impacting millions of people around the world. To address the pressing need to improve the quality of treatment for FoG, devising a computer-aided detection and quantification tool for FoG has been increasingly important. As a non-invasive technique for collecting motion patterns, the footstep pressure sequences obtained from pressure sensitive gait mats provide a great opportunity for evaluating FoG in the clinic and potentially in the home environment. In this study, FoG detection is formulated as a sequential modelling task and a novel deep learning architecture, namely Adversarial Spatio-temporal Network (ASTN), is proposed to learn FoG patterns across multiple levels. A novel adversarial training scheme is introduced with a multi-level subject discriminator to obtain subject-independent FoG representations, which helps to reduce the over-fitting risk due to the high inter-subject variance. As a result, robust FoG detection can be achieved for unseen subjects. The proposed scheme also sheds light on improving subject-level clinical studies from other scenarios as it can be integrated with many existing deep architectures. To the best of our knowledge, this is one of the first studies of footstep pressure-based FoG detection and the approach of utilizing ASTN is the first deep neural network architecture in pursuit of subject-independent representations. Experimental results on 393 trials collected from 21 subjects demonstrate encouraging performance of the proposed ASTN for FoG detection with an AUC 0.85

Biodegradable dual semicircular patch antenna tile for smart floors

A dual semicircular microstrip patch antenna implemented on a biodegradable substrate is presented for operation in the [863-873] MHz and [2.4-2.5] GHz frequency bands. To cover these frequency bands, two semicircular patches are compactly integrated onto a biodegradable cork tile, commonly found as support in laminate flooring, serving as a substrate. Thereby, the antenna tile may be seamlessly embedded as a sublayer of the floor structure. A higher-order mode is generated by applying via pins in the antenna topology to produce a conical radiation pattern with a null at broadside and sectoral coverage in the vertical plane. As such, the concealed floor antenna covers all azimuth angles of arrival in smart houses. The antenna performance is fully validated, also when the tile is covered by different polyvinyl chloride sheets. Owing to the supplementary design margins, the antenna impedance bandwidth remains covered. Moreover, the radiation patterns are measured in various elevation planes. Under standalone conditions, a radiation efficiency and a maximum gain of 74.3% and 5.8 dBi at 2.45 GHz and 48.1% and 2 dBi at 868 MHz are, respectively, obtained. Its omnidirectional coverage in the horizontal plane, stable performance on the inhomogeneous and biocompatible cork substrate and for various inhomogeneous superstrates, and its low-profile integration make the proposed antenna an excellent candidate for smart floors and smart houses