Sign language gesture recognition with bispectrum features using SVM

Wi-Fi based sensing system captures the signal reflections due to human gestures as Channel State Information (CSI) values in subcarrier level for accurately predicting the fine-grained gestures. The proposed work explores the Higher Order Statistical (HOS) method by deriving bispectram features (BF) from raw signal by adopting a Conditional Informative Feature Extraction (CIFE) technique from information theory to form a subset of informative and best features. Support Vector Machine (SVM) classifier is adopted in the present work for classifying the gesture and to measure the prediction accuracy. The present work is validated on a secondary dataset, SignFi, having data collected from two different environments with varying number of users and sign gestures. SVM reports an overall accuracy of 83.8%, 94.1%, 74.9% and 75.6% in different environments/scenarios.Taylor's University through its TAYLOR'S PhD SCHOLARSHIP Programmeinfo:eu-repo/semantics/publishedVersio

The Evolution of Wi-Fi Technology in Human Motion Recognition: Concepts, Techniques and Future Works

. Human motion recognition is an important topic in computer vision as well as security. It is used in scientific research, surveillance cameras industry and robotics technology as well. The human interaction with the objects creates a complex stance. Multiple artefacts such as clutter, occlusions, and backdrop diversity contribute to the complexity of this technology. Wi-Fi signals with the usage of their features could help solve some of these issues, with the help of other wearable sensors, such as: RGB-D camera, IR sensor (thermal camera), inertial sensor etc. This paper reviews various approaches for Wi-Fi human motion recognition systems, their analytical methodologies, challenges and proposed techniques along with the aspects to this paper: (a) applications; (b) single and multi-modality sensing; (c) Wi-Fi-based techniques; d) challenges and future works. More research related to Wi-Fi human related activity recognition can be encouraged and improved

Synthetic Micro-Doppler Signatures of Non-Stationary Channels for the Design of Human Activity Recognition Systems

The main aim of this dissertation is to generate synthetic micro-Doppler signatures and TV-MDSs to train the HACs. This is achieved by developing non-stationary fixed-tofixed (F2F) indoor channel models. Such models provide an in-depth understanding of the channel parameters that influence the micro-Doppler signatures and TV-MDSs. Hence, the proposed non-stationary channel models help to generate the micro-Doppler signatures and the TV-MDSs, which fit those of the collected measurement data. First, we start with a simple two-dimensional (2D) non-stationary F2F channel model with fixed and moving scatterers. Such a model assumes that the moving scatterers are moving in 2D geometry with simple time variant (TV) trajectories and they have the same height as the transmitter and the receiver antennas. The model of the Doppler shifts caused by the moving scatterers in 2D space is provided. The micro-Doppler signature of this model is explored by employing the spectrogram of which a closed-form expression is derived. Moreover, we demonstrate how the TV-MDSs can be computed from the spectrograms. The aforementioned model is extended to provide two three-dimensional (3D) nonstationary F2F channel models. Such models allow simulating the micro-Doppler signatures influenced by the 3D trajectories of human activities, such as walking and falling. Moreover, expressions of the trajectories of these human activities are also given. Approximate solutions of the spectrograms of these channels are provided by approximating the Doppler shifts caused by the human activities into linear piecewise functions of time. The impact of these activities on the micro-Doppler signatures and the TV-MDSs of the simulated channel models is explored. The work done in this dissertation is not limited to analyzing micro-Doppler signatures and the TV-MDSs of the simulated channel models, but also includes those of the measured channels. The channel-state-information (CSI) software tool installed on commercial-off-theshelf (COTS) devices is utilized to capture complex channel transfer function (CTF) data under the influence of human activities. To mitigate the TV phase distortions caused by the clock asynchronization between the transmitter and receiver stations, a back-to-back (B2B) connection is employed. Models of the measured CTF and its true phases are also shown. The true micro-Doppler signatures and TV-MDSs of the measured CTF are analyzed. The results showed that the CSI tool is reliable to validate the proposed channel models. This allows the micro-Doppler signatures and the TV-MDSs extracted from the data collected with this tool to be used to train the HACs.publishedVersio

WiFi-Based Real-Time Calibration-Free Passive Human Motion Detection

With the rapid development of WLAN technology, wireless device-free passive human detection becomes a newly-developing technique and holds more potential to worldwide and ubiquitous smart applications. Recently, indoor fine-grained device-free passive human motion detection based on the PHY layer information is rapidly developed. Previous wireless device-free passive human detection systems either rely on deploying specialized systems with dense transmitter-receiver links or elaborate off-line training process, which blocks rapid deployment and weakens system robustness. In the paper, we explore to research a novel fine-grained real-time calibration-free device-free passive human motion via physical layer information, which is independent of indoor scenarios and needs no prior-calibration and normal profile. We investigate sensitivities of amplitude and phase to human motion, and discover that phase feature is more sensitive to human motion, especially to slow human motion. Aiming at lightweight and robust device-free passive human motion detection, we develop two novel and practical schemes: short-term averaged variance ratio (SVR) and long-term averaged variance ratio (LVR). We realize system design with commercial WiFi devices and evaluate it in typical multipath-rich indoor scenarios. As demonstrated in the experiments, our approach can achieve a high detection rate and low false positive rate

Detection and Localisation Using Light

Visible light communication (VLC) systems have become promising candidates to complement conventional radio frequency (RF) systems due to the increasingly saturated RF spectrum and the potentially high data rates that can be achieved by VLC systems. Furthermore, people detection and counting in an indoor environment has become an emerging and attractive area in the past decade. Many techniques and systems have been developed for counting in public places such as subways, bus stations and supermarkets. The outcome of these techniques can be used for public security, resource allocation and marketing decisions. This thesis presents the first indoor light-based detection and localisation system that builds on concepts from radio detection and ranging (radar) making use of the expected growth in the use and adoption of visible light communication (VLC), which can provide the infrastructure for our light detection and localisation (LiDAL) system. Our system enables active detection, counting and localisation of people, in addition to being fully compatible with existing VLC systems. In order to detect human (targets), LiDAL uses the visible light spectrum. It sends pulses using a VLC transmitter and analyses the reflected signal collected by an optical receiver. Although we examine the use of the visible spectrum here, LiDAL can be used in the infrared spectrum and other parts of the light spectrum. We introduce LiDAL with different transmitter-receiver configurations and optimum detectors considering the fluctuation of the received reflected signal from the target in the presence of Gaussian noise. We design an efficient multiple input multiple output (MIMO) LiDAL system with wide field of view (FOV) single photodetector receiver, and also design a multiple input single output (MISO) LiDAL system with an imaging receiver to eliminate ambiguity in target detection and localisation. We develop models for the human body and its reflections and consider the impact of the colour and texture of the cloth used as well as the impact of target mobility. A number of detection and localisation methods are developed iii for our LiDAL system including cross correlation, a background subtraction method and a background estimation method. These methods are considered to distinguish a mobile target from the ambient reflections due to background obstacles (furniture) in a realistic indoor environment

Improving Wifi Sensing And Networking With Channel State Information

In recent years, WiFi has a very rapid growth due to its high throughput, high efficiency, and low costs. Multiple-Input Multiple-Output (MIMO) and Orthogonal Frequency-Division Multiplexing (OFDM) are two key technologies for providing high throughput and efficiency for WiFi systems. MIMO-OFDM provides Channel State Information (CSI) which represents the amplitude attenuation and phase shift of each transmit-receiver antenna pair of each carrier frequency. CSI helps WiFi achieve high throughput to meet the growing demands of wireless data traffic. CSI captures how wireless signals travel through the surrounding environment, so it can also be used for wireless sensing purposes. This dissertation presents how to improve WiFi sensing and networking with CSI. More specifically, this dissertation proposes deep learning models to improve the performance and capability of WiFi sensing and presents network protocols to reduce CSI feedback overhead for high efficiency WiFi networking. For WiFi sensing, there are many wireless sensing applications using CSI as the input in recent years. To get a better understanding of existing WiFi sensing technologies and future WiFi sensing trends, this dissertation presents a survey of signal processing techniques, algorithms, applications, performance results, challenges, and future trends of CSI-based WiFi sensing. CSI is widely used for gesture recognition and sign language recognition. Existing methods for WiFi-based sign language recognition have low accuracy and high costs when there are more than 200 sign gestures. The dissertation presents SignFi for sign language recognition using CSI and Convolutional Neural Networks (CNNs). SignFi provides high accuracy and low costs for run-time testing for 276 sign gestures in the lab and home environments. For WiFi networking, although CSI provides high throughput for WiFi networks, it also introduces high overhead. WiFi transmitters need CSI feedback for transmit beamforming and rate adaptation. The size of CSI packets is very large and it grows very fast with respect to the number of antennas and channel width. CSI feedback introduces high overhead which reduces the performance and efficiency of WiFi systems, especially mobile and hand-held WiFi devices. This dissertation presents RoFi to reduce CSI feedback overhead based on the mobility status of WiFi receivers. CSI feedback compression reduces overhead, but WiFi receivers still need to send CSI feedback to the WiFi transmitter. The dissertation presents EliMO for eliminating CSI feedback without sacrificing beamforming gains

Adaptive User Authentication on Mobile Devices

Modern mobile devices allow users to access various applications and services anywhere. However, high mobility also exposes mobile devices to device loss, unauthorized access, and many other risks. Existing studies have proposed a variety of explicit authentication (EA) and implicit authentication (IA) mechanisms to secure sensitive personal and corporate data on mobile devices. Considering the limitations of these mechanisms under different circumstances, we expect that future authentication systems will be able to dynamically determine when and how to authenticate users based on the current context, which is called adaptive authentication. This thesis investigates adaptive authentication from the perspectives of context sensing techniques, authentication and access control adaptations, and adaptation modeling. First, we investigate the smartphone loss scenario. Context sensing is critical for triggering immediate device locking with re-authentication and an alert to the owner before they leave without the phone. We propose Chaperone, an active acoustic sensing based solution to detect a user's departure from the device. It is designed to robustly provide a user's proximity and motion contexts in real-world scenarios characterized by bursting high-frequency noise, bustling crowds, and diverse environmental layouts. Extensive evaluations at a variety of real-world locations have shown that Chaperone has high accuracy and low detection latency under various conditions. Second, we investigate temporary device sharing as a special scenario of adaptive authentication. We propose device sharing awareness (DSA), a new sharing-protection approach for temporarily shared mobile devices. DSA exploits natural handover gestures and behavioral biometrics as contextual factors to transparently enable and disable a device's sharing mode without requiring explicit input of the device owner. It also supports various access control strategies to fulfill sharing requirements imposed by an app. Our user study has shown the effectiveness of handover detection and demonstrated how DSA automatically processes sharing events to provide a secure sharing environment. Third, we investigate the adaptation of an IA system to shared mobile devices to reject imposters and distinguish between legitimate users in real-time. We propose a multi-user IA solution that incorporates multiple modalities and supports adding new users and automatically labeling new incoming data for model updating. Our solution adopts a score fusion strategy based on Dempster-Shafer (D-S) theory to improve accuracy with considering uncertainties among different IA mechanisms. We also provide an evaluation framework to support IA researchers in the evaluation of multi-user, multi-modal IA systems. We present two sample use cases to showcase how our framework helps address practical design questions of multi-user IA systems. Fourth, we investigate a high-level organization of different adaptation policies in an adaptive authentication system. We design and build a multi-stage risk-aware adaptive authentication and access control framework (MRAAC). MRAAC organizes adaptation policies in multiple stages to handle various scenarios and progressively adapts authentication mechanisms based on context, resource sensitivity, and user authenticity. We present three use cases to show how MRAAC enables various stakeholders (device manufacturers, enterprise and secure app developers) to provide adaptive authentication workflows on COTS Android with low processing and battery overhead. In conclusion, this thesis fills the gaps in adaptive authentication systems for shared mobile devices and adaptation models for authentication and access control. Our frameworks and implementations also benefit researchers and developers to develop and evaluate their adaptive authentication systems efficiently