Activity Recognition Based on Micro-Doppler Signature with In-Home Wi-Fi

Device free activity recognition and monitoring has become a promising research area with increasing public interest in pattern of life monitoring and chronic health conditions. This paper proposes a novel framework for inhome Wi-Fi signal-based activity recognition in e-healthcare applications using passive micro-Doppler (m-D) signature classification. The framework includes signal modeling, Doppler extraction and m-D classification. A data collection campaign was designed to verify the framework where six m-D signatures corresponding to typical daily activities are sucessfully detected and classified using our software defined radio (SDR) demo system. Analysis of the data focussed on potential discriminative characteristics, such as maximum Doppler frequency and time duration of activity. Finally, a sparsity induced classifier is applied for adaptting the method in healthcare application scenarios and the results are compared with those from the well-known Support Vector Machine (SVM) method

Radar and RGB-depth sensors for fall detection: a review

This paper reviews recent works in the literature on the use of systems based on radar and RGB-Depth (RGB-D) sensors for fall detection, and discusses outstanding research challenges and trends related to this research field. Systems to detect reliably fall events and promptly alert carers and first responders have gained significant interest in the past few years in order to address the societal issue of an increasing number of elderly people living alone, with the associated risk of them falling and the consequences in terms of health treatments, reduced well-being, and costs. The interest in radar and RGB-D sensors is related to their capability to enable contactless and non-intrusive monitoring, which is an advantage for practical deployment and users’ acceptance and compliance, compared with other sensor technologies, such as video-cameras, or wearables. Furthermore, the possibility of combining and fusing information from The heterogeneous types of sensors is expected to improve the overall performance of practical fall detection systems. Researchers from different fields can benefit from multidisciplinary knowledge and awareness of the latest developments in radar and RGB-D sensors that this paper is discussing

Respiration and Activity Detection based on Passive Radio Sensing in Home Environments

The pervasive deployment of connected devices in modern society has significantly changed the nature of the wireless landscape, especially in the license free industrial, scientific and medical (ISM) bands. This paper introduces a deep learning enabled passive radio sensing method that can monitor human respiration and daily activities through leveraging unplanned and ever-present wireless bursts in the ISM frequency band, and can be employed as an additional data input within healthcare informatics. Wireless connected biomedical sensors (Medical Things) rely on coding and modulating of the sensor data onto wireless (radio) bursts which comply with specific physical layer standards like 802.11, 802.15.1 or 802.15.4. The increasing use of these unplanned connected sensors has led to a pell-mell of radio bursts which limit the capacity and robustness of communication channels to deliver data, whilst also increasing inter-system interference. This paper presents a novel methodology to disentangle the chaotic bursts in congested radio environments in order to provide healthcare informatics. The radio bursts are treated as pseudo noise waveforms which eliminate the requirement to extract embedded information through signal demodulation or decoding. Instead, we leverage the phase and frequency components of these radio bursts in conjunction with cross ambiguity function (CAF) processing and a Deep Transfer Network (DTN). We use 2.4GHz 802.11 (WiFi) signals to demonstrate experimentally the capability of this technique for human respiration detection (including through-the-wall), and classifying everyday but complex human motions such as standing, sitting and falling

Synthetic Micro-Doppler Signatures of Non-Stationary Channels for the Design of Human Activity Recognition Systems

The main aim of this dissertation is to generate synthetic micro-Doppler signatures and TV-MDSs to train the HACs. This is achieved by developing non-stationary fixed-tofixed (F2F) indoor channel models. Such models provide an in-depth understanding of the channel parameters that influence the micro-Doppler signatures and TV-MDSs. Hence, the proposed non-stationary channel models help to generate the micro-Doppler signatures and the TV-MDSs, which fit those of the collected measurement data. First, we start with a simple two-dimensional (2D) non-stationary F2F channel model with fixed and moving scatterers. Such a model assumes that the moving scatterers are moving in 2D geometry with simple time variant (TV) trajectories and they have the same height as the transmitter and the receiver antennas. The model of the Doppler shifts caused by the moving scatterers in 2D space is provided. The micro-Doppler signature of this model is explored by employing the spectrogram of which a closed-form expression is derived. Moreover, we demonstrate how the TV-MDSs can be computed from the spectrograms. The aforementioned model is extended to provide two three-dimensional (3D) nonstationary F2F channel models. Such models allow simulating the micro-Doppler signatures influenced by the 3D trajectories of human activities, such as walking and falling. Moreover, expressions of the trajectories of these human activities are also given. Approximate solutions of the spectrograms of these channels are provided by approximating the Doppler shifts caused by the human activities into linear piecewise functions of time. The impact of these activities on the micro-Doppler signatures and the TV-MDSs of the simulated channel models is explored. The work done in this dissertation is not limited to analyzing micro-Doppler signatures and the TV-MDSs of the simulated channel models, but also includes those of the measured channels. The channel-state-information (CSI) software tool installed on commercial-off-theshelf (COTS) devices is utilized to capture complex channel transfer function (CTF) data under the influence of human activities. To mitigate the TV phase distortions caused by the clock asynchronization between the transmitter and receiver stations, a back-to-back (B2B) connection is employed. Models of the measured CTF and its true phases are also shown. The true micro-Doppler signatures and TV-MDSs of the measured CTF are analyzed. The results showed that the CSI tool is reliable to validate the proposed channel models. This allows the micro-Doppler signatures and the TV-MDSs extracted from the data collected with this tool to be used to train the HACs.publishedVersio

Human activity signatures captured under different directions using SISO and MIMO radar systems

In this paper, we highlight and resolve the shortcomings of single-input single-output (SISO) millimeter wave (mm-Wave) radar systems for human activity recognition (HAR). A 2 × 2 distributed multiple-input multiple-output (MIMO) radar framework is presented to capture human activity signatures under realistic conditions in indoor environments. We propose to distribute the two pairs of collocated transmitter–receiver antennas in order to illuminate the indoor environment from different perspectives. For the proposed MIMO system, we measure the time-variant (TV) radial velocity distribution and TV mean radial velocity to observe the signatures of human activities. We deploy the Ancortek SDR-KIT 2400T2R4 mm-Wave radar in a SISO as well as a 2 × 2 distributed MIMO configuration. We corroborate the limitations of SISO configurations by recording real human activities in different directions. It is shown that, unlike the SISO radar configuration, the proposed MIMO configuration has the ability to obtain superior human activity signatures for all directions. To signify the importance of the proposed 2 × 2 MIMO radar system, we compared the performance of a SISO radar-based passive step counter with a distributed MIMO radar-based passive step counter. As the proposed 2 × 2 MIMO radar system is able to detect human activity in all directions, it fills a research gap of radio frequency (RF)-based HAR systems.publishedVersio

A Trajectory-Driven 3D Channel Model for Human Activity Recognition

publishedVersio

Device-Free Localization for Human Activity Monitoring

Over the past few decades, human activity monitoring has grabbed considerable research attentions due to greater demand for human-centric applications in healthcare and assisted living. For instance, human activity monitoring can be adopted in smart building system to improve the building management as well as the quality of life, especially for the elderly people who are facing health deterioration due to aging factor, without neglecting the important aspects such as safety and energy consumption. The existing human monitoring technology requires additional sensors, such as GPS, PIR sensors, video camera, etc., which incur cost and have several drawbacks. There exist various solutions of using other technologies for human activity monitoring in a smartly controlled environment, either device-assisted or device-free. A radio frequency (RF)-based device-free indoor localization, known as device-free localization (DFL), has attracted a lot of research effort in recent years due its simplicity, low cost, and compatibility with the existing hardware equipped with RF interface. This chapter introduces the potential of RF signals, commonly adopted for wireless communications, as sensing tools for DFL system in human activity monitoring. DFL is based on the concept of radio irregularity where human existence in wireless communication field may interfere and change the wireless characteristics

Magnetic and radar sensing for multimodal remote health monitoring

With the increased life expectancy and rise in health conditions related to aging, there is a need for new technologies that can routinely monitor vulnerable people, identify their daily pattern of activities and any anomaly or critical events such as falls. This paper aims to evaluate magnetic and radar sensors as suitable technologies for remote health monitoring purpose, both individually and fusing their information. After experiments and collecting data from 20 volunteers, numerical features has been extracted in both time and frequency domains. In order to analyse and verify the validation of fusion method for different classifiers, a Support Vector Machine with a quadratic kernel, and an Artificial Neural Network with one and multiple hidden layers have been implemented. Furthermore, for both classifiers, feature selection has been performed to obtain salient features. Using this technique along with fusion, both classifiers can detect 10 different activities with an accuracy rate of approximately 96%. In cases where the user is unknown to the classifier, an accuracy of approximately 92% is maintained

Transfer Learning from Audio Deep Learning Models for Micro-Doppler Activity Recognition

This paper presents a mechanism to transform radio micro-Doppler signatures into a pseudo-audio representation, which results in significant improvements in transfer learning from a deep learning model trained on audio. We also demonstrate that transfer learning from a deep learning model trained on audio is more effective than transfer learning from a model trained on images, which suggests machine learning methods used to analyse audio can be leveraged for micro-Doppler. Finally, we utilise an occlusion method to gain an insight into how the deep learning model interprets the micro-Doppler signatures and the subsequent pseudo-audio representations