Multiple Patients Behavior Detection in Real-time using mmWave Radar and Deep CNNs

To address potential gaps noted in patient monitoring in the hospital, a novel patient behavior detection system using mmWave radar and deep convolution neural network (CNN), which supports the simultaneous recognition of multiple patients' behaviors in real-time, is proposed. In this study, we use an mmWave radar to track multiple patients and detect the scattering point cloud of each one. For each patient, the Doppler pattern of the point cloud over a time period is collected as the behavior signature. A three-layer CNN model is created to classify the behavior for each patient. The tracking and point clouds detection algorithm was also implemented on an mmWave radar hardware platform with an embedded graphics processing unit (GPU) board to collect Doppler pattern and run the CNN model. A training dataset of six types of behavior were collected, over a long duration, to train the model using Adam optimizer with an objective to minimize cross-entropy loss function. Lastly, the system was tested for real-time operation and obtained a very good inference accuracy when predicting each patient's behavior in a two-patient scenario.Comment: This paper has been submitted to IEEE Radar Conference 201

Indoor person identification using a low-power FMCW radar

Contemporary surveillance systems mainly use video cameras as their primary sensor. However, video cameras possess fundamental deficiencies, such as the inability to handle low-light environments, poor weather conditions, and concealing clothing. In contrast, radar devices are able to sense in pitchdark environments and to see through walls. In this paper, we investigate the use of micro-Doppler (MD) signatures retrieved from a low-power radar device to identify a set of persons based on their gait characteristics. To that end, we propose a robust feature learning approach based on deep convolutional neural networks. Given that we aim at providing a solution for a real-world problem, people are allowed to walk around freely in two different rooms. In this setting, the IDentification with Radar data data set is constructed and published, consisting of 150 min of annotated MD data equally spread over five targets. Through experiments, we investigate the effectiveness of both the Doppler and time dimension, showing that our approach achieves a classification error rate of 24.70% on the validation set and 21.54% on the test set for the five targets used. When experimenting with larger time windows, we are able to further lower the error rate

NON-CONTACT TECHNIQUES FOR HUMAN VITAL SIGN DETECTION AND GAIT ANALYSIS

Human vital signs including respiratory rate, heart rate, oxygen saturation, blood pressure, and body temperature are important physiological parameters that are used to track and monitor human health condition. Another important biological parameter of human health is human gait. Human vital sign detection and gait investigations have been attracted many scientists and practitioners in various fields such as sport medicine, geriatric medicine, bio-mechanic and bio-medical engineering and has many biological and medical applications such as diagnosis of health issues and abnormalities, elderly care and health monitoring, athlete performance analysis, and treatment of joint problems. Thoroughly tracking and understanding the normal motion of human limb joints can help to accurately monitor human subjects or patients over time to provide early flags of possible complications in order to aid in a proper diagnosis and development of future comprehensive treatment plans. With the spread of COVID-19 around the world, it has been getting more important than ever to employ technology that enables us to detect human vital signs in a non-contact way and helps protect both patients and healthcare providers from potentially life-threatening viruses, and have the potential to also provide a convenient way to monitor people health condition, remotely. A popular technique to extract biological parameters from a distance is to use cameras. Radar systems are another attractive solution for non-contact human vital signs monitoring and gait investigation that track and monitor these biological parameters without invading people privacy. The goal of this research is to develop non-contact methods that is capable of extracting human vital sign parameters and gait features accurately. To do that, in this work, optical systems including cameras and proper filters have been developed to extract human respiratory rate, heart rate, and oxygen saturation. Feasibility of blood pressure extraction using the developed optical technique has been investigated, too. Moreover, a wideband and low-cost radar system has been implemented to detect single or multiple human subject’s respiration and heart rate in dark or from behind the wall. The performance of the implemented radar system has been enhanced and it has been utilized for non-contact human gait analysis. Along with the hardware, advanced signal processing schemes have been enhanced and applied to the data collected using the aforementioned radar system. The data processing algorithms have been extended for multi-subject scenarios with high accuracy for both human vital sign detection and gait analysis. In addition, different configurations of this and high-performance radar system including mono-static and MIMO have been designed and implemented with great success. Many sets of exhaustive experiments have been conducted using different human subjects and various situations and accurate reference sensors have been used to validate the performance of the developed systems and algorithms

Investigation of Non-coherent Discrete Target Range Estimation Techniques for High-precision Location

Ranging is an essential and crucial task for radar systems. How to solve the range-detection problem effectively and precisely is massively important. Meanwhile, unambiguity and high resolution are the points of interest as well. Coherent and non-coherent techniques can be applied to achieve range estimation, and both of them have advantages and disadvantages. Coherent estimates offer higher precision but are more vulnerable to noise and clutter and phase wrap errors, particularly in a complex or harsh environment, while the non-coherent approaches are simpler but provide lower precision. With the purpose of mitigating inaccuracy and perturbation in range estimation, miscellaneous techniques are employed to achieve optimally precise detection. Numerous elegant processing solutions stemming from non-coherent estimate are now introduced into the coherent realm, and vice versa. This thesis describes two non-coherent ranging estimate techniques with novel algorithms to mitigate the instinct deficit of non-coherent ranging approaches. One technique is based on peak detection and realised by Kth-order Polynomial Interpolation, while another is based on Z-transform and realised by Most-likelihood Chirp Z-transform. A two-stage approach for the fine ranging estimate is applied to the Discrete Fourier transform domain of both algorithms. An N-point Discrete Fourier transform is implemented to attain a coarse estimation; an accurate process around the point of interest determined in the first stage is conducted. For KPI technique, it interpolates around the peak of Discrete Fourier transform profiles of the chirp signal to achieve accurate interpolation and optimum precision. For Most-likelihood Chirp Z-transform technique, the Chirp Z-transform accurately implements the periodogram where only a narrow band spectrum is processed. Furthermore, the concept of most-likelihood estimator is introduced to combine with Chirp Z-transform to acquire better ranging performance. Cramer-Rao lower bound is presented to evaluate the performance of these two techniques from the perspective of statistical signal processing. Mathematical derivation, simulation modelling, theoretical analysis and experimental validation are conducted to assess technique performance. Further research will be pushed forward to algorithm optimisation and system development of a location system using non-coherent techniques and make a comparison to a coherent approach

Doppler radar monitoring of lava dome processes at Merapi Volcano, Indonesia

Merapi volcano in Central Java, Indonesia, is considered one of the most dangerous volcanoes worldwide. Due to the high viscosity of its magma, the lava emerging at the top the volcano cannot flow silently down the flanks of the volcano but builds a lava dome. An indicator for the stability of the lava dome are rockfalls and block and ash flows, which are caused by local instabilities at the dome. When the lava dome reaches a critical size, it collapses. This results in dangerous block and ash flows, which can reach several kilometers into the proximity of the volcano. In the past rockfall and block and ash flow activity has been observed visually or by seismic networks. However, visual observations are often impossible due to bad visibility conditions and until now seismic measurements allow only few insights into the dynamic processes that are involved in instability events, i.e. events of material breaks off the lava dome. In order to enhance monitoring of lava dome activity, a first prototype Doppler radar system has been installed at the western of the Merapi in October 2001. This system consists of a frequency modulated continuous wave (FMCW) 24GHz Doppler radar. The Doppler spectra recorded by the system give a relative measure of the amount of material moving through the beam as well as information about its velocities. Because the radar system is insensitive for clouds, the system provides first continuous "quasi-visual" observations of dome instabilities...thesi

Radar sensing for ambient assisted living application with artificial intelligence

In a time characterized by rapid technological advancements and a noticeable trend towards an older average population, the need for automated systems to monitor movements and actions has become increasingly important. This thesis delves into the application of radar, specifically Frequency Modulated Continuous Wave (FMCW) radar, as an emerging and effective sensor in the field of "Activity Recognition." This area involves capturing motion data through sensors and integrating it with machine learning algorithms to autonomously classify human activities. Radar is distinguished by its ability to accurately track complex bodily movements while ensuring privacy compliance. The research provides an in-depth examination of FMCW radar, detailing its operational principles and exploring radar information domains such as range-time and micro-Doppler signatures. Following this, the thesis presents a state-of-the-art review in activity recognition, discussing key papers and significant works that have shaped the field. The thesis then focuses on research topics where contributions were made. The first topic is human activity recognition (HAR) with different physiology, presenting a comprehensive experimental setup with radar sensors to capture various human activities. The analysis of classification results reveals the effectiveness of different radar representations. Advancing into the domain of resource-constrained system platforms. It introduces adaptive thresholding for efficient data processing and discusses the optimization of these methods using artificial intelligence, particularly focusing on the evolution algorithm such as Self-Adaptive Differential Evolution Algorithm (SADEA). The final chapter discusses the use of Long Short-Term Memory (LSTM) networks for short-range personnel recognition using radar signals. It details the training and testing methodologies and provides an analysis of LSTM networks performance in temporal classification tasks. Overall, this thesis demonstrates the effectiveness of merging radar technology with machine learning in HAR, particularly in assisted living. It contributes to the field by introducing methods optimized for resource-limited settings and innovative approaches in temporal classification using LSTM networks

Recent Advances in Motion Analysis

The advances in the technology and methodology for human movement capture and analysis over the last decade have been remarkable. Besides acknowledged approaches for kinematic, dynamic, and electromyographic (EMG) analysis carried out in the laboratory, more recently developed devices, such as wearables, inertial measurement units, ambient sensors, and cameras or depth sensors, have been adopted on a wide scale. Furthermore, computational intelligence (CI) methods, such as artificial neural networks, have recently emerged as promising tools for the development and application of intelligent systems in motion analysis. Thus, the synergy of classic instrumentation and novel smart devices and techniques has created unique capabilities in the continuous monitoring of motor behaviors in different fields, such as clinics, sports, and ergonomics. However, real-time sensing, signal processing, human activity recognition, and characterization and interpretation of motion metrics and behaviors from sensor data still representing a challenging problem not only in laboratories but also at home and in the community. This book addresses open research issues related to the improvement of classic approaches and the development of novel technologies and techniques in the domain of motion analysis in all the various fields of application

Application of advanced technology to space automation

Automated operations in space provide the key to optimized mission design and data acquisition at minimum cost for the future. The results of this study strongly accentuate this statement and should provide further incentive for immediate development of specific automtion technology as defined herein. Essential automation technology requirements were identified for future programs. The study was undertaken to address the future role of automation in the space program, the potential benefits to be derived, and the technology efforts that should be directed toward obtaining these benefits