An inclusive survey of contactless wireless sensing: a technology used for remotely monitoring vital signs has the potential to combating COVID-19

With the Coronavirus pandemic showing no signs of abating, companies and governments around the world are spending millions of dollars to develop contactless sensor technologies that minimize the need for physical interactions between the patient and healthcare providers. As a result, healthcare research studies are rapidly progressing towards discovering innovative contactless technologies, especially for infants and elderly people who are suffering from chronic diseases that require continuous, real-time control, and monitoring. The fusion between sensing technology and wireless communication has emerged as a strong research candidate choice because wearing sensor devices is not desirable by patients as they cause anxiety and discomfort. Furthermore, physical contact exacerbates the spread of contagious diseases which may lead to catastrophic consequences. For this reason, research has gone towards sensor-less or contactless technology, through sending wireless signals, then analyzing and processing the reflected signals using special techniques such as frequency modulated continuous wave (FMCW) or channel state information (CSI). Therefore, it becomes easy to monitor and measure the subject’s vital signs remotely without physical contact or asking them to wear sensor devices. In this paper, we overview and explore state-of-the-art research in the field of contactless sensor technology in medicine, where we explain, summarize, and classify a plethora of contactless sensor technologies and techniques with the highest impact on contactless healthcare. Moreover, we overview the enabling hardware technologies as well as discuss the main challenges faced by these systems.This work is funded by the scientific and technological research council of Turkey (TÜBITAK) under grand 119E39

Contactless Electrocardiogram Monitoring with Millimeter Wave Radar

The electrocardiogram (ECG) has always been an important biomedical test to diagnose cardiovascular diseases. Current approaches for ECG monitoring are based on body attached electrodes leading to uncomfortable user experience. Therefore, contactless ECG monitoring has drawn tremendous attention, which however remains unsolved. In fact, cardiac electrical-mechanical activities are coupling in a well-coordinated pattern. In this paper, we achieve contactless ECG monitoring by breaking the boundary between the cardiac mechanical and electrical activity. Specifically, we develop a millimeter-wave radar system to contactlessly measure cardiac mechanical activity and reconstruct ECG without any contact in. To measure the cardiac mechanical activity comprehensively, we propose a series of signal processing algorithms to extract 4D cardiac motions from radio frequency (RF) signals. Furthermore, we design a deep neural network to solve the cardiac related domain transformation problem and achieve end-to-end reconstruction mapping from RF input to the ECG output. The experimental results show that our contactless ECG measurements achieve timing accuracy of cardiac electrical events with median error below 14ms and morphology accuracy with median Pearson-Correlation of 90% and median Root-Mean-Square-Error of 0.081mv compared to the groudtruth ECG. These results indicate that the system enables the potential of contactless, continuous and accurate ECG monitoring

Bio-Radar Applications for Remote Vital Signs Monitoring

Nowadays, most vital signs monitoring techniques used in a medical context and/or daily life routines require direct contact with skin, which can become uncomfortable or even impractical to be used regularly. Radar technology has been appointed as one of the most promising contactless tools to overcome these hurdles. However, there is a lack of studies that cover a comprehensive assessment of this technology when applied in real-world environments. This dissertation aims to study radar technology for remote vital signs monitoring, more specifically, in respiratory and heartbeat sensing. Two off-the-shelf radars, based on impulse radio ultra-wideband and frequency modu lated continuous wave technology, were customized to be used in a small proof of concept experiment with 10 healthy participants. Each subject was monitored with both radars at three different distances for two distinct conditions: breathing and voluntary apnea. Signals processing algorithms were developed to detect and estimate respiratory and heartbeat parameters, assessed using qualitative and quantitative methods. Concerning respiration, a minimum error of 1.6% was found when radar respiratory peaks signals were directly compared with their reference, whereas a minimum mean absolute error of 0.3 RPM was obtained for the respiration rate. Concerning heartbeats, their expression in radar signals was not as clear as the respiration ones, however a minimum mean absolute error of 1.8 BPM for heartbeat was achieved after applying a novel selective algorithm developed to validate if heart rate value was estimated with reliability. The results proved the potential for radars to be used in respiratory and heartbeat contactless sensing, showing that the employed methods can be already used in some mo tionless situations. Notwithstanding, further work is required to improve the developed algorithms in order to obtain more robust and accurate systems.Atualmente, a maioria das técnicas usadas para a monitorização de sinais vitais em contexto médicos e/ou diário requer contacto direto com a pele, o que poderá tornar-se incómodo ou até mesmo inviável em certas situações. A tecnologia radar tem vindo a ser apontada como uma das mais promissoras ferramentas para medição de sinais vitais à distância e sem contacto. Todavia, são necessários mais estudos que permitam avaliar esta tecnologia quando aplicada a situações mais reais. Esta dissertação tem como objetivo o estudo da tecnologia radar aplicada no contexto de medição remota de sinais vitais, mais concretamente, na medição de atividade respiratória e cardíaca. Dois aparelhos radar, baseados em tecnologia banda ultra larga por rádio de impulso e em tecnologia de onda continua modulada por frequência, foram configurados e usados numa prova de conceito com 10 participantes. Cada sujeito foi monitorizado com cada um dos radar em duas situações distintas: respirando e em apneia voluntária. Algorit mos de processamento de sinal foram desenvolvidos para detetar e estimar parâmetros respiratórios e cardíacos, avaliados através de métodos qualitativos e quantitativos. Em relação à respiração, o menor erro obtido foi de 1,6% quando os sinais de radar respiratórios foram comparados diretamente com os sinais de referência, enquanto que, um erro médio absoluto mínimo de 0,3 RPM foi obtido para a estimação da frequência respiratória via radar. A expressão cardíaca nos sinais radar não se revelou tão evidente como a respiratória, no entanto, um erro médio absoluto mínimo de 1,8 BPM foi obtido para a estimação da frequência cardíaca após a aplicação de um novo algoritmo seletivo, desenvolvido para validar a confiança dos valores obtidos. Os resultados obtidos provaram o potencial do uso de radares na medição de atividade respiratória e cardíaca sem contacto, sendo esta tecnologia viável de ser implementada em situações onde não existe muito movimento. Não obstante, os algoritmos desenvolvidos devem ser aperfeiçoados no futuro de forma a obter sistemas mais robustos e precisos

Rf sensing and processing methods for noninvasive health monitoring

Vulnerable populations include groups of people with a higher risk of poor health as a result of the limitations due to illness or disability. The health issues of vulnerable populations include three categories: physical, psychological, and social. The people with physical issues include high-risk mothers and infants, older adults and others with chronic illnesses and people with disabilities. The psychological issues of vulnerable populations include chronic mental conditions, such as bipolar disorder, major depression, and hyperactivity disorder, as well as substance abuse and those who are suicidal. The social issues in vulnerable populations include those living in abusive families, the homeless, etc. This dissertation concentrates on methods for helping two groups of vulnerable populations, namely, frail older adults and psychiatric hospital patients, to monitor their activity level, respiration rate, sleeping quality, and restless time in bed. In the first part of our work, we investigate a contactless monitoring system for psychiatric patients in a naturalistic hospital setting that can track their motion in bed, estimate the breathing rate of patients during their peaceful sleeping periods, and can be used to estimate a patient's restless time and sleep quality. Specifically, the contactless monitoring system uses a Vayyar Radar system with a carrier frequency of 6.014 GHz to capture all reflections by the FMCW (frequency modulation continuous waveform) signal. The Vayyar Radar system has been installed in a Psychiatric Center to capture 12 nights with over 135 hours of data from 7 patients. A depth camera and a thermal camera have also been installed and are used as the ground truth. The goal is to classify in bed and out of bed classes, quantify restlessness in bed, and determine the breathing rate while patients are lying in bed. We have simulated the psychiatric hospital set-up in the lab, where a respiration belt is used for ground truth, and tested the system with body postures of patients observed in the psychiatric hospital. We estimated respiration rate with different sleep postures, with the aim of investigating a contactless monitoring system for psychiatric patients in the hospital that can estimate the breathing rate of patients during typical sleeping postures, and find the torso area when the patients use other postures, such as reading books in bed or reversing the body on the bed. In the second part of our work, we investigate two methods for learning the room structure via radio wave reflections for longitudinal health monitoring of older adults in a naturalistic home setting. The goal is to use these data as part of a monitoring system that can be easily installed in a home with minimal configuration, for the purpose of detecting very early signs of illness and functional decline. Two studies are conducted using RF (radio frequency) sensing. The first method learns the structure from the RF clutter patterns and uses the beat frequency of the maximum peak in each chirp to calculate the wall position. The second method learns the room structure from active movement patterns and uses the open space between the clusters of active movement patterns to estimate the possible wall locations. Comparing the two results from these methods provides a more robust wall location. In addition, a background filter is designed based on the wall position, and the activity level of people in different rooms is estimated using a fuzzy rule system applied to the RF motion data

Radar and RGB-depth sensors for fall detection: a review

This paper reviews recent works in the literature on the use of systems based on radar and RGB-Depth (RGB-D) sensors for fall detection, and discusses outstanding research challenges and trends related to this research field. Systems to detect reliably fall events and promptly alert carers and first responders have gained significant interest in the past few years in order to address the societal issue of an increasing number of elderly people living alone, with the associated risk of them falling and the consequences in terms of health treatments, reduced well-being, and costs. The interest in radar and RGB-D sensors is related to their capability to enable contactless and non-intrusive monitoring, which is an advantage for practical deployment and users’ acceptance and compliance, compared with other sensor technologies, such as video-cameras, or wearables. Furthermore, the possibility of combining and fusing information from The heterogeneous types of sensors is expected to improve the overall performance of practical fall detection systems. Researchers from different fields can benefit from multidisciplinary knowledge and awareness of the latest developments in radar and RGB-D sensors that this paper is discussing

IoT Platform for COVID-19 Prevention and Control: A Survey

As a result of the worldwide transmission of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), coronavirus disease 2019 (COVID-19) has evolved into an unprecedented pandemic. Currently, with unavailable pharmaceutical treatments and vaccines, this novel coronavirus results in a great impact on public health, human society, and global economy, which is likely to last for many years. One of the lessons learned from the COVID-19 pandemic is that a long-term system with non-pharmaceutical interventions for preventing and controlling new infectious diseases is desirable to be implemented. Internet of things (IoT) platform is preferred to be utilized to achieve this goal, due to its ubiquitous sensing ability and seamless connectivity. IoT technology is changing our lives through smart healthcare, smart home, and smart city, which aims to build a more convenient and intelligent community. This paper presents how the IoT could be incorporated into the epidemic prevention and control system. Specifically, we demonstrate a potential fog-cloud combined IoT platform that can be used in the systematic and intelligent COVID-19 prevention and control, which involves five interventions including COVID-19 Symptom Diagnosis, Quarantine Monitoring, Contact Tracing & Social Distancing, COVID-19 Outbreak Forecasting, and SARS-CoV-2 Mutation Tracking. We investigate and review the state-of-the-art literatures of these five interventions to present the capabilities of IoT in countering against the current COVID-19 pandemic or future infectious disease epidemics.Comment: 12 pages; Submitted to IEEE Internet of Things Journa

Doppler radar remote sensing of respiratory function

Doppler radar remote sensing of torso kinematics can provide an indirect measure of cardiopulmonary function. Motion at the human body surface due to heart and lung activity has been successfully used to characterize such measures as respiratory rate and depth, obstructive sleep apnea, and even the identity of an individual subject. For a sedentary subject, Doppler radar can track the periodic motion of the portion of the body moving as a result of the respiratory cycle as distinct from other extraneous motions that may occur, to provide a spatial temporal displacement pattern that can be combined with a mathematical model to indirectly assess quantities such as tidal volume, and paradoxical breathing. Furthermore, it has been demonstrated that even healthy respiratory function results in distinct motion patterns between individuals that vary as a function of relative time and depth measures over the body surface during the inhalation/exhalation cycle. Potentially, the biomechanics that results in different measurements between individuals can be further exploited to recognize pathology related to lung ventilation heterogeneity and other respiratory diagnostics

Design and Implementation of a Stepped Frequency Continuous Wave Radar System for Biomedical Applications

There is a need to detect vital signs of human (e.g., the respiration and heart-beat rate) with noncontact method in a number of applications such as search and rescue operation (e.g. earthquakes, fire), health monitoring of the elderly, performance monitoring of athletes Ultra-wideband radar system can be utilized for noncontact vital signs monitoring and tracking of various human activities of more than one subject. Therefore, a stepped-frequency continuous wave radar (SFCW) system with wideband performance is designed and implemented for Vital signs detection and fall events monitoring. The design of the SFCW radar system is firstly developed using off-the-shelf discrete components. Later, the system is implemented using surface mount components to make it portable with low cost. The measurement result is proved to be accurate for both heart rate and respiration rate detection within ±5% when compared with contact measurements. Furthermore, an electromagnetic model has been developed using a multi-layer dielectric model of the human subject to validate the experimental results. The agreement between measured and simulated results is good for distances up to 2 m and at various subjects’ orientations with respect to the radar, even in the presence of more than one subject. The compressive sensing (CS) technique is utilized to reduce the size of the acquired data to levels significantly below the Nyquist threshold. In our demonstration, we use phase information contained in the obtained complex high-resolution range profile (HRRP) to derive the motion characteristics of the human. The obtained data has been successfully utilized for non-contact walk, fall and limping detection and healthcare monitoring. The effectiveness of the proposed method is validated using measured results

Edge Artificial Intelligence for Real-Time Target Monitoring

The key enabling technology for the exponentially growing cellular communications sector is location-based services. The need for location-aware services has increased along with the number of wireless and mobile devices. Estimation problems, and particularly parameter estimation, have drawn a lot of interest because of its relevance and engineers' ongoing need for higher performance. As applications expanded, a lot of interest was generated in the accurate assessment of temporal and spatial properties. In the thesis, two different approaches to subject monitoring are thoroughly addressed. For military applications, medical tracking, industrial workers, and providing location-based services to the mobile user community, which is always growing, this kind of activity is crucial. In-depth consideration is given to the viability of applying the Angle of Arrival (AoA) and Receiver Signal Strength Indication (RSSI) localization algorithms in real-world situations. We presented two prospective systems, discussed them, and presented specific assessments and tests. These systems were put to the test in diverse contexts (e.g., indoor, outdoor, in water...). The findings showed the localization capability, but because of the low-cost antenna we employed, this method is only practical up to a distance of roughly 150 meters. Consequently, depending on the use-case, this method may or may not be advantageous. An estimation algorithm that enhances the performance of the AoA technique was implemented on an edge device. Another approach was also considered. Radar sensors have shown to be durable in inclement weather and bad lighting conditions. Frequency Modulated Continuous Wave (FMCW) radars are the most frequently employed among the several sorts of radar technologies for these kinds of applications. Actually, this is because they are low-cost and can simultaneously provide range and Doppler data. In comparison to pulse and Ultra Wide Band (UWB) radar sensors, they also need a lower sample rate and a lower peak to average ratio. The system employs a cutting-edge surveillance method based on widely available FMCW radar technology. The data processing approach is built on an ad hoc-chain of different blocks that transforms data, extract features, and make a classification decision before cancelling clutters and leakage using a frame subtraction technique, applying DL algorithms to Range-Doppler (RD) maps, and adding a peak to cluster assignment step before tracking targets. In conclusion, the FMCW radar and DL technique for the RD maps performed well together for indoor use-cases. The aforementioned tests used an edge device and Infineon Technologies' Position2Go FMCW radar tool-set