Doppler Radar Techniques for Distinct Respiratory Pattern Recognition and Subject Identification.

Ph.D. Thesis. University of Hawaiʻi at Mānoa 2017

Noncontact detection and analysis of respiratory function using microwave Doppler Radar

Real-time respiratory measurement with Doppler Radar has an important advantage in the monitoring of certain conditions such as sleep apnoea, sudden infant death syndrome (SIDS), and many other general clinical uses requiring fast nonwearable and non-contact measurement of the respiratory function. In this paper, we demonstrate the feasibility of using Doppler Radar in measuring the basic respiratory frequencies (via fast Fourier transform) for four different types of breathing scenarios: normal breathing, rapid breathing, slow inhalation-fast exhalation, and fast inhalation-slow exhalation conducted in a laboratory environment. A high correlation factor was achieved between the Doppler Radar-based measurements and the conventional measurement device, a respiration strap. We also extended this work from basic signal acquisition to extracting detailed features of breathing function (I: E ratio). This facilitated additional insights into breathing activity and is likely to trigger a number of new applications in respiratory medicine

Detection and analysis of human respiration using microwave Doppler radar

 Non-contact detection characteristic of Doppler radar provides an unobtrusive means of respiration detection and monitoring. This avoids additional preparations such as physical sensor attachment or special clothing. Furthermore, robustness of Doppler radar against environmental factors reduce environmental constraints and strengthens the possibility of employing Doppler radar as a practical biomedical devices in the future particularly in long term monitoring applications such as in sleep studies

Detection and analysis of human respiration using microwave Doppler radar

 Non-contact detection characteristic of Doppler radar provides an unobtrusive means of respiration detection and monitoring. This avoids additional preparations such as physical sensor attachment or special clothing. Furthermore, robustness of Doppler radar against environmental factors reduce environmental constraints and strengthens the possibility of employing Doppler radar as a practical biomedical devices in the future particularly in long term monitoring applications such as in sleep studies

Noncontact Vital Signs Detection

Human health condition can be accessed by measurement of vital signs, i.e., respiratory rate (RR), heart rate (HR), blood oxygen level, temperature and blood pressure. Due to drawbacks of contact sensors in measurement, non-contact sensors such as imaging photoplethysmogram (IPPG) and Doppler radar system have been proposed for cardiorespiratory rates detection by researchers.The UWB pulse Doppler radars provide high resolution range-time-frequency information. It is bestowed with advantages of low transmitted power, through-wall capabilities, and high resolution in localization. However, the poor signal to noise ratio (SNR) makes it challenging for UWB radar systems to accurately detect the heartbeat of a subject. To solve the problem, phased-methods have been proposed to extract the phase variations in the reflected pulses modulated by human tiny thorax motions. Advance signal processing method, i.e., state space method, can not only be used to enhance SNR of human vital signs detection, but also enable the micro-Doppler trajectories extraction of walking subject from UWB radar data.Stepped Frequency Continuous Wave (SFCW) radar is an alternative technique useful to remotely monitor human subject activities. Compared with UWB pulse radar, it relieves the stress on requirement of high sampling rate analog-to-digital converter (ADC) and possesses higher signal-to-noise-ratio (SNR) in vital signs detection. However, conventional SFCW radar suffers from long data acquisition time to step over many frequencies. To solve this problem, multi-channel SFCW radar has been proposed to step through different frequency bandwidths simultaneously. Compressed sensing (CS) can further reduce the data acquisition time by randomly stepping through 20% of the original frequency steps.In this work, SFCW system is implemented with low cost, off-the-shelf surface mount components to make the radar sensors portable. Experimental results collected from both pulse and SFCW radar systems have been validated with commercial contact sensors and satisfactory results are shown

Remote Human Vital Sign Monitoring Using Multiple-Input Multiple-Output Radar at Millimeter-Wave Frequencies

Non-contact respiration rate (RR) and heart rate (HR) monitoring using millimeter-wave (mmWave) radars has gained lots of attention for medical, civilian, and military applications. These mmWave radars are small, light, and portable which can be deployed to various places. To increase the accuracy of RR and HR detection, distributed multi-input multi-output (MIMO) radar can be used to acquire non-redundant information of vital sign signals from different perspectives because each MIMO channel has different fields of view with respect to the subject under test (SUT). This dissertation investigates the use of a Frequency Modulated Continuous Wave (FMCW) radar operating at 77-81 GHz for this application. Vital sign signal is first reconstructed with Arctangent Demodulation (AD) method using phase change’s information collected by the radar due to chest wall displacement from respiration and heartbeat activities. Since the heartbeat signals can be corrupted and concealed by the third/fourth harmonics of the respiratory signals as well as random body motion (RBM) from the SUT, we have developed an automatic Heartbeat Template (HBT) extraction method based on Constellation Diagrams of the received signals. The extraction method will automatically spot and extract signals’ portions that carry good amount of heartbeat signals which are not corrupted by the RBM. The extracted HBT is then used as an adapted wavelet for Continuous Wavelet Transform (CWT) to reduce interferences from respiratory harmonics and RBM, as well as magnify the heartbeat signals. As the nature of RBM is unpredictable, the extracted HBT may not completely cancel the interferences from RBM. Therefore, to provide better HR detection’s accuracy, we have also developed a spectral-based HR selection method to gather frequency spectra of heartbeat signals from different MIMO channels. Based on this gathered spectral information, we can determine an accurate HR even if the heartbeat signals are significantly concealed by the RBM. To further improve the detection’s accuracy of RR and HR, two deep learning (DL) frameworks are also investigated. First, a Convolutional Neural Network (CNN) has been proposed to optimally select clean MIMO channels and eliminate MIMO channels with low SNR of heartbeat signals. After that, a Multi-layer Perceptron (MLP) neural network (NN) is utilized to reconstruct the heartbeat signals that will be used to assess and select the final HR with high confidence

A contribution to unobtrusive video-based measurement of respiratory signals

Due to the growing popularity of video-based methods for physiological signal measurement, and taking into account the technological advancements of these type of devices, this work proposes a series of new novel methods to obtain the respiratory signal from a distance, based on video analysis. This thesis aims to improve the state of the art video methods for respiratory measurement, more specifically, by presenting methods that can be used to obtain respiratory variability or perform respiratory rhythm measurements. Moreover, this thesis also aims to present a new implementation of a time-frequency signal processing technique, to improve its computational efficiency when applied to the respiratory signals. In this document a first approach to video-based methods for respiratory signal measurement is performed, to assert the feasibility of using a consumer-grade camera, not only to measure the mean respiratory rate or frequency, but to assert if this hardware could be used to acquire the raw respiratory signal and the respiratory rhythm as well. In this regard a new video-based method was introduced that measures the respiratory signal of a subject at a distance, with the aid of a custom pattern placed on the thorax of the subject. Given the results from the first video-based method, a more broad approach was taken by comparing three different types of video hardware, with the aim to characterise if they could be used for respiratory signal acquisition and respiratory variability measurements. The comparative analysis was performed in terms of instantaneous frequency, as it allowed to characterise the methods in terms of respiratory variability and to compare them in the same terms with the reference method. Subsequently, and due to the previous obtained results, a new method was proposed using a stereo depth camera with the aim to tackle the limitations of the previous study. The proposed method uses an hybrid architecture were the synchronized infrared frame and depth point-cloud from the same camera are acquired. The infrared frame is used to detect the movements of the subject inside the scene, and to recompute on demand a region of interest to obtain the respiratory signal from the depth point-cloud. Furthermore, in this study an opportunistic approach is taken in order to process all the obtained data, as it is also the aim of this study to verify if using a more realistic approach to respiratory signal analysis in real-life conditions, would influence the respiratory rhythm measurement. Even though the depth camera method proved reliable in terms of respiratory rhythm measurement, the opportunistic approach relied on visual inspection of the obtained respiratory signal to properly define each piece. For this reason, a quality indicator had to be proposed that could objectively identify whenever a respiratory signal contained errors. Furthermore, from the idea to characterise the movements of a subject, and by changing the measuring point from a frontal to a lateral perspective to avoid most of the occlusions, a new method based on obtaining the movement of the thoraco-abdominal region using dense optical flow was proposed. This method makes us of the phase of the optical flow to obtain the respiratory signal of the subject, while using the modulus to compute a quality index. Finally, regarding the different signal processing methods used in this thesis to obtain the instantaneous frequency, there were none that could perform in real-time, making the analysis of the respiratory variability not possible in real-life systems where the signals have to be processed in a sample by sample basis. For this reason, as a final chapter a new implementation of the synchrosqueezing transform for time-frequency analysis in real-time is proposed, with the aim to provide a new tool for non-contact methods to obtain the variability of the respiratory signal in real-time.A causa de la creixent popularitat en la mesura de senyals fisiològics amb mètodes de vídeo, i tenint en compte els avenços tecnològics d'aquests dispositius, aquesta tesi proposa una sèrie de nous mètodes per tal d'obtenir la respiració a distància mitjançant l'anàlisi de vídeo. Aquesta tesi té com a objectiu millorar l'estat de l'art referent a la mesura de senyal respiratòria mitjançant els mètodes que en ella es descriuen, així com presentar mètodes que puguin ser usats per obtenir la variabilitat o el ritme respiratori. A més, aquesta tesi té com a objectiu presentar una nova implementació d'un mètode de processat de senyal temps-freqüencial, per tal de millorar-ne l'eficiència computacional quant s’aplica a senyals respiratoris. En aquest document, es realitza una primera aproximació a la mesura de senyal respiratòria mitjançant mètodes de vídeo per tal de verificar si és factible utilitzar una càmera de consum, no només per mesurar el senyal respiratori, sinó verificar si aquest tipus de hardware també pot ser emprat per obtenir el ritme respiratori. En aquest sentit, es presenta en aquest document un nou mètode d'adquisició de senyal respiratòria a distància basat en vídeo, el qual fa ús d'un patró ubicat al tòrax del subjecte per tal d'obtenir-ne la respiració. Un cop obtinguts els resultats del primers resultats, s'han analitzat tres tipus diferents de càmeres, amb la finalitat de caracteritzar-ne la viabilitat d'obtenir el senyal respiratori i la seva variabilitat. L'estudi comparatiu s'ha realitzat en termes de freqüència instantània, donat que permet caracteritzar els mètodes en termes de variabilitat respiratòria i comparar-los, en les mateixes condicions, amb el mètode de referencia. A continuació, s'ha presentat un nou mètode basat en una càmera de profunditat estèreo amb la finalitat de millorar i corregir les limitacions anteriors. El nou mètode proposat es basa en una arquitectura hibrida la qual utilitza els canals de vídeo infraroig i de profunditat de forma sincronitzada. El canal infraroig s'utilitza per detectar els moviments del subjecte dins l'escena i calcular, sota demanda, una regió d'interès que s'utilitza posteriorment en el canal de profunditat per extreure el senyal respiratori. A més a més, en aquest estudi s'ha utilitzat una aproximació oportunista en el processat del senyal respiratori, donat que també és un dels objectius d'aquest estudi, verificar si el fet d'utilitzar una aproximació més realista en l'adquisició de senyal, pot influir en la mesura del ritme respiratori. Tot i que el mètode anterior es mostra fiable en termes de mesura del ritme respiratori, la selecció oportunista del senyal necessita d’inspecció visual per tal de definir correctament cada fragment. Per aquest motiu, era necessari definir un índex de qualitat el qual permetés identificar de forma objectiva cada tram de senyal, així com detectar si el senyal conté errors. Partint de la idea de caracteritzar el moviment del subjecte de l'estudi anterior, i modificant el punt de mesura frontal cap a un de lateral per tal d'evitar oclusions, es proposa un nou mètode basat en l'obtenció del moviment toràcic-abdominal a partir del flux òptic del senyal de vídeo. Aquest mètode recupera el senyal respiratori del subjecte a partir de la fase del flux òptic, tot calculant un índex de qualitat a partir del mòdul. Finalment, i tenint en compte els diferents mètodes de processat utilitzats en aquesta tesi per tal de obtenir la freqüència instantània, es pot apreciar que cap d'ells és capaç de funcionar en temps real, fent inviable l'anàlisi de la variabilitat respiratòria en sistemes reals amb processat mostra a mostra. Per aquest motiu, en el capítol final d'aquesta tesi, s'ha proposat una nova implementació de la transformació "synchrosqueezing" per tal de realitzar l’anàlisi temporal-freqüencial en temps real, i proveir d'una nova eina per tal d'obtenir la variabilitat respiratòria en temps real, amb mètodes sense contacte

Bio-Radar: sistema de aquisição de sinais vitais sem contacto

The Bio-Radar system is capable to measure vital signs accurately, namely the respiratory and cardiac signal, using electromagnetic waves. In this way, it is possible to monitor subjects remotely and comfortably for long periods of time. This system is based on the micro-Doppler effect, which relates the received signal phase variation with the distance change between the subject chest-wall and the radar antennas, which occurs due to the cardiopulmonary function. Considering the variety of applications where this system can be used, it is required to evaluate its performance when applied to real context scenarios and thus demonstrate the advantages that bioradar systems can bring to the general population. In this work, a bio-radar prototype was developed in order to verify the viability to be integrated in specific applications, using robust and low profile solutions that equally guarantee the general system performance while addressing the market needs. Considering these two perspectives to be improved, different level solutions were developed. On the hardware side, textile antennas were developed to be embedded in a car seat upholstery, thus reaching a low profile solution and easy to include in the industrialization process. Real context scenarios imply long-term monitoring periods, where involuntary body motion can occur producing high amplitude signals that overshadow the vital signs. Non-controlled monitoring environments might also produce time varying parasitic reflections that have a direct impact in the signal. Additionally, the subject's physical stature and posture during the monitoring period can have a different impact in the signals quality. Therefore, signal processing algorithms were developed to be robust to low quality signals and non-static scenarios. On the other hand, the bio-radar potential can also be maximized if the acquired signals are used pertinently to help identify the subject's psychophysiological state enabling one to act accordingly. The random body motion until now has been seen as a noisy source, however it can also provide useful information regarding subject's state. In this sense, the acquired vital signs as well as other body motions were used in machine learning algorithms with the goal to identify the subject's emotions and thus verify if the remotely acquired vital signs can also provide useful information.O sistema Bio-Radar permite medir sinais vitais com precisão, nomeadamente o sinal respiratório e cardíaco, utilizando ondas eletromagnéticas para esse fim. Desta forma, é possível monitorizar sujeitos de forma remota e confortável durante longos períodos de tempo. Este sistema é baseado no efeito de micro-Doppler, que relaciona a variação de fase do sinal recebido com a alteração da distância entre as antenas do radar e a caixa torácica do sujeito, que ocorre durante a função cardiopulmonar. Considerando a variedade de aplicações onde este sistema pode ser utilizado, é necessário avaliar o seu desempenho quando aplicado em contextos reais e assim demonstrar as vantagens que os sistemas bio-radar podem trazer à população geral. Neste trabalho, foi desenvolvido um protótipo do bio radar com o objetivo de verificar a viabilidade de integrar estes sistemas em aplicações específicas, utilizando soluções robustas e discretas que garantam igualmente o seu bom desempenho, indo simultaneamente de encontro às necessidades do mercado. Considerando estas duas perspetivas em que o sistema pode ser melhorado, foram desenvolvidas soluções de diferentes níveis. Do ponto de vista de hardware, foram desenvolvidas antenas têxteis para serem integradas no estofo de um banco automóvel, alcançando uma solução discreta e fácil de incluir num processo de industrialização. Contextos reais de aplicação implicam períodos de monitorização longos, onde podem ocorrer movimentos corporais involuntários que produzem sinais de elevada amplitude que se sobrepõem aos sinais vitais. Ambientes de monitorização não controlados podem produzir reflexões parasitas variantes no tempo que têm impacto direto no sinal. Adicionalmente, a estrutura física do sujeito e a sua postura durante o período de monitorização podem ter impactos diferentes na qualidade dos sinais. Desta forma, foram desenvolvidos algoritmos de processamento de sinal robustos a sinais de baixa qualidade e a cenários não estáticos. Por outro lado, o potencial do bio radar pode também ser maximizado se os sinais adquiridos forem pertinentemente utilizados de forma a ajudar a identificar o estado psicofisiológico do sujeito, permitindo mais tarde agir em conformidade. O movimento corporal aleatório que foi até agora visto como uma fonte de ruído, pode no entanto também fornecer informação útil sobre o estado do sujeito. Neste sentido, os sinais vitais e outros movimentos corporais adquiridos foram utilizados em algoritmos de aprendizagem automática com o objetivo de identificar as emoções do sujeito e assim verificar que sinais vitais adquiridos remotamente podem também conter informação útil.Programa Doutoral em Engenharia Eletrotécnic

Few-Shot User-Adaptable Radar-Based Breath Signal Sensing

Vital signs estimation provides valuable information about an individual’s overall health status. Gathering such information usually requires wearable devices or privacy-invasive settings. In this work, we propose a radar-based user-adaptable solution for respiratory signal prediction while sitting at an office desk. Such an approach leads to a contact-free, privacy-friendly, and easily adaptable system with little reference training data. Data from 24 subjects are preprocessed to extract respiration information using a 60 GHz frequency-modulated continuous wave radar. With few training examples, episodic optimization-based learning allows for generalization to new individuals. Episodically, a convolutional variational autoencoder learns how to map the processed radar data to a reference signal, generating a constrained latent space to the central respiration frequency. Moreover, autocorrelation over recorded radar data time assesses the information corruption due to subject motions. The model learning procedure and breathing prediction are adjusted by exploiting the motion corruption level. Thanks to the episodic acquired knowledge, the model requires an adaptation time of less than one and two seconds for one to five training examples, respectively. The suggested approach represents a novel, quickly adaptable, non-contact alternative for office settings with little user motion.ITEA3 Unleash Potentials in Simulation (UPSIM) project (N°19006) German Federal Ministry of Education and Research (BMBF)Austrian Research Promotion Agency (FFG)Rijksdienst voor Ondernemend Nederland (Rvo)Innovation Fund Denmark (IFD

NON-CONTACT TECHNIQUES FOR HUMAN VITAL SIGN DETECTION AND GAIT ANALYSIS

Human vital signs including respiratory rate, heart rate, oxygen saturation, blood pressure, and body temperature are important physiological parameters that are used to track and monitor human health condition. Another important biological parameter of human health is human gait. Human vital sign detection and gait investigations have been attracted many scientists and practitioners in various fields such as sport medicine, geriatric medicine, bio-mechanic and bio-medical engineering and has many biological and medical applications such as diagnosis of health issues and abnormalities, elderly care and health monitoring, athlete performance analysis, and treatment of joint problems. Thoroughly tracking and understanding the normal motion of human limb joints can help to accurately monitor human subjects or patients over time to provide early flags of possible complications in order to aid in a proper diagnosis and development of future comprehensive treatment plans. With the spread of COVID-19 around the world, it has been getting more important than ever to employ technology that enables us to detect human vital signs in a non-contact way and helps protect both patients and healthcare providers from potentially life-threatening viruses, and have the potential to also provide a convenient way to monitor people health condition, remotely. A popular technique to extract biological parameters from a distance is to use cameras. Radar systems are another attractive solution for non-contact human vital signs monitoring and gait investigation that track and monitor these biological parameters without invading people privacy. The goal of this research is to develop non-contact methods that is capable of extracting human vital sign parameters and gait features accurately. To do that, in this work, optical systems including cameras and proper filters have been developed to extract human respiratory rate, heart rate, and oxygen saturation. Feasibility of blood pressure extraction using the developed optical technique has been investigated, too. Moreover, a wideband and low-cost radar system has been implemented to detect single or multiple human subject’s respiration and heart rate in dark or from behind the wall. The performance of the implemented radar system has been enhanced and it has been utilized for non-contact human gait analysis. Along with the hardware, advanced signal processing schemes have been enhanced and applied to the data collected using the aforementioned radar system. The data processing algorithms have been extended for multi-subject scenarios with high accuracy for both human vital sign detection and gait analysis. In addition, different configurations of this and high-performance radar system including mono-static and MIMO have been designed and implemented with great success. Many sets of exhaustive experiments have been conducted using different human subjects and various situations and accurate reference sensors have been used to validate the performance of the developed systems and algorithms