A Review of Indoor Millimeter Wave Device-based Localization and Device-free Sensing Technologies and Applications

The commercial availability of low-cost millimeter wave (mmWave) communication and radar devices is starting to improve the penetration of such technologies in consumer markets, paving the way for large-scale and dense deployments in fifth-generation (5G)-and-beyond as well as 6G networks. At the same time, pervasive mmWave access will enable device localization and device-free sensing with unprecedented accuracy, especially with respect to sub-6 GHz commercial-grade devices. This paper surveys the state of the art in device-based localization and device-free sensing using mmWave communication and radar devices, with a focus on indoor deployments. We first overview key concepts about mmWave signal propagation and system design. Then, we provide a detailed account of approaches and algorithms for localization and sensing enabled by mmWaves. We consider several dimensions in our analysis, including the main objectives, techniques, and performance of each work, whether each research reached some degree of implementation, and which hardware platforms were used for this purpose. We conclude by discussing that better algorithms for consumer-grade devices, data fusion methods for dense deployments, as well as an educated application of machine learning methods are promising, relevant and timely research directions.Comment: 43 pages, 13 figures. Accepted in IEEE Communications Surveys & Tutorials (IEEE COMST

Contact and remote breathing rate monitoring techniques: a review

ABSTRACT: Breathing rate monitoring is a must for hospitalized patients with the current coronavirus disease 2019 (COVID-19). We review in this paper recent implementations of breathing monitoring techniques, where both contact and remote approaches are presented. It is known that with non-contact monitoring, the patient is not tied to an instrument, which improves patients’ comfort and enhances the accuracy of extracted breathing activity, since the distress generated by a contact device is avoided. Remote breathing monitoring allows screening people infected with COVID-19 by detecting abnormal respiratory patterns. However, non-contact methods show some disadvantages such as the higher set-up complexity compared to contact ones. On the other hand, many reported contact methods are mainly implemented using discrete components. While, numerous integrated solutions have been reported for non-contact techniques, such as continuous wave (CW) Doppler radar and ultrawideband (UWB) pulsed radar. These radar chips are discussed and their measured performances are summarized and compared

Design and Implementation of a Stepped Frequency Continuous Wave Radar System for Biomedical Applications

There is a need to detect vital signs of human (e.g., the respiration and heart-beat rate) with noncontact method in a number of applications such as search and rescue operation (e.g. earthquakes, fire), health monitoring of the elderly, performance monitoring of athletes Ultra-wideband radar system can be utilized for noncontact vital signs monitoring and tracking of various human activities of more than one subject. Therefore, a stepped-frequency continuous wave radar (SFCW) system with wideband performance is designed and implemented for Vital signs detection and fall events monitoring. The design of the SFCW radar system is firstly developed using off-the-shelf discrete components. Later, the system is implemented using surface mount components to make it portable with low cost. The measurement result is proved to be accurate for both heart rate and respiration rate detection within ±5% when compared with contact measurements. Furthermore, an electromagnetic model has been developed using a multi-layer dielectric model of the human subject to validate the experimental results. The agreement between measured and simulated results is good for distances up to 2 m and at various subjects’ orientations with respect to the radar, even in the presence of more than one subject. The compressive sensing (CS) technique is utilized to reduce the size of the acquired data to levels significantly below the Nyquist threshold. In our demonstration, we use phase information contained in the obtained complex high-resolution range profile (HRRP) to derive the motion characteristics of the human. The obtained data has been successfully utilized for non-contact walk, fall and limping detection and healthcare monitoring. The effectiveness of the proposed method is validated using measured results

LOW-POWER IMPULSE-RADIO ULTRA-WIDEBAND TECHNIQUES FOR BIOMEDICAL APPLICATIONS.

Ph.DDOCTOR OF PHILOSOPH

A comprehensive multimodal dataset for contactless lip reading and acoustic analysis

Small-scale motion detection using non-invasive remote sensing techniques has recently garnered significant interest in the field of speech recognition. Our dataset paper aims to facilitate the enhancement and restoration of speech information from diverse data sources for speakers. In this paper, we introduce a novel multimodal dataset based on Radio Frequency, visual, text, audio, laser and lip landmark information, also called RVTALL. Specifically, the dataset consists of 7.5 GHz Channel Impulse Response (CIR) data from ultra-wideband (UWB) radars, 77 GHz frequency modulated continuous wave (FMCW) data from millimeter wave (mmWave) radar, visual and audio information, lip landmarks and laser data, offering a unique multimodal approach to speech recognition research. Meanwhile, a depth camera is adopted to record the landmarks of the subject’s lip and voice. Approximately 400 minutes of annotated speech profiles are provided, which are collected from 20 participants speaking 5 vowels, 15 words, and 16 sentences. The dataset has been validated and has potential for the investigation of lip reading and multimodal speech recognition

Terahertz Communications and Sensing for 6G and Beyond: A Comprehensive View

The next-generation wireless technologies, commonly referred to as the sixth generation (6G), are envisioned to support extreme communications capacity and in particular disruption in the network sensing capabilities. The terahertz (THz) band is one potential enabler for those due to the enormous unused frequency bands and the high spatial resolution enabled by both short wavelengths and bandwidths. Different from earlier surveys, this paper presents a comprehensive treatment and technology survey on THz communications and sensing in terms of the advantages, applications, propagation characterization, channel modeling, measurement campaigns, antennas, transceiver devices, beamforming, networking, the integration of communications and sensing, and experimental testbeds. Starting from the motivation and use cases, we survey the development and historical perspective of THz communications and sensing with the anticipated 6G requirements. We explore the radio propagation, channel modeling, and measurements for THz band. The transceiver requirements, architectures, technological challenges, and approaches together with means to compensate for the high propagation losses by appropriate antenna and beamforming solutions. We survey also several system technologies required by or beneficial for THz systems. The synergistic design of sensing and communications is explored with depth. Practical trials, demonstrations, and experiments are also summarized. The paper gives a holistic view of the current state of the art and highlights the issues and challenges that are open for further research towards 6G.Comment: 55 pages, 10 figures, 8 tables, submitted to IEEE Communications Surveys & Tutorial

Development and Experimental Analysis of Wireless High Accuracy Ultra-Wideband Localization Systems for Indoor Medical Applications

This dissertation addresses several interesting and relevant problems in the field of wireless technologies applied to medical applications and specifically problems related to ultra-wideband high accuracy localization for use in the operating room. This research is cross disciplinary in nature and fundamentally builds upon microwave engineering, software engineering, systems engineering, and biomedical engineering. A good portion of this work has been published in peer reviewed microwave engineering and biomedical engineering conferences and journals. Wireless technologies in medicine are discussed with focus on ultra-wideband positioning in orthopedic surgical navigation. Characterization of the operating room as a medium for ultra-wideband signal transmission helps define system design requirements. A discussion of the first generation positioning system provides a context for understanding the overall system architecture of the second generation ultra-wideband positioning system outlined in this dissertation. A system-level simulation framework provides a method for rapid prototyping of ultra-wideband positioning systems which takes into account all facets of the system (analog, digital, channel, experimental setup). This provides a robust framework for optimizing overall system design in realistic propagation environments. A practical approach is taken to outline the development of the second generation ultra-wideband positioning system which includes an integrated tag design and real-time dynamic tracking of multiple tags. The tag and receiver designs are outlined as well as receiver-side digital signal processing, system-level design support for multi-tag tracking, and potential error sources observed in dynamic experiments including phase center error, clock jitter and drift, and geometric position dilution of precision. An experimental analysis of the multi-tag positioning system provides insight into overall system performance including the main sources of error. A five base station experiment shows the potential of redundant base stations in improving overall dynamic accuracy. Finally, the system performance in low signal-to-noise ratio and non-line-of-sight environments is analyzed by focusing on receiver-side digitally-implemented ranging algorithms including leading-edge detection and peak detection. These technologies are aimed at use in next-generation medical systems with many applications including surgical navigation, wireless telemetry, medical asset tracking, and in vivo wireless sensors

Smart Devices and Systems for Wearable Applications

Wearable technologies need a smooth and unobtrusive integration of electronics and smart materials into textiles. The integration of sensors, actuators and computing technologies able to sense, react and adapt to external stimuli, is the expression of a new generation of wearable devices. The vision of wearable computing describes a system made by embedded, low power and wireless electronics coupled with smart and reliable sensors - as an integrated part of textile structure or directly in contact with the human body. Therefore, such system must maintain its sensing capabilities under the demand of normal clothing or textile substrate, which can impose severe mechanical deformation to the underlying garment/substrate. The objective of this thesis is to introduce a novel technological contribution for the next generation of wearable devices adopting a multidisciplinary approach in which knowledge of circuit design with Ultra-Wide Band and Bluetooth Low Energy technology, realization of smart piezoresistive / piezocapacitive and electro-active material, electro-mechanical characterization, design of read-out circuits and system integration find a fundamental and necessary synergy. The context and the results presented in this thesis follow an “applications driven” method in terms of wearable technology. A proof of concept has been designed and developed for each addressed issue. The solutions proposed are aimed to demonstrate the integration of a touch/pressure sensor into a fabric for space debris detection (CApture DEorbiting Target project), the effectiveness of the Ultra-Wide Band technology as an ultra-low power data transmission option compared with well known Bluetooth (IR-UWB data transmission project) and to solve issues concerning human proximity estimation (IR-UWB Face-to-Face Interaction and Proximity Sensor), wearable actuator for medical applications (EAPtics project) and aerospace physiology countermeasure (Gravity Loading Countermeasure Skinsuit project)

Vital Signs Monitoring Based On UWB Radar

Contactless detection of human vital sign using radar sensors appears to be a promising technology which integrates communication, biomedicine, computer science etc. The radar-based vital sign detection has been actively investigated in the past decade. Due to the advantages such as wide bandwidth, high resolution, small and portable size etc., ultra-wideband (UWB) radar has received a great deal of attention in the health care field. In this thesis, an X4 series UWB radar developed by Xethru Company is adopted to detect human breathing signals through the radar echo reflected by the chest wall movement caused by breath and heartbeat. The emphasis is placed on the estimation of breathing and heart rate based on several signal processing algorithms. Firstly, the research trend of vital sign detection using radar technology is reviewed, based on which the advantages of contactless detection and UWB radar-based technology are highlighted. Then theoretical basis and core algorithms of radar signals detection are presented. Meanwhile, the detection system based on Xethru UWB radar is introduced. Next, several preprocessing methods including SVD-based clutter and noise removal algorithms, the largest variance-based target detection method, and the autocorrelation-based breathing-like signal identification method are investigated, to extract the significant component containing the vital signs from the received raw radar echo signal. Then the thesis investigates four time-frequency analysis algorithms (fast Fourier transform + band-pass filter (FFT+BPF), empirical mode decomposition (EMD), ensemble empirical mode decomposition (EEMD) and variational mode decomposition (VMD) and compare their performances in estimating breathing rate (BR) and heart rate (HR) in different application scenarios. A python-based vital signs detection system is designed to implement the above-mentioned preprocessing and BR and HR estimation algorithms, based on which a large number of single target experiments are undertaken to evaluate the four estimation algorithms. Specifically, the single target experiments are divided into simple setup and challenging setup. In the simple setup, testees face to radar and keep normal breathing in an almost stationary posture, while in the challenging setup, the testee is allowed to do more actions, such as site sitting, changing the breathing frequency, deep hold the breathing. It is shown that the FFT+BPF algorithm gives the highest accuracy and the fastest calculation speed under the simple setup, while in a challenging setup, the VMD algorithm has the highest accuracy and the widest applicability. Finally, double targets breathing signal detection at different distances to the radar are undertaken, aiming to observe whether the breathing signals of two targets will interfere with each other. We found that when two objects are not located at the same distance to the radar, the object closer to the radar will not affect the breath detection of the object far from the radar. When the two targets are located at the same distance, the 'Shading effect' appears in the two breathing signals and only VMD algorithm can separate the breathing signals of the targets