Multi-Person Motion Tracking via RF Body Reflections

Recently, we have witnessed the emergence of technologies that can localize a user and track her gestures based purely on radio reflections off the person's body. These technologies work even if the user is behind a wall or obstruction. However, for these technologies to be fully practical, they need to address major challenges such as scaling to multiple people, accurately localizing them and tracking their gestures, and localizing static users as opposed to requiring the user to move to be detectable. This paper presents WiZ, the first multi-person centimeter-scale motion tracking system that pinpoints people's locations based purely on RF reflections off their bodies. WiZ can also locate static users by sensing minute changes in their RF reflections due to breathing. Further, it can track concurrent gestures made by different individuals, even when they carry no wireless device on them. We implement a prototype of WiZ and show that it can localize up to five users each with a median accuracy of 8-18 cm and 7-11 cm in the x and y dimensions respectively. WiZ can also detect 3D pointing gestures of multiple users with a median orientation error of 8 -16 degrees for each of them. Finally, WiZ can track breathing motion and output the breath count of multiple people with high accuracy

The Future of the Operating Room: Surgical Preplanning and Navigation using High Accuracy Ultra-Wideband Positioning and Advanced Bone Measurement

This dissertation embodies the diversity and creativity of my research, of which much has been peer-reviewed, published in archival quality journals, and presented nationally and internationally. Portions of the work described herein have been published in the fields of image processing, forensic anthropology, physical anthropology, biomedical engineering, clinical orthopedics, and microwave engineering. The problem studied is primarily that of developing the tools and technologies for a next-generation surgical navigation system. The discussion focuses on the underlying technologies of a novel microwave positioning subsystem and a bone analysis subsystem. The methodologies behind each of these technologies are presented in the context of the overall system with the salient results helping to elucidate the difficult facets of the problem. The microwave positioning system is currently the highest accuracy wireless ultra-wideband positioning system that can be found in the literature. The challenges in producing a system with these capabilities are many, and the research and development in solving these problems should further the art of high accuracy pulse-based positioning

Spatial Identification Methods and Systems for RFID Tags

Disertační práce je zaměřena na metody a systémy pro měření vzdálenosti a lokalizaci RFID tagů pracujících v pásmu UHF. Úvod je věnován popisu současného stavu vědeckého poznání v oblasti RFID prostorové identifikace a stručnému shrnutí problematiky modelování a návrhu prototypů těchto systémů. Po specifikaci cílů disertace pokračuje práce popisem teorie modelování degenerovaného kanálu pro RFID komunikaci. Detailně jsou rozebrány metody měření vzdálenosti a odhadu směru příchodu signálu založené na zpracování fázové informace. Pro účely lokalizace je navrženo několik scénářů rozmístění antén. Modely degenerovaného kanálu jsou simulovány v systému MATLAB. Významná část této práce je věnována konceptu softwarově definovaného rádia (SDR) a specifikům jeho adaptace na UHF RFID, která využití běžných SDR systémů značně omezují. Diskutována je zejména problematika průniku nosné vysílače do přijímací cesty a požadavky na signál lokálního oscilátoru používaný pro směšování. Prezentovány jsou tři vyvinuté prototypy: experimentální dotazovač EXIN-1, měřicí systém založený na platformě Ettus USRP a anténní přepínací matice pro emulaci SIMO systému. Závěrečná část je zaměřena na testování a zhodnocení popisovaných lokalizačních technik, založených na měření komplexní přenosové funkce RFID kanálu. Popisuje úzkopásmové/širokopásmové měření vzdálenosti a metody odhadu směru signálu. Oba navržené scénáře rozmístění antén jsou v závěru ověřeny lokalizačním měřením v reálných podmínkách.The doctoral thesis is focused on methods and systems for ranging and localization of RFID tags operating in the UHF band. It begins with a description of the state of the art in the field of RFID positioning with short extension to the area of modeling and prototyping of such systems. After a brief specification of dissertation objectives, the thesis overviews the theory of degenerate channel modeling for RFID communication. Details are given about phase-based ranging and direction of arrival finding methods. Several antenna placement scenarios are proposed for localization purposes. The degenerate channel models are simulated in MATLAB. A significant part of the thesis is devoted to software defined radio (SDR) concept and its adaptation for UHF RFID operation, as it has its specialties which make the usage of standard SDR test equipment very disputable. Transmit carrier leakage into receiver path and requirements on local oscillator signals for mixing are discussed. The development of three experimental prototypes is also presented there: experimental interrogator EXIN-1, measurement system based on Ettus USRP platform, and antenna switching matrix for an emulation of SIMO system. The final part is focused on testing and evaluation of described positioning techniques based on complex backscatter channel transfer function measurement. Both narrowband/wideband ranging and direction of arrival methods are validated. Finally, both proposed antenna placement scenarios are evaluated with real-world measurements.

Development and Experimental Analysis of Wireless High Accuracy Ultra-Wideband Localization Systems for Indoor Medical Applications

This dissertation addresses several interesting and relevant problems in the field of wireless technologies applied to medical applications and specifically problems related to ultra-wideband high accuracy localization for use in the operating room. This research is cross disciplinary in nature and fundamentally builds upon microwave engineering, software engineering, systems engineering, and biomedical engineering. A good portion of this work has been published in peer reviewed microwave engineering and biomedical engineering conferences and journals. Wireless technologies in medicine are discussed with focus on ultra-wideband positioning in orthopedic surgical navigation. Characterization of the operating room as a medium for ultra-wideband signal transmission helps define system design requirements. A discussion of the first generation positioning system provides a context for understanding the overall system architecture of the second generation ultra-wideband positioning system outlined in this dissertation. A system-level simulation framework provides a method for rapid prototyping of ultra-wideband positioning systems which takes into account all facets of the system (analog, digital, channel, experimental setup). This provides a robust framework for optimizing overall system design in realistic propagation environments. A practical approach is taken to outline the development of the second generation ultra-wideband positioning system which includes an integrated tag design and real-time dynamic tracking of multiple tags. The tag and receiver designs are outlined as well as receiver-side digital signal processing, system-level design support for multi-tag tracking, and potential error sources observed in dynamic experiments including phase center error, clock jitter and drift, and geometric position dilution of precision. An experimental analysis of the multi-tag positioning system provides insight into overall system performance including the main sources of error. A five base station experiment shows the potential of redundant base stations in improving overall dynamic accuracy. Finally, the system performance in low signal-to-noise ratio and non-line-of-sight environments is analyzed by focusing on receiver-side digitally-implemented ranging algorithms including leading-edge detection and peak detection. These technologies are aimed at use in next-generation medical systems with many applications including surgical navigation, wireless telemetry, medical asset tracking, and in vivo wireless sensors

Doctor of Philosophy

dissertationThis work seeks to improve upon existing methods for device-free localization (DFL) using radio frequency (RF) sensor networks. Device-free localization is the process of determining the location of a target object, typically a person, without the need for a device to be with the object to aid in localization. An RF sensor network measures changes to radio propagation caused by the presence of a person to locate that person. We show how existing methods which use either wideband or narrowband RF channels can be improved in ways including localization accuracy, energy efficiency, and system cost. We also show how wideband and narrowband systems can combine their information to improve localization. A common assumption in ultra-wideband research is that to estimate the bistatic delay or range, "background subtraction" is effective at removing clutter and must first be performed. Another assumption commonly made is that after background subtraction, each individual multipath component caused by a person's presence can be distinguished perfectly. We show that these assumptions are often not true and that ranging can still be performed even when these assumptions are not true. We propose modeling the difference between a current set of channel impulse responses (CIR) and a set of calibration CIRs as a hidden Markov model (HMM) and show the effectiveness of this model over background subtraction. The methods for performing device-free localization by using ultra-wideband (UWB) measurements and by using received signal strength (RSS) measurements are often considered separate topic of research and viewed only in isolation by two different communities of researchers. We consider both of these methods together and propose methods for combining the information obtained from UWB and RSS measurements. We show that using both methods in conjunction is more effective than either method on its own, especially in a setting where radio placement is constrained. It has been shown that for RSS-based DFL, measuring on multiple channels improves localization accuracy. We consider the trade-o s of measuring all radio links on all channels and the energy and latency expense of making the additional measurements required when sampling multiple channels. We also show the benefits of allowing multiple radios to transmit simultaneously, or in parallel, to better measure the available radio links

Cancer Detection Using Advanced UWB Microwave Technology

Medical diagnosis and subsequent treatment efficacy hinge on innovative imaging modalities. Among these, Microwave Imaging (MWI) has emerged as a compelling approach, offering safe and cost-efficient visualization of the human body. This comprehensive research explores the potential of the Huygens principle-based microwave imaging algorithm, specifically focusing on its prowess in cancer, lesion, and infection detection. Extensive experimentation employing meticulously crafted phantoms validates the algorithm’s robustness. In the context of lung infections, this study harnesses the power of Huygens-based microwave imaging to detect lung-COVID-19 infections. Employing Microstrip and horn antennas within a frequency range of 1 to 5 GHz and a multi-bistatic setup in an anechoic chamber, the research utilizes phantoms mimicking human torso dimensions and dielectric properties. Notably, the study achieves a remarkable detection capability, attaining a signal-to-clutter ratio of 7 dB during image reconstruction using S21 signals.A higher SCR ratio indicates better contrast and clarity of the detected inclusion, which is essential for reliable medical imaging. It is noteworthy that this achievement is realized in free space without necessitating coupling liquid, underscoring the algorithm’s practicality. Furthermore, the research delves into the validation of Huygens Principle (HP)-based microwave imaging in detecting intricate lung lesions. Utilizing a meticulously designed multi-layered phantom with characteristics closely mirroring human anatomy, the study spans frequency bands from 0.5 GHz to 3 GHz within an anechoic chamber. The outcomes are compelling, demonstrating consistent lesion detection within reconstructed images. Impressively, the signal-to-clutter ratio post-artifact removal surges to 13.4 dB, affirming the algorithm’s potential in elevating medical imaging precision. To propel the capabilities of MWI further, this research unveils a novel device: 3D microwave imaging rooted in Huygens principle. Leveraging MammoWave device’s capabilities, the study ventures into 3D image reconstruction. Dedicated phantoms housing 3D structured inclusions, each embodying distinct dielectric properties, serve as the experimental bedrock. Through an intricate interplay of data acquisition and processing, the study attains a laudable feat: seamless 3D visualization of inclusions across various z-axis planes, accompanied by minimal dimensional error not exceeding 7.5%. In a parallel exploration, spiral-like measurement configurations enter the spotlight. These configurations, meticulously tailored along the z-axis, yield promising results. The research unveils an innovative approach to reducing measurement time while safeguarding imaging fidelity. Notably, spiral-like measurements achieve a notable 50% reduction in measurement time, albeit with slight trade-offs. Signal-to-clutter ratios experience a modest reduction, and there is a minor increase in dimensional analysis error, which remains within the confines of 3.5%. The research findings serve as a testament to MWI’s efficacy across diverse medical domains. The success in lung infection and lesion detection underscores its potential impact on medical diagnostics. Moreover, the foray into 3D imaging and the strategic exploration of measurement configurations lay the foundation for future advancements in microwave imaging technologies. As a result, the outcomes of this research promise to reshape the landscape of accurate and efficient medical imaging modalities

Localisation and tracking of people using distributed UWB sensors

In vielen Überwachungs- und Rettungsszenarien ist die Lokalisierung und Verfolgung von Personen in Innenräumen auf nichtkooperative Weise erforderlich. Für die Erkennung von Objekten durch Wände in kurzer bis mittlerer Entfernung, ist die Ultrabreitband (UWB) Radartechnologie aufgrund ihrer hohen zeitlichen Auflösung und Durchdringungsfähigkeit Erfolg versprechend. In dieser Arbeit wird ein Prozess vorgestellt, mit dem Personen in Innenräumen mittels UWB-Sensoren lokalisiert werden können. Er umfasst neben der Erfassung von Messdaten, Abstandschätzungen und dem Erkennen von Mehrfachzielen auch deren Ortung und Verfolgung. Aufgrund der schwachen Reflektion von Personen im Vergleich zum Rest der Umgebung, wird zur Personenerkennung zuerst eine Hintergrundsubtraktionsmethode verwendet. Danach wird eine konstante Falschalarmrate Methode zur Detektion und Abstandschätzung von Personen angewendet. Für Mehrfachziellokalisierung mit einem UWB-Sensor wird eine Assoziationsmethode entwickelt, um die Schätzungen des Zielabstandes den richtigen Zielen zuzuordnen. In Szenarien mit mehreren Zielen kann es vorkommen, dass ein näher zum Sensor positioniertes Ziel ein anderes abschattet. Ein Konzept für ein verteiltes UWB-Sensornetzwerk wird vorgestellt, in dem sich das Sichtfeld des Systems durch die Verwendung mehrerer Sensoren mit unterschiedlichen Blickfeldern erweitert lässt. Hierbei wurde ein Prototyp entwickelt, der durch Fusion von Sensordaten die Verfolgung von Mehrfachzielen in Echtzeit ermöglicht. Dabei spielen insbesondere auch Synchronisierungs- und Kooperationsaspekte eine entscheidende Rolle. Sensordaten können durch Zeitversatz und systematische Fehler gestört sein. Falschmessungen und Rauschen in den Messungen beeinflussen die Genauigkeit der Schätzergebnisse. Weitere Erkenntnisse über die Zielzustände können durch die Nutzung zeitlicher Informationen gewonnen werden. Ein Mehrfachzielverfolgungssystem wird auf der Grundlage des Wahrscheinlichkeitshypothesenfilters (Probability Hypothesis Density Filter) entwickelt, und die Unterschiede in der Systemleistung werden bezüglich der von den Sensoren ausgegebene Informationen, d.h. die Fusion von Ortungsinformationen und die Fusion von Abstandsinformationen, untersucht. Die Information, dass ein Ziel detektiert werden sollte, wenn es aufgrund von Abschattungen durch andere Ziele im Szenario nicht erkannt wurde, wird als dynamische Überdeckungswahrscheinlichkeit beschrieben. Die dynamische Überdeckungswahrscheinlichkeit wird in das Verfolgungssystem integriert, wodurch weniger Sensoren verwendet werden können, während gleichzeitig die Performanz des Schätzers in diesem Szenario verbessert wird. Bei der Methodenauswahl und -entwicklung wurde die Anforderung einer Echtzeitanwendung bei unbekannten Szenarien berücksichtigt. Jeder untersuchte Aspekt der Mehrpersonenlokalisierung wurde im Rahmen dieser Arbeit mit Hilfe von Simulationen und Messungen in einer realistischen Umgebung mit UWB Sensoren verifiziert.Indoor localisation and tracking of people in non-cooperative manner is important in many surveillance and rescue applications. Ultra wideband (UWB) radar technology is promising for through-wall detection of objects in short to medium distances due to its high temporal resolution and penetration capability. This thesis tackles the problem of localisation of people in indoor scenarios using UWB sensors. It follows the process from measurement acquisition, multiple target detection and range estimation to multiple target localisation and tracking. Due to the weak reflection of people compared to the rest of the environment, a background subtraction method is initially used for the detection of people. Subsequently, a constant false alarm rate method is applied for detection and range estimation of multiple persons. For multiple target localisation using a single UWB sensor, an association method is developed to assign target range estimates to the correct targets. In the presence of multiple targets it can happen that targets closer to the sensor induce shadowing over the environment hindering the detection of other targets. A concept for a distributed UWB sensor network is presented aiming at extending the field of view of the system by using several sensors with different fields of view. A real-time operational prototype has been developed taking into consideration sensor cooperation and synchronisation aspects, as well as fusion of the information provided by all sensors. Sensor data may be erroneous due to sensor bias and time offset. Incorrect measurements and measurement noise influence the accuracy of the estimation results. Additional insight of the targets states can be gained by exploiting temporal information. A multiple person tracking framework is developed based on the probability hypothesis density filter, and the differences in system performance are highlighted with respect to the information provided by the sensors i.e. location information fusion vs range information fusion. The information that a target should have been detected when it is not due to shadowing induced by other targets is described as dynamic occlusion probability. The dynamic occlusion probability is incorporated into the tracking framework, allowing fewer sensors to be used while improving the tracker performance in the scenario. The method selection and development has taken into consideration real-time application requirements for unknown scenarios at every step. Each investigated aspect of multiple person localization within the scope of this thesis has been verified using simulations and measurements in a realistic environment using M-sequence UWB sensors

Development and Evaluation of a Multistatic Ultrawideband Random Noise Radar

This research studies the AFIT noise network (NoNET) radar node design and the feasibility in processing the bistatic channel information of a cluster of widely distributed noise radar nodes. A system characterization is used to predict theoretical localization performance metrics. Design and integration of a distributed and central signal and data processing architecture enables the Matlab®-driven signal data acquisition, digital processing and multi-sensor image fusion. Experimental evaluation of the monostatic localization performance reveals its range measurement error standard deviation is 4.8 cm with a range resolution of 87.2(±5.9) cm. The 16-channel multistatic solution results in a 2-dimensional localization error of 7.7(±3.1) cm and a comparative analysis is performed against the netted monostatic solution. Results show that active sensing with a low probability of intercept (LPI) multistatic radar, like the NoNET, is capable of producing sub-meter accuracy and near meter-resolution imagery