Localisation and tracking of people using distributed UWB sensors

In vielen Überwachungs- und Rettungsszenarien ist die Lokalisierung und Verfolgung von Personen in Innenräumen auf nichtkooperative Weise erforderlich. Für die Erkennung von Objekten durch Wände in kurzer bis mittlerer Entfernung, ist die Ultrabreitband (UWB) Radartechnologie aufgrund ihrer hohen zeitlichen Auflösung und Durchdringungsfähigkeit Erfolg versprechend. In dieser Arbeit wird ein Prozess vorgestellt, mit dem Personen in Innenräumen mittels UWB-Sensoren lokalisiert werden können. Er umfasst neben der Erfassung von Messdaten, Abstandschätzungen und dem Erkennen von Mehrfachzielen auch deren Ortung und Verfolgung. Aufgrund der schwachen Reflektion von Personen im Vergleich zum Rest der Umgebung, wird zur Personenerkennung zuerst eine Hintergrundsubtraktionsmethode verwendet. Danach wird eine konstante Falschalarmrate Methode zur Detektion und Abstandschätzung von Personen angewendet. Für Mehrfachziellokalisierung mit einem UWB-Sensor wird eine Assoziationsmethode entwickelt, um die Schätzungen des Zielabstandes den richtigen Zielen zuzuordnen. In Szenarien mit mehreren Zielen kann es vorkommen, dass ein näher zum Sensor positioniertes Ziel ein anderes abschattet. Ein Konzept für ein verteiltes UWB-Sensornetzwerk wird vorgestellt, in dem sich das Sichtfeld des Systems durch die Verwendung mehrerer Sensoren mit unterschiedlichen Blickfeldern erweitert lässt. Hierbei wurde ein Prototyp entwickelt, der durch Fusion von Sensordaten die Verfolgung von Mehrfachzielen in Echtzeit ermöglicht. Dabei spielen insbesondere auch Synchronisierungs- und Kooperationsaspekte eine entscheidende Rolle. Sensordaten können durch Zeitversatz und systematische Fehler gestört sein. Falschmessungen und Rauschen in den Messungen beeinflussen die Genauigkeit der Schätzergebnisse. Weitere Erkenntnisse über die Zielzustände können durch die Nutzung zeitlicher Informationen gewonnen werden. Ein Mehrfachzielverfolgungssystem wird auf der Grundlage des Wahrscheinlichkeitshypothesenfilters (Probability Hypothesis Density Filter) entwickelt, und die Unterschiede in der Systemleistung werden bezüglich der von den Sensoren ausgegebene Informationen, d.h. die Fusion von Ortungsinformationen und die Fusion von Abstandsinformationen, untersucht. Die Information, dass ein Ziel detektiert werden sollte, wenn es aufgrund von Abschattungen durch andere Ziele im Szenario nicht erkannt wurde, wird als dynamische Überdeckungswahrscheinlichkeit beschrieben. Die dynamische Überdeckungswahrscheinlichkeit wird in das Verfolgungssystem integriert, wodurch weniger Sensoren verwendet werden können, während gleichzeitig die Performanz des Schätzers in diesem Szenario verbessert wird. Bei der Methodenauswahl und -entwicklung wurde die Anforderung einer Echtzeitanwendung bei unbekannten Szenarien berücksichtigt. Jeder untersuchte Aspekt der Mehrpersonenlokalisierung wurde im Rahmen dieser Arbeit mit Hilfe von Simulationen und Messungen in einer realistischen Umgebung mit UWB Sensoren verifiziert.Indoor localisation and tracking of people in non-cooperative manner is important in many surveillance and rescue applications. Ultra wideband (UWB) radar technology is promising for through-wall detection of objects in short to medium distances due to its high temporal resolution and penetration capability. This thesis tackles the problem of localisation of people in indoor scenarios using UWB sensors. It follows the process from measurement acquisition, multiple target detection and range estimation to multiple target localisation and tracking. Due to the weak reflection of people compared to the rest of the environment, a background subtraction method is initially used for the detection of people. Subsequently, a constant false alarm rate method is applied for detection and range estimation of multiple persons. For multiple target localisation using a single UWB sensor, an association method is developed to assign target range estimates to the correct targets. In the presence of multiple targets it can happen that targets closer to the sensor induce shadowing over the environment hindering the detection of other targets. A concept for a distributed UWB sensor network is presented aiming at extending the field of view of the system by using several sensors with different fields of view. A real-time operational prototype has been developed taking into consideration sensor cooperation and synchronisation aspects, as well as fusion of the information provided by all sensors. Sensor data may be erroneous due to sensor bias and time offset. Incorrect measurements and measurement noise influence the accuracy of the estimation results. Additional insight of the targets states can be gained by exploiting temporal information. A multiple person tracking framework is developed based on the probability hypothesis density filter, and the differences in system performance are highlighted with respect to the information provided by the sensors i.e. location information fusion vs range information fusion. The information that a target should have been detected when it is not due to shadowing induced by other targets is described as dynamic occlusion probability. The dynamic occlusion probability is incorporated into the tracking framework, allowing fewer sensors to be used while improving the tracker performance in the scenario. The method selection and development has taken into consideration real-time application requirements for unknown scenarios at every step. Each investigated aspect of multiple person localization within the scope of this thesis has been verified using simulations and measurements in a realistic environment using M-sequence UWB sensors

A Survey on Fundamental Limits of Integrated Sensing and Communication

The integrated sensing and communication (ISAC), in which the sensing and communication share the same frequency band and hardware, has emerged as a key technology in future wireless systems due to two main reasons. First, many important application scenarios in fifth generation (5G) and beyond, such as autonomous vehicles, Wi-Fi sensing and extended reality, requires both high-performance sensing and wireless communications. Second, with millimeter wave and massive multiple-input multiple-output (MIMO) technologies widely employed in 5G and beyond, the future communication signals tend to have high-resolution in both time and angular domain, opening up the possibility for ISAC. As such, ISAC has attracted tremendous research interest and attentions in both academia and industry. Early works on ISAC have been focused on the design, analysis and optimization of practical ISAC technologies for various ISAC systems. While this line of works are necessary, it is equally important to study the fundamental limits of ISAC in order to understand the gap between the current state-of-the-art technologies and the performance limits, and provide useful insights and guidance for the development of better ISAC technologies that can approach the performance limits. In this paper, we aim to provide a comprehensive survey for the current research progress on the fundamental limits of ISAC. Particularly, we first propose a systematic classification method for both traditional radio sensing (such as radar sensing and wireless localization) and ISAC so that they can be naturally incorporated into a unified framework. Then we summarize the major performance metrics and bounds used in sensing, communications and ISAC, respectively. After that, we present the current research progresses on fundamental limits of each class of the traditional sensing and ISAC systems. Finally, the open problems and future research directions are discussed

Target localization in MIMO radar systems

MIMO (Multiple-Input Multiple-Output) radar systems employ multiple antennas to transmit multiple waveforms and engage in joint processing of the received echoes from the target. MIMO radar has been receiving increasing attention in recent years from researchers, practitioners, and funding agencies. Elements of MIMO radar have the ability to transmit diverse waveforms ranging from independent to fully correlated. MIMO radar offers a new paradigm for signal processing research. In this dissertation, target localization accuracy performance, attainable by the use of MIMO radar systems, configured with multiple transmit and receive sensors, widely distributed over an area, are studied. The Cramer-Rao lower bound (CRLB) for target localization accuracy is developed for both coherent and noncoherent processing. The CRLB is shown to be inversely proportional to the signal effective bandwidth in the noncoherent case, but is approximately inversely proportional to the carrier frequency in the coherent case. It is shown that optimization over the sensors\u27 positions lowers the CRLB by a factor equal to the product of the number of transmitting and receiving sensors. The best linear unbiased estimator (BLUE) is derived for the MIMO target localization problem. The BLUE\u27s utility is in providing a closed-form localization estimate that facilitates the analysis of the relations between sensors locations, target location, and localization accuracy. Geometric dilution of precision (GDOP) contours are used to map the relative performance accuracy for a given layout of radars over a given geographic area. Coherent processing advantage for target localization relies on time and phase synchronization between transmitting and receiving radars. An analysis of the sensitivity of the localization performance with respect to the variance of phase synchronization error is provided by deriving the hybrid CRLB. The single target case is extended to the evaluation of multiple target localization performance. Thus far, the analysis assumes a stationary target. Study of moving target tracking capabilities is offered through the use of the Bayesian CRLB for the estimation of both target location and velocity. Centralized and decentralized tracking algorithms, inherit to distributed MIMO radar architecture, are proposed and evaluated. It is shown that communication requirements and processing load may be reduced at a relatively low performance cost

Joint Radar and Communication Design: Applications, State-of-the-Art, and the Road Ahead

Sharing of the frequency bands between radar and communication systems has attracted substantial attention, as it can avoid under-utilization of otherwise permanently allocated spectral resources, thus improving efficiency. Further, there is increasing demand for radar and communication systems that share the hardware platform as well as the frequency band, as this not only decongests the spectrum, but also benefits both sensing and signaling operations via the full cooperation between both functionalities. Nevertheless, the success of spectrum and hardware sharing between radar and communication systems critically depends on high-quality joint radar and communication designs. In the first part of this paper, we overview the research progress in the areas of radar-communication coexistence and dual-functional radar-communication (DFRC) systems, with particular emphasis on application scenarios and technical approaches. In the second part, we propose a novel transceiver architecture and frame structure for a DFRC base station (BS) operating in the millimeter wave (mmWave) band, using the hybrid analog-digital (HAD) beamforming technique. We assume that the BS is serving a multi-antenna user equipment (UE) over a mmWave channel, and at the same time it actively detects targets. The targets also play the role of scatterers for the communication signal. In that framework, we propose a novel scheme for joint target search and communication channel estimation, which relies on omni-directional pilot signals generated by the HAD structure. Given a fully-digital communication precoder and a desired radar transmit beampattern, we propose to design the analog and digital precoders under non-convex constant-modulus (CM) and power constraints, such that the BS can formulate narrow beams towards all the targets, while pre-equalizing the impact of the communication channel. Furthermore, we design a HAD receiver that can simultaneously process signals from the UE and echo waves from the targets. By tracking the angular variation of the targets, we show that it is possible to recover the target echoes and mitigate the resulting interference to the UE signals, even when the radar and communication signals share the same signal-to-noise ratio (SNR). The feasibility and efficiency of the proposed approaches in realizing DFRC are verified via numerical simulations. Finally, the paper concludes with an overview of the open problems in the research field of communication and radar spectrum sharing (CRSS)