Localisation and tracking of people using distributed UWB sensors

In vielen Überwachungs- und Rettungsszenarien ist die Lokalisierung und Verfolgung von Personen in Innenräumen auf nichtkooperative Weise erforderlich. Für die Erkennung von Objekten durch Wände in kurzer bis mittlerer Entfernung, ist die Ultrabreitband (UWB) Radartechnologie aufgrund ihrer hohen zeitlichen Auflösung und Durchdringungsfähigkeit Erfolg versprechend. In dieser Arbeit wird ein Prozess vorgestellt, mit dem Personen in Innenräumen mittels UWB-Sensoren lokalisiert werden können. Er umfasst neben der Erfassung von Messdaten, Abstandschätzungen und dem Erkennen von Mehrfachzielen auch deren Ortung und Verfolgung. Aufgrund der schwachen Reflektion von Personen im Vergleich zum Rest der Umgebung, wird zur Personenerkennung zuerst eine Hintergrundsubtraktionsmethode verwendet. Danach wird eine konstante Falschalarmrate Methode zur Detektion und Abstandschätzung von Personen angewendet. Für Mehrfachziellokalisierung mit einem UWB-Sensor wird eine Assoziationsmethode entwickelt, um die Schätzungen des Zielabstandes den richtigen Zielen zuzuordnen. In Szenarien mit mehreren Zielen kann es vorkommen, dass ein näher zum Sensor positioniertes Ziel ein anderes abschattet. Ein Konzept für ein verteiltes UWB-Sensornetzwerk wird vorgestellt, in dem sich das Sichtfeld des Systems durch die Verwendung mehrerer Sensoren mit unterschiedlichen Blickfeldern erweitert lässt. Hierbei wurde ein Prototyp entwickelt, der durch Fusion von Sensordaten die Verfolgung von Mehrfachzielen in Echtzeit ermöglicht. Dabei spielen insbesondere auch Synchronisierungs- und Kooperationsaspekte eine entscheidende Rolle. Sensordaten können durch Zeitversatz und systematische Fehler gestört sein. Falschmessungen und Rauschen in den Messungen beeinflussen die Genauigkeit der Schätzergebnisse. Weitere Erkenntnisse über die Zielzustände können durch die Nutzung zeitlicher Informationen gewonnen werden. Ein Mehrfachzielverfolgungssystem wird auf der Grundlage des Wahrscheinlichkeitshypothesenfilters (Probability Hypothesis Density Filter) entwickelt, und die Unterschiede in der Systemleistung werden bezüglich der von den Sensoren ausgegebene Informationen, d.h. die Fusion von Ortungsinformationen und die Fusion von Abstandsinformationen, untersucht. Die Information, dass ein Ziel detektiert werden sollte, wenn es aufgrund von Abschattungen durch andere Ziele im Szenario nicht erkannt wurde, wird als dynamische Überdeckungswahrscheinlichkeit beschrieben. Die dynamische Überdeckungswahrscheinlichkeit wird in das Verfolgungssystem integriert, wodurch weniger Sensoren verwendet werden können, während gleichzeitig die Performanz des Schätzers in diesem Szenario verbessert wird. Bei der Methodenauswahl und -entwicklung wurde die Anforderung einer Echtzeitanwendung bei unbekannten Szenarien berücksichtigt. Jeder untersuchte Aspekt der Mehrpersonenlokalisierung wurde im Rahmen dieser Arbeit mit Hilfe von Simulationen und Messungen in einer realistischen Umgebung mit UWB Sensoren verifiziert.Indoor localisation and tracking of people in non-cooperative manner is important in many surveillance and rescue applications. Ultra wideband (UWB) radar technology is promising for through-wall detection of objects in short to medium distances due to its high temporal resolution and penetration capability. This thesis tackles the problem of localisation of people in indoor scenarios using UWB sensors. It follows the process from measurement acquisition, multiple target detection and range estimation to multiple target localisation and tracking. Due to the weak reflection of people compared to the rest of the environment, a background subtraction method is initially used for the detection of people. Subsequently, a constant false alarm rate method is applied for detection and range estimation of multiple persons. For multiple target localisation using a single UWB sensor, an association method is developed to assign target range estimates to the correct targets. In the presence of multiple targets it can happen that targets closer to the sensor induce shadowing over the environment hindering the detection of other targets. A concept for a distributed UWB sensor network is presented aiming at extending the field of view of the system by using several sensors with different fields of view. A real-time operational prototype has been developed taking into consideration sensor cooperation and synchronisation aspects, as well as fusion of the information provided by all sensors. Sensor data may be erroneous due to sensor bias and time offset. Incorrect measurements and measurement noise influence the accuracy of the estimation results. Additional insight of the targets states can be gained by exploiting temporal information. A multiple person tracking framework is developed based on the probability hypothesis density filter, and the differences in system performance are highlighted with respect to the information provided by the sensors i.e. location information fusion vs range information fusion. The information that a target should have been detected when it is not due to shadowing induced by other targets is described as dynamic occlusion probability. The dynamic occlusion probability is incorporated into the tracking framework, allowing fewer sensors to be used while improving the tracker performance in the scenario. The method selection and development has taken into consideration real-time application requirements for unknown scenarios at every step. Each investigated aspect of multiple person localization within the scope of this thesis has been verified using simulations and measurements in a realistic environment using M-sequence UWB sensors

Target Localization Using Approximate Maximum Likelihood for MIMO Radar Systems

This thesis deals with target localization using multiple-input multiple-output (MIMO) radars. In the field of communications, navigation, radar, and sensing networks, one of the common and most sophisticated problems is target localization. We develop a target localization scheme in distributed MIMO radar systems using bistatic range measurements. The localization approach consists of two phases. First, measurements are divided into multiple groups based on the various transmitter and receiver elements. For each group, an approximate maximum likelihood (AML) estimator is proposed to estimate the location of a target. Then, the estimation results from these different groups are combined to form the final estimate. The performance of the proposed algorithm is validated by simulation and is shown to reach the Cram\'{e}r-Rao lower bound (CRLB) in a range of measurement noise levels. The main advantage of the proposed algorithm is that it achieves a higher accuracy than existing schemes for locating a target position in high-noise conditions

Development and performance evaluation of a multistatic radar system

Multistatic radar systems are of emerging interest as they can exploit spatial diversity, enabling improved performance and new applications. Their development is being fuelled by advances in enabling technologies in such fields as communications and Digital Signal Processing (DSP). Such systems differ from typical modern active radar systems through consisting of multiple spatially diverse transmitter and receiver sites. Due to this spatial diversity, these systems present challenges in managing their operation as well as in usefully combining the multiple sources of information to give an output to the radar operator. In this work, a novel digital Commercial Off-The-Shelf (COTS) based coherent multistatic radar system designed at University College London, named ‘NetRad’, has been developed to produce some of the first published experimental results, investigating the challenges of operating such a system, and determining what level of performance might be achievable. Full detail of the various stages involved in the combination of data from the component transmitter-receiver pairs within a multistatic system is investigated, and many of the practical issues inherent are discussed. Simulation and subsequent experimental verification of several centralised and decentralised detection algorithms in terms of localisation (resolution and parameter estimation) of targets was undertaken. The computational cost of the DSP involved in multistatic data fusion is also considered. This gave a clear demonstration of several of the benefits of multistatic radar. Resolution of multiple targets that would have been unresolvable in a conventional monostatic system was shown. Targets were also shown to be plotted as two-dimensional vector position and velocities from use of time delay and Doppler shift information only. A range of targets were used including some such as walking people which were particularly challenging due to the variability of Radar Cross Section (RCS). Performance improvements were found to be dependant on the type of multistatic radar, method of data fusion and target characteristics in question. It is likely that future work will look to further explore the optimisation of multistatic radar for the various measures of performance identified and discussed in this work

Doppler-only target tracking for a multistatic radar exploiting FM band illuminators of opportunity

Includes bibliographical referencesCommensal Radar (CR), defined as a subclass of Passive Radar (PR), is a receive only radar that exploits non-cooperative illuminators of opportunity for target detection, location and subsequent tracking. The objective of this thesis is to evaluate the feasibility of using a Frequency Modulation (FM) Broadcast band CR system as a cost effective solution for Air Traffic Control (ATC). An inherent complication by exploiting FM is the low range resolution due to the low bandwidth of FM radio signals. However, due to typical long integration times associated with CR, the frequency domain resolution is typically very good. As a result, measurements of the target's Doppler shift are highly accurate and could potentially make FM illuminators a viable source for ATC purposes. Accordingly, this thesis aims to obtain a comprehensive understanding of using high resolution Doppler measurements to accurately track the position of a target. This objective have been addressed b by performing a comprehensive mathematical analysis for a Doppler only tracking CR system. The analysis is verified with a tracking simulation, in which the Recursive Gauss Newton Filter (RGNF) is used and lastly, a field experiment was conducted to produce tracking results based on real measurement data. Results demonstrated that Doppler only target tracking from real measurement data is possible, even when the initial target state vector is initialised from real measurement data. A good degree of correlation is achieved between the theoretical, simulated and measured results, hence verifying the theoretical findings of this thesis. Ensuring that the observation matrix is properly conditioned in Doppler only tracking applications is important, as failure to do so results in tracking instability. Factors that influence the conditioning of the observation matrix are; the number of receivers used (assuming the basic observation criteria is met) and the placement of the receivers, keeping in mind the possibility of Doppler correlation in the measurements. The possibility of improving an ill-conditioned observation matrix is also demonstrated. In general, tracking filters, for example the RGNF, typically employ time history information and therefore, a direct comparison to the Cramer Rao Lower Bound (CRLB) is unrealistic and accordingly a new theoretical lower bound, called the Cumulative CRLB was derived that does account for time history measurements. Although the best results for this thesis are achieved by using long integration periods (4 s), the effect of Doppler walk was not compensated for and is an aspect that requires further investigation to potentially further improve on the results obtained in this thesis. As a final conclusion for this thesis; the Doppler only target tracking delivered some encouraging results, however a qualification test in the form of an extensive trial period is next required to motivate Doppler only tracking for ATC purposes

Improvement of detection and tracking techniques in multistatic passive radar systems. (Mejora de técnicas de detección y seguimiento en sistemas radar pasivos multiestáticos)

Esta tesis doctoral es el resultado de una intensa actividad investigadora centrada en los sensores radar pasivos para la mejora de las capacidades de detección y seguimiento en escenarios complejos con blancos terrestres y pequeños drones. El trabajo de investigación se ha llevado a cabo en el grupo de investigación coordinado por la Dra. María Pilar Jarabo Amores, dentro del marco diferentes proyectos: IDEPAR (“Improved DEtection techniques for PAssive Radars”), MASTERSAT (“MultichAnnel paSsive radar receiver exploiting TERrestrial and SATellite Illuminators”) y KRIPTON (“A Knowledge based appRoach to passIve radar detection using wideband sPace adapTive prOcessiNg”) financiados por el Ministerio de Economía y Competitividad de España; MAPIS (Multichannel passive ISAR imaging for military applications) y JAMPAR (“JAMmer-based PAssive Radar”), financiados por la Agencia Europea de Defensa (EDA) . El objetivo principal es la mejora de las técnicas de detección y seguimiento en radares pasivos con configuraciones biestáticas y multiestaticas. En el documento se desarrollan algoritmos para el aprovechamiento de señales procedentes de distintos iluminadores de oportunidad (transmisores DVB-T, satélites DVB-S y señales GPS). Las soluciones propuestas han sido integradas en el demostrador tecnológico IDEPAR, desarrollado y actualizado bajo los proyectos mencionados, y validadas en escenarios reales declarados de interés por potenciales usuarios finales (Direccion general de armamento y material, instituto nacional de tecnología aeroespacial y la armada española). Para el desarrollo y evaluación de cadenas de las cadenas de procesado, se plantean dos casos de estudio: blancos terrestres en escenarios semiurbanos edificios y pequeños blancos aéreos en escenarios rurales y costeros. Las principales contribuciones se pueden resumir en los siguientes puntos: • Diseño de técnicas de seguimiento 2D en el espacio de trabajo rango biestático-frecuencia Doppler: se desarrollan técnicas de seguimiento para los dos casos de estudio, localización de blancos terrestres y pequeños drones. Para es último se implementan técnicas capaces de seguir tanto el movimiento del dron como su firma Doppler, lo que permite implementar técnicas de clasificación de blancos. • Diseño de técnicas de seguimiento de blancos capaces de integrar información en el espacio 3D (rango, Doppler y acimut): se diseñan técnicas basadas en procesado en dos etapas, una primera con seguimiento en 2D para el filtrado de falsas alarmas y la segunda para el seguimiento en 3D y la conversión de coordenadas a un plano local cartesiano. Se comparan soluciones basadas en filtros de Kalman para sistemas tanto lineales como no lineales. • Diseño de cadenas de procesado para sistemas multiestáticos: la información estimada del blanco sobre múltiples geometrías biestáticas es utilizada para incremento de las capacidades de localización del blanco en el plano cartesiano local. Se presentan soluciones basadas en filtros de Kalman para sistemas no lineales explotando diferentes medidas biestáticas en el proceso de transformación de coordenadas, analizando las mejoras de precisión en la localización del blanco. • Diseño de etapas de procesado para radares pasivos basados en señales satelitales de las constelaciones GPS DVB-S. Se estudian las características de las señales satelitales identificando sus inconvenientes y proponiendo cadenas de procesado que permitan su utilización para la detección y seguimiento de blancos terrestres. • Estudio del uso de señales DVB-T multicanal con gaps de transmisión entre los diferentes canales en sistemas radares pasivos. Con ello se incrementa la resolución del sistema, y las capacidades de detección, seguimiento y localización. Se estudia el modelo de señal multicanal, sus efectos sobre el procesado coherente y se proponen cadenas de procesado para paliar los efectos adversos de este tipo de señales

A scalable real-time processing chain for radar exploiting illuminators of opportunity

Includes bibliographical references.This thesis details the design of a processing chain and system software for a commensal radar system, that is, a radar that makes use of illuminators of opportunity to provide the transmitted waveform. The stages of data acquisition from receiver back-end, direct path interference and clutter suppression, range/Doppler processing and target detection are described and targeted to general purpose commercial off-the-shelf computing hardware. A detailed low level design of such a processing chain for commensal radar which includes both processing stages and processing stage interactions has, to date, not been presented in the Literature. Furthermore, a novel deployment configuration for a networked multi-site FM broadcast band commensal radar system is presented in which the reference and surveillance channels are record at separate locations

Performance Analysis of Integrated Sensing and Communications Under Gain-Phase Imperfections

This paper evaluates the performance of uplink integrated sensing and communication systems in the presence of gain and phase imperfections. Specifically, we consider multiple unmanned aerial vehicles (UAVs) transmitting data to a multiple-input-multiple-output base-station (BS) that is responsible for estimating the transmitted information in addition to localising the transmitting UAVs. The signal processing at the BS is divided into two consecutive stages: localisation and communication. A maximum likelihood (ML) algorithm is introduced for the localisation stage to jointly estimate the azimuth-elevation angles and Doppler frequency of the UAVs under gain-phase defects, which are then compared to the estimation of signal parameters via rotational invariance techniques (ESPRIT) and multiple signal classification (MUSIC). Furthermore, the Cramer-Rao lower bound (CRLB) is derived to evaluate the asymptotic performance and quantify the influence of the gain-phase imperfections which are modelled using Rician and von Mises distributions, respectively. Thereafter, in the communication stage, the location parameters estimated in the first stage are employed to estimate the communication channels which are fed into a maximum ratio combiner to preprocess the received communication signal. An accurate closed-form approximation of the achievable average sum data rate (SDR) for all UAVs is derived. The obtained results show that gain-phase imperfections have a significant influence on both localisation and communication, however, the proposed ML is less sensitive when compared to other algorithms. The derived analysis is concurred with simulations.Comment: 38 pages, 7 figure

OFDM passive radar employing compressive processing in MIMO configurations

A key advantage of passive radar is that it provides a means of performing position detection and tracking without the need for transmission of energy pulses. In this respect, passive radar systems utilising (receiving) orthogonal frequency division multiplexing (OFDM) communications signals from transmitters using OFDM standards such as long term evolution (LTE), WiMax or WiFi, are considered. Receiving a stronger reference signal for the matched filtering, detecting a lower target signature is one of the challenges in the passive radar. Impinging at the receiver, the OFDM waveforms supply two-dimensional virtual uniform rectangul ararray with the first and second dimensions refer to time delays and Doppler frequencies respectively. A subspace method, multiple signals classification (MUSIC) algorithm, demonstrated the signal extraction using multiple time samples. Apply normal measurements, this problem requires high computational resources regarding the number of OFDM subcarriers. For sub-Nyquist sampling, compressive sensing (CS) becomes attractive. A single snap shot measurement can be applied with Basis Pursuit (BP), whereas l1-singular value decomposition (l1-SVD) is applied for the multiple snapshots. Employing multiple transmitters, the diversity in the detection process can be achieved. While a passive means of attaining three-dimensional large-set measurements is provided by co-located receivers, there is a significant computational burden in terms of the on-line analysis of such data sets. In this thesis, the passive radar problem is presented as a mathematically sparse problem and interesting solutions, BP and l1-SVD as well as Bayesian compressive sensing, fast-Besselk, are considered. To increase the possibility of target signal detection, beamforming in the compressive domain is also introduced with the application of conve xoptimization and subspace orthogonality. An interference study is also another problem when reconstructing the target signal. The networks of passive radars are employed using stochastic geometry in order to understand the characteristics of interference, and the effect of signal to interference plus noise ratio (SINR). The results demonstrate the outstanding performance of l1-SVD over MUSIC when employing multiple snapshots. The single snapshot problem along with fast-BesselK multiple-input multiple-output configuration can be solved using fast-BesselK and this allows the compressive beamforming for detection capability

Exploiting Sparse Structures in Source Localization and Tracking

This thesis deals with the modeling of structured signals under different sparsity constraints. Many phenomena exhibit an inherent structure that may be exploited when setting up models, examples include audio waves, radar, sonar, and image objects. These structures allow us to model, identify, and classify the processes, enabling parameter estimation for, e.g., identification, localisation, and tracking.In this work, such structures are exploited, with the goal to achieve efficient localisation and tracking of a structured source signal. Specifically, two scenarios are considered. In papers A and B, the aim is to find a sparse subset of a structured signal such that the signal parameters and source locations maybe estimated in an optimal way. For the sparse subset selection, a combinatorial optimization problem is approximately solved by means of convex relaxation, with the results of allowing for different types of a priori information to be incorporated in the optimization. In paper C, a sparse subset of data is provided, and a generative model is used to find the location of an unknown number of jammers in a wireless network, with the jammers’ movement in the network being tracked as additional observations become available