Localisation and tracking of people using distributed UWB sensors

In vielen Überwachungs- und Rettungsszenarien ist die Lokalisierung und Verfolgung von Personen in Innenräumen auf nichtkooperative Weise erforderlich. Für die Erkennung von Objekten durch Wände in kurzer bis mittlerer Entfernung, ist die Ultrabreitband (UWB) Radartechnologie aufgrund ihrer hohen zeitlichen Auflösung und Durchdringungsfähigkeit Erfolg versprechend. In dieser Arbeit wird ein Prozess vorgestellt, mit dem Personen in Innenräumen mittels UWB-Sensoren lokalisiert werden können. Er umfasst neben der Erfassung von Messdaten, Abstandschätzungen und dem Erkennen von Mehrfachzielen auch deren Ortung und Verfolgung. Aufgrund der schwachen Reflektion von Personen im Vergleich zum Rest der Umgebung, wird zur Personenerkennung zuerst eine Hintergrundsubtraktionsmethode verwendet. Danach wird eine konstante Falschalarmrate Methode zur Detektion und Abstandschätzung von Personen angewendet. Für Mehrfachziellokalisierung mit einem UWB-Sensor wird eine Assoziationsmethode entwickelt, um die Schätzungen des Zielabstandes den richtigen Zielen zuzuordnen. In Szenarien mit mehreren Zielen kann es vorkommen, dass ein näher zum Sensor positioniertes Ziel ein anderes abschattet. Ein Konzept für ein verteiltes UWB-Sensornetzwerk wird vorgestellt, in dem sich das Sichtfeld des Systems durch die Verwendung mehrerer Sensoren mit unterschiedlichen Blickfeldern erweitert lässt. Hierbei wurde ein Prototyp entwickelt, der durch Fusion von Sensordaten die Verfolgung von Mehrfachzielen in Echtzeit ermöglicht. Dabei spielen insbesondere auch Synchronisierungs- und Kooperationsaspekte eine entscheidende Rolle. Sensordaten können durch Zeitversatz und systematische Fehler gestört sein. Falschmessungen und Rauschen in den Messungen beeinflussen die Genauigkeit der Schätzergebnisse. Weitere Erkenntnisse über die Zielzustände können durch die Nutzung zeitlicher Informationen gewonnen werden. Ein Mehrfachzielverfolgungssystem wird auf der Grundlage des Wahrscheinlichkeitshypothesenfilters (Probability Hypothesis Density Filter) entwickelt, und die Unterschiede in der Systemleistung werden bezüglich der von den Sensoren ausgegebene Informationen, d.h. die Fusion von Ortungsinformationen und die Fusion von Abstandsinformationen, untersucht. Die Information, dass ein Ziel detektiert werden sollte, wenn es aufgrund von Abschattungen durch andere Ziele im Szenario nicht erkannt wurde, wird als dynamische Überdeckungswahrscheinlichkeit beschrieben. Die dynamische Überdeckungswahrscheinlichkeit wird in das Verfolgungssystem integriert, wodurch weniger Sensoren verwendet werden können, während gleichzeitig die Performanz des Schätzers in diesem Szenario verbessert wird. Bei der Methodenauswahl und -entwicklung wurde die Anforderung einer Echtzeitanwendung bei unbekannten Szenarien berücksichtigt. Jeder untersuchte Aspekt der Mehrpersonenlokalisierung wurde im Rahmen dieser Arbeit mit Hilfe von Simulationen und Messungen in einer realistischen Umgebung mit UWB Sensoren verifiziert.Indoor localisation and tracking of people in non-cooperative manner is important in many surveillance and rescue applications. Ultra wideband (UWB) radar technology is promising for through-wall detection of objects in short to medium distances due to its high temporal resolution and penetration capability. This thesis tackles the problem of localisation of people in indoor scenarios using UWB sensors. It follows the process from measurement acquisition, multiple target detection and range estimation to multiple target localisation and tracking. Due to the weak reflection of people compared to the rest of the environment, a background subtraction method is initially used for the detection of people. Subsequently, a constant false alarm rate method is applied for detection and range estimation of multiple persons. For multiple target localisation using a single UWB sensor, an association method is developed to assign target range estimates to the correct targets. In the presence of multiple targets it can happen that targets closer to the sensor induce shadowing over the environment hindering the detection of other targets. A concept for a distributed UWB sensor network is presented aiming at extending the field of view of the system by using several sensors with different fields of view. A real-time operational prototype has been developed taking into consideration sensor cooperation and synchronisation aspects, as well as fusion of the information provided by all sensors. Sensor data may be erroneous due to sensor bias and time offset. Incorrect measurements and measurement noise influence the accuracy of the estimation results. Additional insight of the targets states can be gained by exploiting temporal information. A multiple person tracking framework is developed based on the probability hypothesis density filter, and the differences in system performance are highlighted with respect to the information provided by the sensors i.e. location information fusion vs range information fusion. The information that a target should have been detected when it is not due to shadowing induced by other targets is described as dynamic occlusion probability. The dynamic occlusion probability is incorporated into the tracking framework, allowing fewer sensors to be used while improving the tracker performance in the scenario. The method selection and development has taken into consideration real-time application requirements for unknown scenarios at every step. Each investigated aspect of multiple person localization within the scope of this thesis has been verified using simulations and measurements in a realistic environment using M-sequence UWB sensors

Soft information for localization-of-things

Location awareness is vital for emerging Internetof- Things applications and opens a new era for Localizationof- Things. This paper first reviews the classical localization techniques based on single-value metrics, such as range and angle estimates, and on fixed measurement models, such as Gaussian distributions with mean equal to the true value of the metric. Then, it presents a new localization approach based on soft information (SI) extracted from intra- and inter-node measurements, as well as from contextual data. In particular, efficient techniques for learning and fusing different kinds of SI are described. Case studies are presented for two scenarios in which sensing measurements are based on: 1) noisy features and non-line-of-sight detector outputs and 2) IEEE 802.15.4a standard. The results show that SI-based localization is highly efficient, can significantly outperform classical techniques, and provides robustness to harsh propagation conditions.RYC-2016-1938

Towards localisation with Doppler radar

In this thesis the author introduces a novel method for Geo Localisation via Doppler Radar. The area of research is in the three dimensional space using amplitude and magnitude measurements. Geo Localisation in mobile applications is a useful technology that enables monitoring and gathering information about objects of interest

Bimodal sound source tracking applied to road traffic monitoring

The constant increase of road traffic requires closer and closer road network monitoring. The awareness of traffic characteristics in real time as well as its historical trends, facilitates decision-making for flow regulation, triggering relief operations, ensuring the motorists’ safety and contribute to optimize transport infrastructures. Today, the heterogeneity of the available data makes their processing complex and expensive (multiple sensors with different technologies, placed in different locations, with their own data format, unsynchronized, etc.). This leads metrologists to develop “smarter” monitoring devices, i.e. capable of providing all the necessary data synchronized from a single measurement point, with no impact on the flow road itself and ideally without complex installation. This work contributes to achieve such an objective through the development of a passive, compact, non-intrusive, acoustic-based system composed of a microphone array with a few number of elements placed on the roadside. The proposed signal processing techniques enable vehicle detection, the estimation of their speed as well as the estimation of their wheelbase length as they pass by. Sound sources emitted by tyre/road interactions are localized using generalized cross-correlation functions between sensor pairs. These successive correlation measurements are filtered using a sequential Monte Carlo method (particle filter) enabling, on one hand, the simultaneous tracking of multiple vehicles (that follow or pass each other) and on the other hand, a discrimination between useful sound sources and interfering noises. This document focuses on two-axle road vehicles only. The two tyre/road interactions (front and rear) observed by a microphone array on the roadside are modeled as two stochastic, zero-mean and uncorrelated processes, spatially disjoint by the wheelbase length. This bimodal sound source model defines a specific particle filter, called bimodal particle filter, which is presented here. Compared to the classical (unimodal) particle filter, a better robustness for speed estimation is achieved especially in cases of harsh observation. Moreover the proposed algorithm enables the wheelbase length estimation through purely passive acoustic measurement. An innovative microphone array design methodology, based on a mathematical expression of the observation and the tracking methodology itself is also presented. The developed algorithms are validated and assessed through in-situ measurements. Estimates provided by the acoustical signal processing are compared with standard radar measurements and confronted to video monitoring images. Although presented in a purely road-related applied context, we feel that the developed methodologies can be, at least partly, applied to rail, aerial, underwater or industrial metrology

Localization and tracking of agents for close range applications

This research investigates the state estimation problem in close-range involving multiple targets using Doppler Radar. As the main theme is based on measurements with linear sensor arrays, optimal sensor arrangements are studied for two most popular measurement technologies: Angle-of-Arrival and range based localization systems

Localization and Tracking in Wireless MIMO Systems

Ph.DDOCTOR OF PHILOSOPH

Interference Mitigation and Localization Based on Time-Frequency Analysis for Navigation Satellite Systems

Interference Mitigation and Localization Based on Time-Frequency Analysis for Navigation Satellite SystemsNowadays, the operation of global navigation satellite systems (GNSS) is imperative across a multitude of applications worldwide. The increasing reliance on accurate positioning and timing information has made more serious than ever the consequences of possible service outages in the satellite navigation systems. Among others, interference is regarded as the primary threat to their operation. Due the recent proliferation of portable interferers, notably jammers, it has now become common for GNSS receivers to endure simultaneous attacks from multiple sources of interference, which are likely spatially distributed and transmit different modulations. To the best knowledge of the author, the present dissertation is the first publication to investigate the use of the S-transform (ST) to devise countermeasures to interference. The original contributions in this context are mainly: • the formulation of a complexity-scalable ST implementable in real time as a bank of filters; • a method for characterizing and localizing multiple in-car jammers through interference snapshots that are collected by separate receivers and analysed with a clever use of the ST; • a preliminary assessment of novel methods for mitigating generic interference at the receiver end by means the ST and more computationally efficient variants of the transform. Besides GNSSs, the countermeasures to interference proposed are equivalently applicable to protect any direct-sequence spread spectrum (DS-SS) communication

Improvement of detection and tracking techniques in multistatic passive radar systems. (Mejora de técnicas de detección y seguimiento en sistemas radar pasivos multiestáticos)

Esta tesis doctoral es el resultado de una intensa actividad investigadora centrada en los sensores radar pasivos para la mejora de las capacidades de detección y seguimiento en escenarios complejos con blancos terrestres y pequeños drones. El trabajo de investigación se ha llevado a cabo en el grupo de investigación coordinado por la Dra. María Pilar Jarabo Amores, dentro del marco diferentes proyectos: IDEPAR (“Improved DEtection techniques for PAssive Radars”), MASTERSAT (“MultichAnnel paSsive radar receiver exploiting TERrestrial and SATellite Illuminators”) y KRIPTON (“A Knowledge based appRoach to passIve radar detection using wideband sPace adapTive prOcessiNg”) financiados por el Ministerio de Economía y Competitividad de España; MAPIS (Multichannel passive ISAR imaging for military applications) y JAMPAR (“JAMmer-based PAssive Radar”), financiados por la Agencia Europea de Defensa (EDA) . El objetivo principal es la mejora de las técnicas de detección y seguimiento en radares pasivos con configuraciones biestáticas y multiestaticas. En el documento se desarrollan algoritmos para el aprovechamiento de señales procedentes de distintos iluminadores de oportunidad (transmisores DVB-T, satélites DVB-S y señales GPS). Las soluciones propuestas han sido integradas en el demostrador tecnológico IDEPAR, desarrollado y actualizado bajo los proyectos mencionados, y validadas en escenarios reales declarados de interés por potenciales usuarios finales (Direccion general de armamento y material, instituto nacional de tecnología aeroespacial y la armada española). Para el desarrollo y evaluación de cadenas de las cadenas de procesado, se plantean dos casos de estudio: blancos terrestres en escenarios semiurbanos edificios y pequeños blancos aéreos en escenarios rurales y costeros. Las principales contribuciones se pueden resumir en los siguientes puntos: • Diseño de técnicas de seguimiento 2D en el espacio de trabajo rango biestático-frecuencia Doppler: se desarrollan técnicas de seguimiento para los dos casos de estudio, localización de blancos terrestres y pequeños drones. Para es último se implementan técnicas capaces de seguir tanto el movimiento del dron como su firma Doppler, lo que permite implementar técnicas de clasificación de blancos. • Diseño de técnicas de seguimiento de blancos capaces de integrar información en el espacio 3D (rango, Doppler y acimut): se diseñan técnicas basadas en procesado en dos etapas, una primera con seguimiento en 2D para el filtrado de falsas alarmas y la segunda para el seguimiento en 3D y la conversión de coordenadas a un plano local cartesiano. Se comparan soluciones basadas en filtros de Kalman para sistemas tanto lineales como no lineales. • Diseño de cadenas de procesado para sistemas multiestáticos: la información estimada del blanco sobre múltiples geometrías biestáticas es utilizada para incremento de las capacidades de localización del blanco en el plano cartesiano local. Se presentan soluciones basadas en filtros de Kalman para sistemas no lineales explotando diferentes medidas biestáticas en el proceso de transformación de coordenadas, analizando las mejoras de precisión en la localización del blanco. • Diseño de etapas de procesado para radares pasivos basados en señales satelitales de las constelaciones GPS DVB-S. Se estudian las características de las señales satelitales identificando sus inconvenientes y proponiendo cadenas de procesado que permitan su utilización para la detección y seguimiento de blancos terrestres. • Estudio del uso de señales DVB-T multicanal con gaps de transmisión entre los diferentes canales en sistemas radares pasivos. Con ello se incrementa la resolución del sistema, y las capacidades de detección, seguimiento y localización. Se estudia el modelo de señal multicanal, sus efectos sobre el procesado coherente y se proponen cadenas de procesado para paliar los efectos adversos de este tipo de señales