Real-time vehicle speed estimation using Unmanned Aerial Vehicles for traffic surveillance

Drones are an emerging tool for traffic surveillance; however, they inherently lack the capability to solely obtain vehicle speed on the road. This Bachelor's thesis presents the design, implementation and study of a system to detect the position, velocity and type of vehicles using the video stream obtained from drones. The solution is created to be used with any kind of aerial vehicle but is tailored for the drones in the European project LABYRINTH, of which the thesis has been a part. The tool utilizes the video feed from a sole camera and the telemetry data from the drone to detect, track and project the objects present on the road from the image into reality. This allows for an estimation of their position and speed. The detection and tracking algorithm implemented is the Simple Online Real Time algorithm, which is often referred to as SORT. Once the position has been acquired, another stream is generated that displays the same video, but with the bounding boxes, velocity and confidence ratings of all identified vehicles, with an overall computing time lower than the frame rate. After implementation, the tool underwent testing in a simulated environment to determine its assets and shortcomings, and was used during the LABYRINTH traffic monitoring flight tests. The Bachelor's thesis achieves the aimed objectives with minimum resource utilization, using readily available logic and open-source software to strike an optimal balance between real-time functionality and precise detection of vehicle position.Outgoin

Real-time Vehicle Speed Estimation using Unmanned Aerial Vehicles for Traffic Surveillance

Drones are an emerging tool for traffic surveillance; however, they inherently lack the capability to solely obtain vehicle speed on the road. This Bachelor’s thesis presents the design, implementation and study of a system to detect the position, velocity and type of vehicles using the video stream obtained from drones. The solution is created to be used with any kind of aerial vehicle but is tailored for the drones in the European project LABYRINTH, of which the thesis has been a part. The tool utilizes the video feed from a sole camera and the telemetry data from the drone to detect, track and project the objects present on the road from the image into reality. This allows for an estimation of their position and speed. The detection and tracking algorithm implemented is the Simple Online Real Time algorithm, which is often referred to as SORT. Once the position has been acquired, another stream is generated that displays the same video, but with the bounding boxes, velocity and confidence ratings of all identified vehicles, with an overall computing time lower than the frame rate. After implementation, the tool underwent testing in a simulated environment to determine its assets and shortcomings, and was used during the LABYRINTH traffic monitoring flight tests. The Bachelor’s thesis achieves the aimed objectives with minimum resource utilization, using readily available logic and open-source software to strike an optimal balance between real-time functionality and precise detection of vehicle position

RADAR Based Collision Avoidance for Unmanned Aircraft Systems

Unmanned Aircraft Systems (UAS) have become increasingly prevalent and will represent an increasing percentage of all aviation. These unmanned aircraft are available in a wide range of sizes and capabilities and can be used for a multitude of civilian and military applications. However, as the number of UAS increases so does the risk of mid-air collisions involving unmanned aircraft. This dissertation aims present one possible solution for addressing the mid-air collision problem in addition to increasing the levels of autonomy of UAS beyond waypoint navigation to include preemptive sensor-based collision avoidance. The presented research goes beyond the current state of the art by demonstrating the feasibility and providing an example of a scalable, self-contained, RADAR-based, collision avoidance system. The technology described herein can be made suitable for use on a miniature (Maximum Takeoff Weight \u3c 10kg) UAS platform. This is of paramount importance as the miniature UAS field has the lowest barriers to entry (acquisition and operating costs) and consequently represents the most rapidly increasing class of UAS

Target detection, tracking, and localization using multi-spectral image fusion and RF Doppler differentials

It is critical for defense and security applications to have a high probability of detection and low false alarm rate while operating over a wide variety of conditions. Sensor fusion, which is the the process of combining data from two or more sensors, has been utilized to improve the performance of a system by exploiting the strengths of each sensor. This dissertation presents algorithms to fuse multi-sensor data that improves system performance by increasing detection rates, lowering false alarms, and improving track performance. Furthermore, this dissertation presents a framework for comparing algorithm error for image registration which is a critical pre-processing step for multi-spectral image fusion. First, I present an algorithm to improve detection and tracking performance for moving targets in a cluttered urban environment by fusing foreground maps from multi-spectral imagery. Most research in image fusion consider visible and long-wave infrared bands; I examine these bands along with near infrared and mid-wave infrared. To localize and track a particular target of interest, I present an algorithm to fuse output from the multi-spectral image tracker with a constellation of RF sensors measuring a specific cellular emanation. The fusion algorithm matches the Doppler differential from the RF sensors with the theoretical Doppler Differential of the video tracker output by selecting the sensor pair that minimizes the absolute difference or root-mean-square difference. Finally, a framework to quantify shift-estimation error for both area- and feature-based algorithms is presented. By exploiting synthetically generated visible and long-wave infrared imagery, error metrics are computed and compared for a number of area- and feature-based shift estimation algorithms. A number of key results are presented in this dissertation. The multi-spectral image tracker improves the location accuracy of the algorithm while improving the detection rate and lowering false alarms for most spectral bands. All 12 moving targets were tracked through the video sequence with only one lost track that was later recovered. Targets from the multi-spectral tracking algorithm were correctly associated with their corresponding cellular emanation for all targets at lower measurement uncertainty using the root-mean-square difference while also having a high confidence ratio for selecting the true target from background targets. For the area-based algorithms and the synthetic air-field image pair, the DFT and ECC algorithms produces sub-pixel shift-estimation error in regions such as shadows and high contrast painted line regions. The edge orientation feature descriptors increase the number of sub-field estimates while improving the shift-estimation error compared to the Lowe descriptor

Five Facets of 6G: Research Challenges and Opportunities

Whilst the fifth-generation (5G) systems are being rolled out across the globe, researchers have turned their attention to the exploration of radical next-generation solutions. At this early evolutionary stage we survey five main research facets of this field, namely {\em Facet~1: next-generation architectures, spectrum and services, Facet~2: next-generation networking, Facet~3: Internet of Things (IoT), Facet~4: wireless positioning and sensing, as well as Facet~5: applications of deep learning in 6G networks.} In this paper, we have provided a critical appraisal of the literature of promising techniques ranging from the associated architectures, networking, applications as well as designs. We have portrayed a plethora of heterogeneous architectures relying on cooperative hybrid networks supported by diverse access and transmission mechanisms. The vulnerabilities of these techniques are also addressed and carefully considered for highlighting the most of promising future research directions. Additionally, we have listed a rich suite of learning-driven optimization techniques. We conclude by observing the evolutionary paradigm-shift that has taken place from pure single-component bandwidth-efficiency, power-efficiency or delay-optimization towards multi-component designs, as exemplified by the twin-component ultra-reliable low-latency mode of the 5G system. We advocate a further evolutionary step towards multi-component Pareto optimization, which requires the exploration of the entire Pareto front of all optiomal solutions, where none of the components of the objective function may be improved without degrading at least one of the other components

A Comprehensive Overview on 5G-and-Beyond Networks with UAVs: From Communications to Sensing and Intelligence

Due to the advancements in cellular technologies and the dense deployment of cellular infrastructure, integrating unmanned aerial vehicles (UAVs) into the fifth-generation (5G) and beyond cellular networks is a promising solution to achieve safe UAV operation as well as enabling diversified applications with mission-specific payload data delivery. In particular, 5G networks need to support three typical usage scenarios, namely, enhanced mobile broadband (eMBB), ultra-reliable low-latency communications (URLLC), and massive machine-type communications (mMTC). On the one hand, UAVs can be leveraged as cost-effective aerial platforms to provide ground users with enhanced communication services by exploiting their high cruising altitude and controllable maneuverability in three-dimensional (3D) space. On the other hand, providing such communication services simultaneously for both UAV and ground users poses new challenges due to the need for ubiquitous 3D signal coverage as well as the strong air-ground network interference. Besides the requirement of high-performance wireless communications, the ability to support effective and efficient sensing as well as network intelligence is also essential for 5G-and-beyond 3D heterogeneous wireless networks with coexisting aerial and ground users. In this paper, we provide a comprehensive overview of the latest research efforts on integrating UAVs into cellular networks, with an emphasis on how to exploit advanced techniques (e.g., intelligent reflecting surface, short packet transmission, energy harvesting, joint communication and radar sensing, and edge intelligence) to meet the diversified service requirements of next-generation wireless systems. Moreover, we highlight important directions for further investigation in future work.Comment: Accepted by IEEE JSA

Current Safety Nets Within the U.S. National Airspace System

There are over 70,000 flights managed per day in the National Airspace System, with approximately 7,000 aircraft in the air over the United States at any given time. Operators of each of these flights would prefer to fly a user-defined 4D trajectory (4DT), which includes arrival and departure times; preferred gates and runways at the airport; efficient, wind-optimal routes for departure, cruise and arrival phase of flight; and fuel efficient altitude profiles. To demonstrate the magnitude of this achievement a single flight from Los Angeles to Baltimore, accesses over 35 shared or constrained resources that are managed by roughly 30 air traffic controllers (at towers, approach control and en route sectors); along with traffic managers at 12 facilities, using over 22 different, independent automation system (including TBFM, ERAM, STARS, ASDE-X, FSM, TSD, GPWS, TCAS, etc.). In addition, dispatchers, ramp controllers and others utilize even more systems to manage each flights access to operator-managed resources. Flying an ideal 4DT requires successful coordination of all flight constraints among all flights, facilities, operators, pilots and controllers. Additionally, when conditions in the NAS change, the trajectories of one or more aircraft may need to be revised to avoid loss of flight efficiency, predictability, separation or system throughput. The Aviation Safety Network has released the 2016 airliner accident statistics showing a very low total of 19 fatal airliner accidents, resulting in 325 fatalities1. Despite several high profile accidents, the year 2016 turned out to be a very safe year for commercial aviation, Aviation Safety Network data show. Over the year 2016 the Aviation Safety Network recorded a total of 19 fatal airliner accidents [1], resulting in 325 fatalities. This makes 2016 the second safest year ever, both by number of fatal accidents as well as in terms of fatalities. In 2015 ASN recorded 16 accidents while in 2013 a total of 265 lives were lost. How can we keep it that way and not upset the apple cart by premature insertion of innovative technologies, functions, and procedures? In aviation, safety nets function as the last system defense against incidents and accidents. Current ground-based and airborne safety nets are well established and development to make them more efficient and reliable continues. Additionally, future air traffic control safety nets may emerge from new operational concepts

Improvement of detection and tracking techniques in multistatic passive radar systems. (Mejora de técnicas de detección y seguimiento en sistemas radar pasivos multiestáticos)

Esta tesis doctoral es el resultado de una intensa actividad investigadora centrada en los sensores radar pasivos para la mejora de las capacidades de detección y seguimiento en escenarios complejos con blancos terrestres y pequeños drones. El trabajo de investigación se ha llevado a cabo en el grupo de investigación coordinado por la Dra. María Pilar Jarabo Amores, dentro del marco diferentes proyectos: IDEPAR (“Improved DEtection techniques for PAssive Radars”), MASTERSAT (“MultichAnnel paSsive radar receiver exploiting TERrestrial and SATellite Illuminators”) y KRIPTON (“A Knowledge based appRoach to passIve radar detection using wideband sPace adapTive prOcessiNg”) financiados por el Ministerio de Economía y Competitividad de España; MAPIS (Multichannel passive ISAR imaging for military applications) y JAMPAR (“JAMmer-based PAssive Radar”), financiados por la Agencia Europea de Defensa (EDA) . El objetivo principal es la mejora de las técnicas de detección y seguimiento en radares pasivos con configuraciones biestáticas y multiestaticas. En el documento se desarrollan algoritmos para el aprovechamiento de señales procedentes de distintos iluminadores de oportunidad (transmisores DVB-T, satélites DVB-S y señales GPS). Las soluciones propuestas han sido integradas en el demostrador tecnológico IDEPAR, desarrollado y actualizado bajo los proyectos mencionados, y validadas en escenarios reales declarados de interés por potenciales usuarios finales (Direccion general de armamento y material, instituto nacional de tecnología aeroespacial y la armada española). Para el desarrollo y evaluación de cadenas de las cadenas de procesado, se plantean dos casos de estudio: blancos terrestres en escenarios semiurbanos edificios y pequeños blancos aéreos en escenarios rurales y costeros. Las principales contribuciones se pueden resumir en los siguientes puntos: • Diseño de técnicas de seguimiento 2D en el espacio de trabajo rango biestático-frecuencia Doppler: se desarrollan técnicas de seguimiento para los dos casos de estudio, localización de blancos terrestres y pequeños drones. Para es último se implementan técnicas capaces de seguir tanto el movimiento del dron como su firma Doppler, lo que permite implementar técnicas de clasificación de blancos. • Diseño de técnicas de seguimiento de blancos capaces de integrar información en el espacio 3D (rango, Doppler y acimut): se diseñan técnicas basadas en procesado en dos etapas, una primera con seguimiento en 2D para el filtrado de falsas alarmas y la segunda para el seguimiento en 3D y la conversión de coordenadas a un plano local cartesiano. Se comparan soluciones basadas en filtros de Kalman para sistemas tanto lineales como no lineales. • Diseño de cadenas de procesado para sistemas multiestáticos: la información estimada del blanco sobre múltiples geometrías biestáticas es utilizada para incremento de las capacidades de localización del blanco en el plano cartesiano local. Se presentan soluciones basadas en filtros de Kalman para sistemas no lineales explotando diferentes medidas biestáticas en el proceso de transformación de coordenadas, analizando las mejoras de precisión en la localización del blanco. • Diseño de etapas de procesado para radares pasivos basados en señales satelitales de las constelaciones GPS DVB-S. Se estudian las características de las señales satelitales identificando sus inconvenientes y proponiendo cadenas de procesado que permitan su utilización para la detección y seguimiento de blancos terrestres. • Estudio del uso de señales DVB-T multicanal con gaps de transmisión entre los diferentes canales en sistemas radares pasivos. Con ello se incrementa la resolución del sistema, y las capacidades de detección, seguimiento y localización. Se estudia el modelo de señal multicanal, sus efectos sobre el procesado coherente y se proponen cadenas de procesado para paliar los efectos adversos de este tipo de señales