Vehicle detection and tracking using homography-based plane rectification and particle filtering

This paper presents a full system for vehicle detection and tracking in non-stationary settings based on computer vision. The method proposed for vehicle detection exploits the geometrical relations between the elements in the scene so that moving objects (i.e., vehicles) can be detected by analyzing motion parallax. Namely, the homography of the road plane between successive images is computed. Most remarkably, a novel probabilistic framework based on Kalman filtering is presented for reliable and accurate homography estimation. The estimated homography is used for image alignment, which in turn allows to detect the moving vehicles in the image. Tracking of vehicles is performed on the basis of a multidimensional particle filter, which also manages the exit and entries of objects. The filter involves a mixture likelihood model that allows a better adaptation of the particles to the observed measurements. The system is specially designed for highway environments, where it has been proven to yield excellent results

Homography-based ground plane detection using a single on-board camera

This study presents a robust method for ground plane detection in vision-based systems with a non-stationary camera. The proposed method is based on the reliable estimation of the homography between ground planes in successive images. This homography is computed using a feature matching approach, which in contrast to classical approaches to on-board motion estimation does not require explicit ego-motion calculation. As opposed to it, a novel homography calculation method based on a linear estimation framework is presented. This framework provides predictions of the ground plane transformation matrix that are dynamically updated with new measurements. The method is specially suited for challenging environments, in particular traffic scenarios, in which the information is scarce and the homography computed from the images is usually inaccurate or erroneous. The proposed estimation framework is able to remove erroneous measurements and to correct those that are inaccurate, hence producing a reliable homography estimate at each instant. It is based on the evaluation of the difference between the predicted and the observed transformations, measured according to the spectral norm of the associated matrix of differences. Moreover, an example is provided on how to use the information extracted from ground plane estimation to achieve object detection and tracking. The method has been successfully demonstrated for the detection of moving vehicles in traffic environments

In-Time UAV Flight-Trajectory Estimation and Tracking Using Bayesian Filters

Rapid increase of UAV operation in the next decade in areas of on-demand delivery, medical transportation services, law enforcement, traffic surveillance and several others pose potential risks to the low altitude airspace above densely populated areas. Safety assessment of airspace demands the need for a novel UAV traffic management (UTM) framework for regulation and tracking of the vehicles. Particularly for low-altitude UAV operations, quality of GPS measurements feeding into the UAV is often compromised by loss of communication link caused by presence of trees or tall buildings in proximity to the UAV flight path. Inaccurate GPS locations may yield to unreliable monitoring and inaccurate prognosis of remaining battery life and other safety metrics which rely on future expected trajectory of the UAV. This work therefore proposes a generalized monitoring and prediction methodology for autonomous UAVs using in-time GPS measurements. Firstly, a typical 4D smooth trajectory generation technique from a series of waypoint locations with associated expected times-of-arrival based on B-spline curves is presented. Initial uncertainty in the vehicle's expected cruise velocity is quantified to compute confidence intervals along the entire flight trajectory using error interval propagation approach. Further, the generated planned trajectory is considered as the prior knowledge which is updated during its flight with incoming GPS measurements in order to estimate its current location and corresponding kinematic profiles. Estimation of position is denoted in dicrete state-space representation such that position at a future time step is derived from position and velocity at current time step and expected velocity at the future time step. A linear Bayesian filtering algorithm is employed to efficiently refine position estimation from noisy GPS measurements and update the confidence intervals. Further, a dynamic re-planning strategy is implemented to incorporate unexpected detour or delay scenarios. Finally, critical challenges related to uncertainty quantification in trajectory prognosis for autonomous vehicles are identified, and potential solutions are discussed at the end of the paper. The entire monitoring framework is demonstrated on real UAV flight experiments conducted at the NASA Langley Research Center