Video Processing Techniques for Traffic Information Acquisition Using Uncontrolled Video Streams

This paper reports on the first steps taken in search of a solution that uses public video streams available on the Internet to address the increasing need for monitoring transportation networks with the intent of returning added value to the community, either by allowing a better understanding of the network and its needs or by feeding applications with real-time information for various purposes, such as simulation, decision-making support and updated route guidance. After the introduction of the field, we present our findings from a survey that briefly describes several works with related studies and explain the algorithms that can be adopted to get relevant information from video streams. This is followed by an analysis of the issues that may arise and the best ways to address them. Next it reports on the results achieved so far, draws some conclusions on what has been done and suggests the next steps of our research

Video Processing Techniques for Traffic Information Acquisition Using Uncontrolled Video Streams

This paper reports on the first steps taken in search of a solution that uses public video streams available on the Internet to address the increasing need for monitoring transportation networks with the intent of returning added value to the community, either by allowing a better understanding of the network and its needs or by feeding applications with real-time information for various purposes, such as simulation, decision-making support and updated route guidance. After the introduction of the field, we present our findings from a survey that briefly describes several works with related studies and explain the algorithms that can be adopted to get relevant information from video streams. This is followed by an analysis of the issues that may arise and the best ways to address them. Next it reports on the results achieved so far, draws some conclusions on what has been done and suggests the next steps of our research

Systematic Parameter Optimization and Application of Automated Tracking in Pedestrian-Dominant Situations

RÉSUMÉ Les mouvements des piétons et leur modélisation constituent un domaine de recherche de plus en plus actif. Bien qu’encore souvent appliqué à la sécurité par l’élaboration de plans d’évacuation en cas d’urgence, comprendre le mouvement des piétons est un enjeu économique de plus en plus important, notamment pour améliorer l’efficacité des aménagements de transport et des grands centres commerciaux. Cependant, les données existantes — particulièrement au niveau individuel, ou microscopique —sont majoritairement collectées dans des situations expérimentales contrôlées. Elles ne sont donc pas nécessairement représentatives du comportement des piétons dans des situations réelles, particulièrement en tenant compte de la susceptibilité de leur comportement aux facteurs démographiques, psychologiques et nvironnementaux. Cette lacune est due principalement à l’absence de méthodes prouvées pour la détection et le suivi de piétons dans des cas réels, absence qui résulte de la complexité des mouvements piétons et qui persiste malgré l’avancement continu des méthodes automatique d’analyse.----------ABSTRACT Though a wealth of data exists for the characterization of pedestrian movement, a majority of it originates from experimental settings owing to the current state of trackers for real-world scenarios. While these trackers are steadily improving, they remain insufficiently reliable for the accurate, microscopic tracking of individuals, particularly in cases of occlusion or higher density, complex scenes. In this work, the use of evolution algorithms is proposed for the systematic calibration of the parameters of existing trackers in order to further optimize their performance – evaluated by tracking accuracy and precision metrics – in complex cases, with an initial focus on two tracking methods designed for multimodal analysis. This calibration is further aided by the inclusion of additional parameters regulating homography, or specifically the plane to which tracker detections are projected. Three real test cases were used: a) a confined corridor in a public building, b) a subway station entrance during morning rush hour and c) a crosswalk in downtown New York. Results demonstrate a halving of tracking errors over both default and manually-calibrated parameters, as well as a strong correlation in performance between similar cases. These results were consistent over multiple trials and regardless of the starting parameters, strongly implying that the obtained solutions are indeed the global maxima for each scene. For application and validation of the resultant tracks, flow characterization and directional counting are demonstrated, utilizing tools included in the optimization framework

Vision-Based Intersection Monitoring: Behavior Analysis & Safety Issues

The main objective of my dissertation is to provide a vision-based system to automatically understands traffic patterns and analyze intersections. The system leverages the existing traffic cameras to provide safety and behavior analysis of intersection participants including behavior and safety. The first step is to provide a robust detection and tracking system for vehicles and pedestrians of intersection videos. The appearance and motion based detectors are evaluated on test videos and public available datasets are prepared and evaluated. The contextual fusion method is proposed for detecting pedestrians and motion-based technique is proposed for vehicles based on evaluation results. The detections are feed to the tracking system which uses the mutual cooperation of bipartite graph and enhance optical flow. The enhanced optical flow tracker handles the partial occlusion problem, and it cooperates with the detection module to provide long-term tracks of vehicles and pedestrians. The system evaluation shows 13% and 43% improvement in tracking of vehicles and pedestrians respectively when both participants are addressed by the proposed framework. Finally, trajectories are assessed to provide a comprehensive analysis of safety and behavior of intersection participants including vehicles and pedestrians. Different important applications are addressed such as turning movement count, pedestrians crossing count, turning speed, waiting time, queue length, and surrogate safety measurements. The contribution of the proposed methods are shown through the comparison with ground truths for each mentioned application, and finally heat-maps show benefits of using the proposed system through the visual depiction of intersection usage

Real-time spatial modeling to detect and track resources on construction sites

For more than 10 years the U.S. construction industry has experienced over 1,000 fatalities annually. Many fatalities may have been prevented had the individuals and equipment involved been more aware of and alert to the physical state of the environment around them. Awareness may be improved by automatic 3D (three-dimensional) sensing and modeling of the job site environment in real-time. Existing 3D modeling approaches based on range scanning techniques are capable of modeling static objects only, and thus cannot model in real-time dynamic objects in an environment comprised of moving humans, equipment, and materials. Emerging prototype 3D video range cameras offer another alternative by facilitating affordable, wide field of view, automated static and dynamic object detection and tracking at frame rates better than 1Hz (real-time). This dissertation presents an imperical work and methodology to rapidly create a spatial model of construction sites and in particular to detect, model, and track the position, dimension, direction, and velocity of static and moving project resources in real-time, based on range data obtained from a three-dimensional video range camera in a static or moving position. Existing construction site 3D modeling approaches based on optical range sensing technologies (laser scanners, rangefinders, etc.) and 3D modeling approaches (dense, sparse, etc.) that offered potential solutions for this research are reviewed. The choice of an emerging sensing tool and preliminary experiments with this prototype sensing technology are discussed. These findings led to the development of a range data processing algorithm based on three-dimensional occupancy grids which is demonstrated in detail. Testing and validation of the proposed algorithms have been conducted to quantify the performance of sensor and algorithm through extensive experimentation involving static and moving objects. Experiments in indoor laboratory and outdoor construction environments have been conducted with construction resources such as humans, equipment, materials, or structures to verify the accuracy of the occupancy grid modeling approach. Results show that modeling objects and measuring their position, dimension, direction, and speed had an accuracy level compatible to the requirements of active safety features for construction. Results demonstrate that video rate 3D data acquisition and analysis of construction environments can support effective detection, tracking, and convex hull modeling of objects. Exploiting rapidly generated three-dimensional models for improved visualization, communications, and process control has inherent value, broad application, and potential impact, e.g. as-built vs. as-planned comparison, condition assessment, maintenance, operations, and construction activities control. In combination with effective management practices, this sensing approach has the potential to assist equipment operators to avoid incidents that result in reduce human injury, death, or collateral damage on construction sites.Civil, Architectural, and Environmental Engineerin

Gaussian mixture model classifiers for detection and tracking in UAV video streams.

Masters Degree. University of KwaZulu-Natal, Durban.Manual visual surveillance systems are subject to a high degree of human-error and operator fatigue. The automation of such systems often employs detectors, trackers and classifiers as fundamental building blocks. Detection, tracking and classification are especially useful and challenging in Unmanned Aerial Vehicle (UAV) based surveillance systems. Previous solutions have addressed challenges via complex classification methods. This dissertation proposes less complex Gaussian Mixture Model (GMM) based classifiers that can simplify the process; where data is represented as a reduced set of model parameters, and classification is performed in the low dimensionality parameter-space. The specification and adoption of GMM based classifiers on the UAV visual tracking feature space formed the principal contribution of the work. This methodology can be generalised to other feature spaces. This dissertation presents two main contributions in the form of submissions to ISI accredited journals. In the first paper, objectives are demonstrated with a vehicle detector incorporating a two stage GMM classifier, applied to a single feature space, namely Histogram of Oriented Gradients (HoG). While the second paper demonstrates objectives with a vehicle tracker using colour histograms (in RGB and HSV), with Gaussian Mixture Model (GMM) classifiers and a Kalman filter. The proposed works are comparable to related works with testing performed on benchmark datasets. In the tracking domain for such platforms, tracking alone is insufficient. Adaptive detection and classification can assist in search space reduction, building of knowledge priors and improved target representations. Results show that the proposed approach improves performance and robustness. Findings also indicate potential further enhancements such as a multi-mode tracker with global and local tracking based on a combination of both papers

Team MIT Urban Challenge Technical Report

This technical report describes Team MITs approach to theDARPA Urban Challenge. We have developed a novel strategy forusing many inexpensive sensors, mounted on the vehicle periphery,and calibrated with a new cross-­modal calibrationtechnique. Lidar, camera, and radar data streams are processedusing an innovative, locally smooth state representation thatprovides robust perception for real­ time autonomous control. Aresilient planning and control architecture has been developedfor driving in traffic, comprised of an innovative combination ofwell­proven algorithms for mission planning, situationalplanning, situational interpretation, and trajectory control. These innovations are being incorporated in two new roboticvehicles equipped for autonomous driving in urban environments,with extensive testing on a DARPA site visit course. Experimentalresults demonstrate all basic navigation and some basic trafficbehaviors, including unoccupied autonomous driving, lanefollowing using pure-­pursuit control and our local frameperception strategy, obstacle avoidance using kino-­dynamic RRTpath planning, U-­turns, and precedence evaluation amongst othercars at intersections using our situational interpreter. We areworking to extend these approaches to advanced navigation andtraffic scenarios

Infrastructure Enabled Autonomy Acting as an Intelligent Transportation System for Autonomous Cars

Autonomous cars have the ability to increase safety, efficiency, and speed of travel. Yet many see a point at which stand-alone autonomous agents populate an area too densely, creating increased risk - particularly when each agent is operating and making decisions on its own and in its own self-interest. The problem at hand then becomes how to best implement and scale this new technology and structure in such a way that it can keep pace with a rapidly changing world, benefitting not just individuals, but societies. This research approaches the challenge by developing an intelligent transportation system that relies on an infrastructure. The solution lies in the removal of sensing and high computational tasks from the vehicles, allowing static ground stations with multi sensor-sensing packs to sense the surrounding environment and direct the vehicles safely from start to goal. On a high level, the Infrastructure Enabled Autonomy system (IEA) uses less hardware, bandwidth, energy, and money to maintain a controlled environment for a vehicle to operate when in highly congested environments. Through the development of background detection algorithms, this research has shown the advantage of static MSSPs analyzing the same environment over time, and carrying an increased reliability from fewer unknowns about the area of interest. It was determined through testing that wireless commands can sufficiently operate a vehicle in a limited agent environment, and do not bottleneck the system. The horizontal trial outcome illustrated that a switching MSSP state of the IEA system showed similar loop time, but a greatly increased standard deviation. However, after performing a t-test with a 95 percent confidence interval, the static and switching MSSP state trials were not significantly different. The final testing quantified the cross track error. For a straight path, the vehicle being controlled by the IEA system had a cross track error less than 12 centimeters, meaning between the controller, network lag, and pixel error, the system was robust enough to generate stable control of the vehicle with minimal error