Explicit contour model for vehicle tracking with automatic hypothesis validation

This paper addresses the problem of vehicle tracking under a single static, uncalibrated camera without any constraints on the scene or on the motion direction of vehicles. We introduce an explicit contour model, which not only provides a good approximation to the contours of all classes of vehicles but also embeds the contour dynamics in its parameterized template. We integrate the model into a Bayesian framework with multiple cues for vehicle tracking, and evaluate the correctness of a target hypothesis, with the information implied by the shape, by monitoring any conflicts within the hypothesis of every single target as well as between the hypotheses of all targets. We evaluated the proposed method using some real sequences, and demonstrated its effectiveness in tracking vehicles, which have their shape changed significantly while moving on curly, uphills roads. © 2005 IEEE.published_or_final_versionThe IEEE International Conference on Image Processing (ICIP 2005), Genoa, Italy, 11-14 September 2005. In Proceedings of IEEE-ICIP, 2005, v. 2, p. 582-58

A real time vehicles detection algorithm for vision based sensors

A vehicle detection plays an important role in the traffic control at signalised intersections. This paper introduces a vision-based algorithm for vehicles presence recognition in detection zones. The algorithm uses linguistic variables to evaluate local attributes of an input image. The image attributes are categorised as vehicle, background or unknown features. Experimental results on complex traffic scenes show that the proposed algorithm is effective for a real-time vehicles detection.Comment: The final publication is available at http://www.springerlink.co

Vehicle Detection and Tracking Techniques: A Concise Review

Vehicle detection and tracking applications play an important role for civilian and military applications such as in highway traffic surveillance control, management and urban traffic planning. Vehicle detection process on road are used for vehicle tracking, counts, average speed of each individual vehicle, traffic analysis and vehicle categorizing objectives and may be implemented under different environments changes. In this review, we present a concise overview of image processing methods and analysis tools which used in building these previous mentioned applications that involved developing traffic surveillance systems. More precisely and in contrast with other reviews, we classified the processing methods under three categories for more clarification to explain the traffic systems

Counting and Classification of Highway Vehicles by Regression Analysis

In this paper, we describe a novel algorithm that counts and classifies highway vehicles based on regression analysis. This algorithm requires no explicit segmentation or tracking of individual vehicles, which is usually an important part of many existing algorithms. Therefore, this algorithm is particularly useful when there are severe occlusions or vehicle resolution is low, in which extracted features are highly unreliable. There are mainly two contributions in our proposed algorithm. First, a warping method is developed to detect the foreground segments that contain unclassified vehicles. The common used modeling and tracking (e.g., Kalman filtering) of individual vehicles are not required. In order to reduce vehicle distortion caused by the foreshortening effect, a nonuniform mesh grid and a projective transformation are estimated and applied during the warping process. Second, we extract a set of low-level features for each foreground segment and develop a cascaded regression approach to count and classify vehicles directly, which has not been used in the area of intelligent transportation systems. Three different regressors are designed and evaluated. Experiments show that our regression-based algorithm is accurate and robust for poor quality videos, from which many existing algorithms could fail to extract reliable features

Textile Fingerprinting for Dismount Analysis in the Visible, Near, and Shortwave Infrared Domain

The ability to accurately and quickly locate an individual, or a dismount, is useful in a variety of situations and environments. A dismount\u27s characteristics such as their gender, height, weight, build, and ethnicity could be used as discriminating factors. Hyperspectral imaging (HSI) is widely used in efforts to identify materials based on their spectral signatures. More specifically, HSI has been used for skin and clothing classification and detection. The ability to detect textiles (clothing) provides a discriminating factor that can aid in a more comprehensive detection of dismounts. This thesis demonstrates the application of several feature selection methods (i.e., support vector machines with recursive feature reduction, fast correlation based filter) in highly dimensional data collected from a spectroradiometer. The classification of the data is accomplished with the selected features and artificial neural networks. A model for uniquely identifying (fingerprinting) textiles are designed, where color and composition are determined in order to fingerprint a specific textile. An artificial neural network is created based on the knowledge of the textile\u27s color and composition, providing a uniquely identifying fingerprinting of a textile. Results show 100% accuracy for color and composition classification, and 98% accuracy for the overall textile fingerprinting process

Traffic Surveillance and Automated Data Extraction from Aerial Video Using Computer Vision, Artificial Intelligence, and Probabilistic Approaches

In transportation engineering, sufficient, reliable, and diverse traffic data is necessary for effective planning, operations, research, and professional practice. Using aerial imagery to achieve traffic surveillance and collect traffic data is one of the feasible ways that is facilitated by the advances of technologies in many related areas. A great deal of aerial imagery datasets are currently available and more datasets are collected every day for various applications. It will be beneficial to make full and efficient use of the attribute rich imagery as a resource for valid and useful traffic data for many applications in transportation research and practice. In this dissertation, a traffic surveillance system that can collect valid and useful traffic data using quality-limited aerial imagery datasets with diverse characteristics is developed. Two novel approaches, which can achieve robust and accurate performance, are proposed and implemented for this system. The first one is a computer vision-based approach, which uses convolutional neural network (CNN) to detect vehicles in aerial imagery and uses features to track those detections. This approach is capable of detecting and tracking vehicles in the aerial imagery datasets with a very limited quality. Experimental results indicate the performance of this approach is very promising and it can achieve accurate measurements for macroscopic traffic data and is also potential for reliable microscopic traffic data. The second approach is a multiple hypothesis tracking (MHT) approach with innovative kinematics and appearance models (KAM). The implemented MHT module is designed to cooperate with the CNN module in order to extend and improve the vehicle tracking system. Experiments are designed based on a meticulously established synthetic vehicle detection datasets, originally induced scale-agonistic property of MHT, and comprehensively identified metrics for performance evaluation. The experimental results not only indicate that the performance of this approach can be very promising, but also provide solutions for some long-standing problems and reveal the impacts of frame rate, detection noise, and traffic configurations as well as the effects of vehicle appearance information on the performance. The experimental results of both approaches prove the feasibility of traffic surveillance and data collection by detecting and tracking vehicles in aerial video, and indicate the direction of further research as well as solutions to achieve satisfactory performance with existing aerial imagery datasets that have very limited quality and frame rates. This traffic surveillance system has the potential to be transformational in how large area traffic data is collected in the future. Such a system will be capable of achieving wide area traffic surveillance and extracting valid and useful traffic data from wide area aerial video captured with a single platfor

Effective Step to Real-time Implementation of Accident Detection System Using Image Processing

Studies in the past have shown that number of traffic related fatalities is highly dependent on the emergency response time after the occurrence of an accident. Also traffic intersections were found to be one of the most vulnerable places for occurrence of an accident. Therefore there is a need to reduce the emergency response time by alerting the emergency response team by an automated accident detection system at traffic intersections, once an accident is detected. The goal of this project is develop an accident detection system at traffic intersections that is capable of operating in real-time with good performance rate. Therefore an accident detection system was developed which uses the vehicle parameters such as the speed and trajectory and other features such as area, orientation and position of the vehicle. Since one of the key elements in accident detection step is accurate tracking of moving vehicles, more focus was given to vehicle detection and tracking step. In this work, a tracking algorithm that uses a weighted combination of low-level features extracted from moving vehicles and low-level vision analysis on vehicle regions extracted from different frames is implemented. The speed of the tracked vehicles are calculated and along with the features extracted from the tracked vehicle, an accident detection system is designed which validates the factors cueing the occurrence of an accident. Once an accident is detected, the user is signaled about the occurrence of an accident. The detection and tracking performance of the algorithm was around 90% for two test videos used and collision detection system produced a correct detection rate of 87.5% for the test crashes simulated in the test bed setup in the laboratory. Overall the algorithm shows promise since it has a processing rate of 5frames/sec with good collision detection performance. With more test crashes and real-crashes data training, the performance of the algorithm is expected to improve.School of Electrical & Computer Engineerin

Design, Data Collection, and Driver Behavior Simulation for the Open- Mode Integrated Transportation System (OMITS)

With the remarkable increase in the population and number of vehicles, traffic has become a severe problem in most metropolitan areas. Traffic congestion has imposed tight constraints on economic growth, national security, and mobility of riders and goods. The open-mode integrated transportation system (OMITS) has been designed to improve the traffic condition of roadways by increasing the ridership of vehicles and optimizing transportation modes through smart services integrating emerging information communication technologies, big data management, social networking, and transportation management. Even a modest reduction in the number of vehicles on roadways will lead to a considerable cost savings in terms of time and money. Additionally the reduction in traffic jams will lead to a significant decrease in both gasoline consumption and greenhouse gas emissions. As a result, novel transportation management is critical to reduce vehicle mileage in the peak time of the road network. The OMITS was proposed to enhance transportation services in respect to the following three aspects: optimization of the transportation modes by multimodal traveling assignment, dynamic routing and ridesharing service with advanced traveler information systems, and interactive user interface for social networking and traveling information. Therefore, the OMITS encompasses a broad range of advanced transportation research topics, say dynamic trip- match, transportation-mode optimization, traffic prediction, dynamic routing, and social network- based carpooling. This dissertation will focus on a kernel part of the OMITS, namely traffic simulation and prediction based on data containing the distribution of vehicles and the road network configuration. A microscopic traffic simulation framework has been developed to take into account various traffic phenomena, such as traffic jams resulting from bottlenecking, incidents, and traffic flow shock waves. Four fundamental contributions of the present study are summarized as follows: Firstly, an accurate and robust vehicle trajectory data collection method based on image data of unmanned aerial vehicle (UAV) has been presented, which can be used to rapidly and accurately acquire the real-time traffic conditions of the region of interest. Historically, a lack in the availability of trajectory data has posed a significant obstacle to the enhancement of microscopic simulation models. To overcome this obstacle, a UAV based vehicle trajectory data collection algorithm has been developed. This method extracts vehicle trajectory data from the UAV’s video at different altitudes with different view scopes. Compared with traditional methods, the present data collection algorithm incorporates many unique features to customize the vehicle and traffic flow, through which vehicle detection and tracking system accuracy can be considerably increased. Secondly, an open mechanics-based acceleration model has been presented to simulate the longitudinal motion of vehicles, in which five general factors—namely the subject vehicle’s speed and acceleration sensitivity, safety consideration, relative speed sensitivity and gap reducing desire—have been identified to describe drivers’ preferences and the interactions between vehicles. Inspired by the similarity between vehicle interactions and particle interactions, a mechanical system with force elements has been introduced to quantify the vehicle’s acceleration. Accordingly, each of the aforementioned five factors are assumed to function as an individual trigger to alter each vehicle’s speed. Based on Newton’s second law of motion, the subject vehicle’s longitudinal behavior can be simulated by the present open mechanics-based acceleration model. By introducing feeling gap, multilane acceleration behavior is included in the presented model. The simulation results fit realistic conditions for the traffic flow and the road capacity very well, where traffic shockwaves can be observed for a certain range of the traffic density. This model can be extended to more general scenarios if other factors can be recognized and introduced into the modeling framework. Thirdly, a driver decision-based lane change execution model has been developed to describe a vehicle’s lane change execution process, which includes two steps, i.e. driver’s lane selection and lane change execution. Currently, most lane change models focus on the driver’s lane selection, and overlook the driver’s behavior during a process of lane change execution which plays a significant role in the simulation of traffic flow characteristics. In this model, a lane change execution is analyzed as a driver’s decision-making process, which consists of desire point setting, priority decision-making, corresponding actions and achievement of consensus analysis. Compared with the traditional lane change execution models, the present model describes a realistic lane change process, and it provides more accurate and detailed simulation results in the microscopic traffic simulation. Based on the presented open mechanics-based acceleration model and the driver decision- based lane change execution model, a reverse lane change model has further been developed to simulate some complex traffic situations such as reverse lane change process at a two-way-two- lane road section where one lane is blocked by a traffic incident. Based on this reverse lane change model, information on the average waiting time and road capability can be obtained. The simulation results show that the present model is able to reflect real driver behavior and the corresponding traffic phenomenon during a reverse lane change process Through a homogenization process of the microscopic vehicle motion, we can obtain the macroscopic traffic flow of the roadway network within certain time and spatial ranges, which will be integrated into the OMITS system for traffic prediction. The validation of the models through future OMITS operations will also enable them to be high fidelity models in future driverless technologies and autonomous vehicles