Illegal parking detection using Gaussian mixture model and kalman filter

Automatic analysis of videos for traffic monitoring has been an area of significant research in the recent past. In this paper, we proposed a system to detect and track illegal vehicle parking using Gaussian Mixture Model and Kalman Filter. i-LIDS dataset is used to test and evaluate the algorithm by comparing the results with the ground truth provided, we have tested the system using 4 full videos from i-LIDS to detect parked vehicle whiten specific area. Region of interest has been used to detect Vehicle parks in a no parking zone over sixty seconds and remains stationary.Within the scope of this work, we highlighted the components of an automated traffic surveillance system, including background modeling, foreground extraction, Kalman filter and Gaussian mixture model. © 2017 IEEE

Utilization of Robust Video Processing Techniques to Aid Efficient Object Detection and Tracking

AbstractIn this research, data acquired by Unmanned Aerial Vehicles (UAVs) are primarily used to detect and track moving objects which pose a major security threat along the United States southern border. Factors such as camera motion, poor illumination and noise make the detection and tracking of moving objects in surveillance videos a formidable task. The main objective of this research is to provide a less ambiguous image data for object detection and tracking by means of noise reduction, image enhancement, video stabilization, and illumination restoration. The improved data is later utilized to detect and track moving objects in surveillance videos. An optimization based image enhancement scheme was successfully implemented to increase edge information to facilitate object detection. Noise present in the raw video captured by the UAV was efficiently removed using search and match methodology. Undesired motion induced in the video frames was eliminated using block matching technique. Moving objects were detected and tracked by using contour information resulting from the implementation of adaptive background subtraction based detection process. Our simulation results shows the efficiency of these algorithms in processing noisy, un-stabilized raw video sequences which were utilized to detect and track moving objects in the video sequences

Key-point based tracking for illegally parked vehicle detection

This research aims to develop a target detection and tracking system that can realize real-time video surveillance. The purpose of the research is to realize a monitoring application that can run automatically and intelligently to detect and track illegally parked vehicles. Since the application scenario of the algorithm is a real traffic environment, it must be able to adapt to complex environmental interference, such as drastic changes in lighting conditions, frequent occlusion, and long-term stable tracking. The thesis shows the detailed design process and test results of the system. This algorithm combines the target detection function based on deep learning network and the multi-object tracking algorithm based on key point matching. The method shown in the thesis focuses on detecting and tracking stationary vehicles in the no parking area. An object detection algorithm based on a deep learning network is used to recognize vehicles. Once the recognized vehicle is defined as an illegally parked vehicle through the determination of its motion state and location, an algorithm based on key-point matching is developed and tracked for this type of vehicle. If the target is still stationary in the no parking area after a period, the system will generate an alarm. The method was tested in more than 20 hours of video. The video comes from public database and our own. They all show real surveillance scenes, including different time periods of the day and different locations. The test results show that the method achieves 100% in precision (also called positive predictive value), 95% in recall (also known as sensitivity) and 97% in F1 (a measure that combines precision and recall). The results obtained also produce better detection and tracking compared to other comparable methods

Framework for real time behavior interpretation from traffic video

© 2005 IEEE.Video-based surveillance systems have a wide range of applications for traffic monitoring, as they provide more information as compared to other sensors. In this paper, we present a rule-based framework for behavior and activity detection in traffic videos obtained from stationary video cameras. Moving targets are segmented from the images and tracked in real time. These are classified into different categories using a novel Bayesian network approach, which makes use of image features and image-sequence- based tracking results for robust classification. Tracking and classification results are used in a programmed context to analyze behavior. For behavior recognition, two types of interactions have mainly been considered. One is interaction between two or more mobile targets in the field of view (FoV) of the camera. The other is interaction between targets and stationary objects in the environment. The framework is based on two types of a priori information: 1) the contextual information of the camera’s FoV, in terms of the different stationary objects in the scene and 2) sets of predefined behavior scenarios, which need to be analyzed in different contexts. The system can recognize behavior from videos and give a lexical output of the detected behavior. It also is capable of handling uncertainties that arise due to errors in visual signal processing. We demonstrate successful behavior recognition results for pedestrian– vehicle interaction and vehicle–checkpost interactions.Kumar, P.; Ranganath, S.; Huang Weimin; Sengupta, K

Driver behavior classification and lateral control for automobile safety systems

Advanced driver assistance systems (ADAS) have been developed to help drivers maintain stability, improve road safety, and avoid potential collision. The data acquisition equipment that can be used to measure the state and parameter information of the vehicle may not be available for a standard passenger car due to economical and technical limitations. This work focuses on developing three technologies (longitudinal tire force estimation, driver behavior classification and lateral control) using low-cost sensors that can be utilized in ADAS. For the longitudinal tire force estimation, a low cost 1Hz positioning global system (GPS) and a steering angle sensor are used as the vehicle data acquisition equipment. A nonlinear extended two-wheel vehicle dynamic model is employed. The sideslip angle and the yaw rate are estimated by discrete Kalman Filter. A time independent piecewise optimization scheme is proposed to provide time-continuous estimates of longitude tire force, which can be transferred to the throttle/brake pedal position. The proposed method can be validated by the estimation results. Driver behavior classification systems can detect unsafe driver behavior and avoid potentially dangerous situations. To realize this strategy, a machine learning classification method, Gaussian Mixture model (GMM), is applied to classify driver behavior. In this application, a low cost 1Hz GPS receiver is considered as the vehicle data acquisition equipment instead of other more costly sensors (such as steering angle sensor, throttle/brake position sensor, and etc.). Since the driving information is limited, the nonlinear extended two-wheel vehicle dynamic model is adopted to reconstruct the driver behavior. Firstly, the sideslip angle and the yaw rate are calculated since they are not available from the GPS measurements. Secondly, a piecewise optimization scheme is proposed to reproduce the steering angle and the longitudinal force. Finally, a GMM classifier is trained to identify abnormal driver behavior. The simulation results demonstrated that the proposed scenario can detect the unsafe driver behavior effectively. The lateral control system developed in this study is a look-down reference system which uses a magnetic sensor at the front bumper to measure the front lateral displacement and a GPS to measure the vehicle\u27s heading orientation. Firstly, the steering angles can be estimated by using the data provided by the front magnetic sensor and GPS. The estimation algorithm is an observer for a new extended single-track model, in which the steering angle and its derivative are viewed as two state variables. Secondly, the road curvature is determined based on the linear relationship with respect to the steering angle. Thirdly, an accurate and real-time estimation of the vehicle\u27s lateral displacements can be accomplished according to a state observer. Finally, the closed loop controller is used as a compensator for automated steering. The proposed estimation and control algorithms are validated by simulation results. The results showed that this lateral steering control system achieved a good and robust performance for vehicles following or tracking a reference path

Context Exploitation in Data Fusion

Complex and dynamic environments constitute a challenge for existing tracking algorithms. For this reason, modern solutions are trying to utilize any available information which could help to constrain, improve or explain the measurements. So called Context Information (CI) is understood as information that surrounds an element of interest, whose knowledge may help understanding the (estimated) situation and also in reacting to that situation. However, context discovery and exploitation are still largely unexplored research topics. Until now, the context has been extensively exploited as a parameter in system and measurement models which led to the development of numerous approaches for the linear or non-linear constrained estimation and target tracking. More specifically, the spatial or static context is the most common source of the ambient information, i.e. features, utilized for recursive enhancement of the state variables either in the prediction or the measurement update of the filters. In the case of multiple model estimators, context can not only be related to the state but also to a certain mode of the filter. Common practice for multiple model scenarios is to represent states and context as a joint distribution of Gaussian mixtures. These approaches are commonly referred as the join tracking and classification. Alternatively, the usefulness of context was also demonstrated in aiding the measurement data association. Process of formulating a hypothesis, which assigns a particular measurement to the track, is traditionally governed by the empirical knowledge of the noise characteristics of sensors and operating environment, i.e. probability of detection, false alarm, clutter noise, which can be further enhanced by conditioning on context. We believe that interactions between the environment and the object could be classified into actions, activities and intents, and formed into structured graphs with contextual links translated into arcs. By learning the environment model we will be able to make prediction on the target\u2019s future actions based on its past observation. Probability of target future action could be utilized in the fusion process to adjust tracker confidence on measurements. By incorporating contextual knowledge of the environment, in the form of a likelihood function, in the filter measurement update step, we have been able to reduce uncertainties of the tracking solution and improve the consistency of the track. The promising results demonstrate that the fusion of CI brings a significant performance improvement in comparison to the regular tracking approaches

Video analytics for security systems

This study has been conducted to develop robust event detection and object tracking algorithms that can be implemented in real time video surveillance applications. The aim of the research has been to produce an automated video surveillance system that is able to detect and report potential security risks with minimum human intervention. Since the algorithms are designed to be implemented in real-life scenarios, they must be able to cope with strong illumination changes and occlusions. The thesis is divided into two major sections. The first section deals with event detection and edge based tracking while the second section describes colour measurement methods developed to track objects in crowded environments. The event detection methods presented in the thesis mainly focus on detection and tracking of objects that become stationary in the scene. Objects such as baggage left in public places or vehicles parked illegally can cause a serious security threat. A new pixel based classification technique has been developed to detect objects of this type in cluttered scenes. Once detected, edge based object descriptors are obtained and stored as templates for tracking purposes. The consistency of these descriptors is examined using an adaptive edge orientation based technique. Objects are tracked and alarm events are generated if the objects are found to be stationary in the scene after a certain period of time. To evaluate the full capabilities of the pixel based classification and adaptive edge orientation based tracking methods, the model is tested using several hours of real-life video surveillance scenarios recorded at different locations and time of day from our own and publically available databases (i-LIDS, PETS, MIT, ViSOR). The performance results demonstrate that the combination of pixel based classification and adaptive edge orientation based tracking gave over 95% success rate. The results obtained also yield better detection and tracking results when compared with the other available state of the art methods. In the second part of the thesis, colour based techniques are used to track objects in crowded video sequences in circumstances of severe occlusion. A novel Adaptive Sample Count Particle Filter (ASCPF) technique is presented that improves the performance of the standard Sample Importance Resampling Particle Filter by up to 80% in terms of computational cost. An appropriate particle range is obtained for each object and the concept of adaptive samples is introduced to keep the computational cost down. The objective is to keep the number of particles to a minimum and only to increase them up to the maximum, as and when required. Variable standard deviation values for state vector elements have been exploited to cope with heavy occlusion. The technique has been tested on different video surveillance scenarios with variable object motion, strong occlusion and change in object scale. Experimental results show that the proposed method not only tracks the object with comparable accuracy to existing particle filter techniques but is up to five times faster. Tracking objects in a multi camera environment is discussed in the final part of the thesis. The ASCPF technique is deployed within a multi-camera environment to track objects across different camera views. Such environments can pose difficult challenges such as changes in object scale and colour features as the objects move from one camera view to another. Variable standard deviation values of the ASCPF have been utilized in order to cope with sudden colour and scale changes. As the object moves from one scene to another, the number of particles, together with the spread value, is increased to a maximum to reduce any effects of scale and colour change. Promising results are obtained when the ASCPF technique is tested on live feeds from four different camera views. It was found that not only did the ASCPF method result in the successful tracking of the moving object across different views but also maintained the real time frame rate due to its reduced computational cost thus indicating that the method is a potential practical solution for multi camera tracking applications