Human Detection and Tracking Using Hog Feature and Particle Filter

Video surveillance system has recently attracted much attention in various fields for monitoring and ensuring security. One of its promising applications is in crowd control to maintain the general security in public places. However, the problem of video surveillance systems is the required continuous manual monitoring especially for crime deterrence. In order to assist the security monitoring the live surveillance systems, intelligent target detection and tracking techniques can send a warning signal to the monitoring officers automatically. Towards this end, in this paper, we propose an innovative method to detect and track a target person in a crowded area using the individual’s features. In the proposed method, to realize automatic detection and tracking we combine Histogram of Oriented Gradient (HOG) feature detection with a particle filter. The HOG feature is applied for the description of contour detection for the person, while the particle filter is used for tracking the targets using skin and clothes color based features. We have developed the evaluation system implementing our proposed method. From the experimental results, we have achieved high accuracy detection rate and tracked the specific target precisely

An Automated Approach for Video Surveillance Using Kalman Filter

Image processing has played a vital role in every aspect of human life. Video surveillance has reached a major out through by the application of advanced image processing and frame modeling techniques. In video surveillance, detection of relocating objects from a video is predominant for object detection, target monitoring, and behavior. Detection of relocating objects in video streams is the first major step of the algorithm, and background subtraction is a pleasant technique for foreground segmentation. In this thesis, automatic actual-time object detection and tracking had been carried out utilizing Kalman filter the place the method output was once monitoring the input and canceling out any variants because of entry and exit noises. This work could be used to boost a surveillance procedure of static digicam and robotic automation visible systems

Metadata extraction and organization for intelligent video surveillance system

Proceedings of the IEEE International Conference on Mechatronics and Automation (ICMA), 2010, p. 489-494The research for metadata extraction originates from the intelligent video surveillance system, which is widely used in outdoor and indoor environment for the aims of traffic monitor, security guard, and intelligent robot. Various features are extracted from the surveillance image sequences such as target detection, target tracking, object's shape and activities. However, the trend of more and more features being used and shared in video surveillance system calls for more attention to bridge the gap between specific analysis algorithms and enduser's expectation. This paper proposes a three-layer object oriented model to extract the surveillance metadata including shape, motion speed, and trajectory of the object emerging in image sequence. Meanwhile, the high-level semantic metadata including entry/exit point, object duration time is organized and stored which are provided for the further end-user queries. The paper also presents the experiment results in different indoor and outdoor surveillance scenarios. At last, a comparative analysis with another traditional method is presented. © 2010 IEEE.published_or_final_versio

Key-point based tracking for illegally parked vehicle detection

This research aims to develop a target detection and tracking system that can realize real-time video surveillance. The purpose of the research is to realize a monitoring application that can run automatically and intelligently to detect and track illegally parked vehicles. Since the application scenario of the algorithm is a real traffic environment, it must be able to adapt to complex environmental interference, such as drastic changes in lighting conditions, frequent occlusion, and long-term stable tracking. The thesis shows the detailed design process and test results of the system. This algorithm combines the target detection function based on deep learning network and the multi-object tracking algorithm based on key point matching. The method shown in the thesis focuses on detecting and tracking stationary vehicles in the no parking area. An object detection algorithm based on a deep learning network is used to recognize vehicles. Once the recognized vehicle is defined as an illegally parked vehicle through the determination of its motion state and location, an algorithm based on key-point matching is developed and tracked for this type of vehicle. If the target is still stationary in the no parking area after a period, the system will generate an alarm. The method was tested in more than 20 hours of video. The video comes from public database and our own. They all show real surveillance scenes, including different time periods of the day and different locations. The test results show that the method achieves 100% in precision (also called positive predictive value), 95% in recall (also known as sensitivity) and 97% in F1 (a measure that combines precision and recall). The results obtained also produce better detection and tracking compared to other comparable methods

Trajectories clustering in ICA space: an application to automatic counting of pedestrians in video sequences

In this paper we propose a method for the automatic counting of pedestrians in video sequences for (automatic) video surveillance applications. We analyse the trajectory data set provided by a detection/tracking system. When using classical target detection and tracking systems, it is well known that the number of detected targets is overestimated/ underestimated. A better representation for the trajectories is given in the ICA (Independent Component Analysis) transformed domain and clustering techniques are applied to the ICA-transformed data in order to provide a better estimation of the actual number of pedestrians which are present on the scene

Video processing methods robust to illumination variations

Ankara : The Department of Electrical and Electronics Engineering and the Institute of Engineering and Sciences of Bilkent University, 2010.Thesis (Master's) -- Bilkent University, 2010.Includes bibliographical references leaves 43-46.Moving shadows constitute problems in various applications such as image segmentation, smoke detection and object tracking. Main cause of these problems is the misclassification of the shadow pixels as target pixels. Therefore, the use of an accurate and reliable shadow detection method is essential to realize intelligent video processing applications. In the first part of the thesis, a cepstrum based method for moving shadow detection is presented. The proposed method is tested on outdoor and indoor video sequences using well-known benchmark test sets. To show the improvements over previous approaches, quantitative metrics are introduced and comparisons based on these metrics are made. Most video processing applications require object tracking as it is the base operation for real-time implementations such as surveillance, monitoring and video compression. Therefore, accurate tracking of an object under varying scene and illumination conditions is crucial for robustness. It is well known that illumination variations on the observed scene and target are an obstacle against robust object tracking causing the tracker lose the target. In the second part of the thesis, a two dimensional (2D) cepstrum based approach is proposed to overcome this problem. Cepstral domain features extracted from the target region are introduced into the covariance tracking algorithm and it is experimentally observed that 2D-cepstrum analysis of the target region provides robustness to varying illumination conditions. Another contribution is the development of the co-difference matrix based object tracking instead of the recently introduced covariance matrix based method. One of the problems with most target tracking methods is that they do not have a well-established control mechanism for target loss which usually occur when illumination conditions suddenly change. In the final part of the thesis, a confidence interval based statistical method is developed for target loss detection. Upper and lower bound functions on the cumulative density function (cdf) of the target feature vector are estimated for a given confidence level. Whenever the estimated cdf of the detected region exceeds the bounds it means that the target is no longer tracked by the tracking algorithm. The method is applicable to most tracking algorithms using features of the target image region.Çoğun, FuatM.S

Spatial Pyramid Context-Aware Moving Object Detection and Tracking for Full Motion Video and Wide Aerial Motion Imagery

A robust and fast automatic moving object detection and tracking system is essential to characterize target object and extract spatial and temporal information for different functionalities including video surveillance systems, urban traffic monitoring and navigation, robotic. In this dissertation, I present a collaborative Spatial Pyramid Context-aware moving object detection and Tracking system. The proposed visual tracker is composed of one master tracker that usually relies on visual object features and two auxiliary trackers based on object temporal motion information that will be called dynamically to assist master tracker. SPCT utilizes image spatial context at different level to make the video tracking system resistant to occlusion, background noise and improve target localization accuracy and robustness. We chose a pre-selected seven-channel complementary features including RGB color, intensity and spatial pyramid of HoG to encode object color, shape and spatial layout information. We exploit integral histogram as building block to meet the demands of real-time performance. A novel fast algorithm is presented to accurately evaluate spatially weighted local histograms in constant time complexity using an extension of the integral histogram method. Different techniques are explored to efficiently compute integral histogram on GPU architecture and applied for fast spatio-temporal median computations and 3D face reconstruction texturing. We proposed a multi-component framework based on semantic fusion of motion information with projected building footprint map to significantly reduce the false alarm rate in urban scenes with many tall structures. The experiments on extensive VOTC2016 benchmark dataset and aerial video confirm that combining complementary tracking cues in an intelligent fusion framework enables persistent tracking for Full Motion Video and Wide Aerial Motion Imagery.Comment: PhD Dissertation (162 pages

Long-term Robust Tracking whith on Failure Recovery

This article aims at a new algorithm for tracking moving objects in the long term. We have tried to overcome some potential difficulties, first by a comparative study of the measuring methods of the difference and the similarity between the template and the source image. In the second part, an improvement of the best method allows us to follow the target in a robust way. This method also allows us to effectively overcome the problems of geometric deformation, partial occlusion and recovery after the target leaves the field of vision. The originality of our algorithm is based on a new model, which does not depend on a probabilistic process and does not require a data based detection in advance. Experimental results on several difficult video sequences have proven performance advantages over many recent trackers. The developed algorithm can be employed in several applications such as video surveillance, active vision or industrial visual servoing

Application of improved you only look once model in road traffic monitoring system

The present research focuses on developing an intelligent traffic management solution for tracking the vehicles on roads. Our proposed work focuses on a much better you only look once (YOLOv4) traffic monitoring system that uses the CSPDarknet53 architecture as its foundation. Deep-sort learning methodology for vehicle multi-target detection from traffic video is also part of our research study. We have included features like the Kalman filter, which estimates unknown objects and can track moving targets. Hungarian techniques identify the correct frame for the object. We are using enhanced object detection network design and new data augmentation techniques with YOLOv4, which ultimately aids in traffic monitoring. Until recently, object identification models could either perform quickly or draw conclusions quickly. This was a big improvement, as YOLOv4 has an astoundingly good performance for a very high frames per second (FPS). The current study is focused on developing an intelligent video surveillance-based vehicle tracking system that tracks the vehicles using a neural network, image-based tracking, and YOLOv4. Real video sequences of road traffic are used to test the effectiveness of the method that has been suggested in the research. Through simulations, it is demonstrated that the suggested technique significantly increases graphics processing unit (GPU) speed and FSP as compared to baseline algorithms

A System for the Generation of Synthetic Wide Area Aerial Surveillance Imagery

The development, benchmarking and validation of aerial Persistent Surveillance (PS) algorithms requires access to specialist Wide Area Aerial Surveillance (WAAS) datasets. Such datasets are difficult to obtain and are often extremely large both in spatial resolution and temporal duration. This paper outlines an approach to the simulation of complex urban environments and demonstrates the viability of using this approach for the generation of simulated sensor data, corresponding to the use of wide area imaging systems for surveillance and reconnaissance applications. This provides a cost-effective method to generate datasets for vehicle tracking algorithms and anomaly detection methods. The system fuses the Simulation of Urban Mobility (SUMO) traffic simulator with a MATLAB controller and an image generator to create scenes containing uninterrupted door-to-door journeys across large areas of the urban environment. This ‘pattern-of-life’ approach provides three-dimensional visual information with natural movement and traffic flows. This can then be used to provide simulated sensor measurements (e.g. visual band and infrared video imagery) and automatic access to ground-truth data for the evaluation of multi-target tracking systems