Assessment of Automated Crowd Behaviour Analysis Based on Optical Flow

In visual surveillance, camera streams are often used to keep an eye on dense crowds. The examination of this data is mostly done manually by observers. When analysing multiple cameras some assistance is desirable. Computer vision methods can be used to assist observers in detecting crowd behaviours. Methods based on optical flow are particularly interesting since they can examine high density crowds with cluttering and (partial) occlusion without increasing computing costs. Not many methods can detect specific behaviour of dense crowds without the need of a learning stage. One promising method by Solmaz et al. uses the Jacobian stability of the optical flow field in the scene to detect five behaviour patterns viz. blocking, bottlenecks, fountainheads, rings and lanes. The method is implemented and a demo program is written with which experiments are performed on several datasets. The detection of three out of five behaviour patterns turn out to be promising, for the latter two improvements are proposed

Fast Fight Detection

Action recognition has become a hot topic within computer vision. However, the action recognition community has focused mainly on relatively simple actions like clapping, walking, jogging, etc. The detection of specific events with direct practical use such as fights or in general aggressive behavior has been comparatively less studied. Such capability may be extremely useful in some video surveillance scenarios like prisons, psychiatric centers or even embedded in camera phones. As a consequence, there is growing interest in developing violence detection algorithms. Recent work considered the well-known Bag-of-Words framework for the specific problem of fight detection. Under this framework, spatio-temporal features are extracted from the video sequences and used for classification. Despite encouraging results in which high accuracy rates were achieved, the computational cost of extracting such features is prohibitive for practical applications. This work proposes a novel method to detect violence sequences. Features extracted from motion blobs are used to discriminate fight and non-fight sequences. Although the method is outperformed in accuracy by state of the art, it has a significantly faster computation time thus making it amenable for real-time applications

Real-time crowd density mapping using a novel sensory fusion model of infrared and visual systems

Crowd dynamic management research has seen significant attention in recent years in research and industry in an attempt to improve safety level and management of large scale events and in large public places such as stadiums, theatres, railway stations, subways and other places where high flow of people at high densities is expected. Failure to detect the crowd behaviour at the right time could lead to unnecessary injuries and fatalities. Over the past decades there have been many incidents of crowd which caused major injuries and fatalities and lead to physical damages. Examples of crowd disasters occurred in past decades include the tragedy of Hillsborough football stadium at Sheffield where at least 93 football supporters have been killed and 400 injured in 1989 in Britain's worst-ever sporting disaster (BBC, 1989). Recently in Cambodia a pedestrians stampede during the Water Festival celebration resulted in 345 deaths and 400 injuries (BBC, 2010) and in 2011 at least 16 people were killed and 50 others were injured in a stampede in the northern Indian town of Haridwar (BBC, 2011). Such disasters could be avoided or losses reduced by using different technologies. Crowd simulation models have been found effective in the prediction of potential crowd hazards in critical situations and thus help in reducing fatalities. However, there is a need to combine the advancement in simulation with real time crowd characterisation such as the estimation of real time density in order to provide accurate prognosis in crowd behaviour and enhance crowd management and safety, particularly in mega event such as the Hajj. This paper addresses the use of novel sensory technology in order to estimate people’s dynamic density du ring one of the Hajj activities. The ultimate goal is that real time accurate estimation of density in different areas within the crowd could help to improve the decision making process and provide more accurate prediction of the crowd dynamics. This paper investigates the use of infrared and visual cameras supported by auxiliary sensors and artificial intelligence to evaluate the accuracy in estimating crowd density in an open space during Muslims Pilgrimage to Makkah (Mecca)

Detection of abandoned objects in crowded environments

With concerns about terrorism and global security on the rise, it has become vital to have in place efficient threat detection systems that will identify potentially dangerous situations, and alert the authorities to take appropriate action. Of particular relevance is the case of abandoned objects in highly crowded areas. This thesis describes a general framework that recognizes the event of someone leaving an object unattended in forbidden areas. Our approach involves the recognition of four sub-events that characterize the activity of interest. When an unaccompanied object is found, the system analyzes its history to determine its most likely owner(s). Through subsequent frames, the system keeps a lookout for the owner, whose presence in or disappearance from the scene defines the status of the object and determines the appropriate course of action. The system was successfully implemented and tested on several standardized datasets.Electrical and Computer Engineerin

Handgun detection using combined human pose and weapon appearance

Closed-circuit television (CCTV) systems are essential nowadays to prevent security threats or dangerous situations, in which early detection is crucial. Novel deep learning-based methods have allowed to develop automatic weapon detectors with promising results. However, these approaches are mainly based on visual weapon appearance only. For handguns, body pose may be a useful cue, especially in cases where the gun is barely visible. In this work, a novel method is proposed to combine, in a single architecture, both weapon appearance and human pose information. First, pose keypoints are estimated to extract hand regions and generate binary pose images, which are the model inputs. Then, each input is processed in different subnetworks and combined to produce the handgun bounding box. Results obtained show that the combined model improves the handgun detection state of the art, achieving from 4.23 to 18.9 AP points more than the best previous approach.Comment: 17 pages, 18 figure

Human Motion Trajectory Prediction: A Survey

With growing numbers of intelligent autonomous systems in human environments, the ability of such systems to perceive, understand and anticipate human behavior becomes increasingly important. Specifically, predicting future positions of dynamic agents and planning considering such predictions are key tasks for self-driving vehicles, service robots and advanced surveillance systems. This paper provides a survey of human motion trajectory prediction. We review, analyze and structure a large selection of work from different communities and propose a taxonomy that categorizes existing methods based on the motion modeling approach and level of contextual information used. We provide an overview of the existing datasets and performance metrics. We discuss limitations of the state of the art and outline directions for further research.Comment: Submitted to the International Journal of Robotics Research (IJRR), 37 page

Application of invariant moments for crowd analysis

The advancement in technology such as the use of CCTV has improved the effects of monitoring crowds. However, the drawback of using CCTV is that the observer might miss some information because monitoring crowds through CCTV system is very laborious and cannot be performed for all the cameras simultaneously. Hence, integrating the image processing techniques into the CCTV surveillance system could give numerous key advantages, and is in fact the only way to deploy effective and affordable intelligent video security systems. Meanwhile, in monitoring crowds, this approach may provide an automated crowd analysis which may also help to improve the prevention of incidents and accelerate action triggering. One of the image processing techniques which might be appropriate is moment invariants. The moments for an individual object have been used widely and successfully in lots of application such as pattern recognition, object identification or image reconstruction. However, until now, moments have not been widely used for a group of objects, such as crowds. A new method Translation Invariant Orthonormal Chebyshev Moments has been proposed. It has been used to estimate crowd density, and compared with two other methods, the Grey Level Dependency Matrix and Minkowski Fractal Dimension. The extracted features are classified into a range of density by using a Self Organizing Map. A comparison of the classification results is done to determine which method gives the best performance for measuring crowd density by vision. The Grey Level Dependency Matrix gives slightly better performance than the Translation Invariant Orthonormal Chebyshev Moments. However, the latter requires less computational resources