"Forget" the Forget Gate: Estimating Anomalies in Videos using Self-contained Long Short-Term Memory Networks

Abnormal event detection is a challenging task that requires effectively handling intricate features of appearance and motion. In this paper, we present an approach of detecting anomalies in videos by learning a novel LSTM based self-contained network on normal dense optical flow. Due to their sigmoid implementations, standard LSTM's forget gate is susceptible to overlooking and dismissing relevant content in long sequence tasks like abnormality detection. The forget gate mitigates participation of previous hidden state for computation of cell state prioritizing current input. In addition, the hyperbolic tangent activation of standard LSTMs sacrifices performance when a network gets deeper. To tackle these two limitations, we introduce a bi-gated, light LSTM cell by discarding the forget gate and introducing sigmoid activation. Specifically, the LSTM architecture we come up with fully sustains content from previous hidden state thereby enabling the trained model to be robust and make context-independent decision during evaluation. Removing the forget gate results in a simplified and undemanding LSTM cell with improved performance effectiveness and computational efficiency. Empirical evaluations show that the proposed bi-gated LSTM based network outperforms various LSTM based models verifying its effectiveness for abnormality detection and generalization tasks on CUHK Avenue and UCSD datasets.Comment: 16 pages, 7 figures, Computer Graphics International (CGI) 202

Abnormal event detection via the analysis of multi-frame optical flow information

International audienceSecurity surveillance of public scene is closely relevant to routine safety of individual. Under the stimulus of this concern, abnormal event detection is becoming one of the most important tasks in computer vision and video processing. In this paper, we propose a new algorithm to address the visual abnormal detection problem. Our algorithm decouples the problem into a feature descriptor extraction process, followed by an AutoEncoder based network called cascade deep AutoEncoder (CDA). The movement information is represented by a novel descriptor capturing the multi-frame optical flow information. And then, the feature descriptor of the normal samples is fed into the CDA network for training. Finally, the abnormal samples are distinguished by the reconstruction error of the CDA in the testing procedure. We validate the proposed method on several video surveillance datasets