595 research outputs found
Video anomaly detection and localization by local motion based joint video representation and OCELM
Nowadays, human-based video analysis becomes increasingly exhausting due to the ubiquitous use of surveillance cameras and explosive growth of video data. This paper proposes a novel approach to detect and localize video anomalies automatically. For video feature extraction, video volumes are jointly represented by two novel local motion based video descriptors, SL-HOF and ULGP-OF. SL-HOF descriptor captures the spatial distribution information of 3D local regions’ motion in the spatio-temporal cuboid extracted from video, which can implicitly reflect the structural information of foreground and depict foreground motion more precisely than the normal HOF descriptor. To locate the video foreground more accurately, we propose a new Robust PCA based foreground localization scheme. ULGP-OF descriptor, which seamlessly combines the classic 2D texture descriptor LGP and optical flow, is proposed to describe the motion statistics of local region texture in the areas located by the foreground localization scheme. Both SL-HOF and ULGP-OF are shown to be more discriminative than existing video descriptors in anomaly detection. To model features of normal video events, we introduce the newly-emergent one-class Extreme Learning Machine (OCELM) as the data description algorithm. With a tremendous reduction in training time, OCELM can yield comparable or better performance than existing algorithms like the classic OCSVM, which makes our approach easier for model updating and more applicable to fast learning from the rapidly generated surveillance data. The proposed approach is tested on UCSD ped1, ped2 and UMN datasets, and experimental results show that our approach can achieve state-of-the-art results in both video anomaly detection and localization task.This work was supported by the National Natural Science Foundation of China (Project nos. 60970034, 61170287, 61232016)
Robust Temporally Coherent Laplacian Protrusion Segmentation of 3D Articulated Bodies
In motion analysis and understanding it is important to be able to fit a
suitable model or structure to the temporal series of observed data, in order
to describe motion patterns in a compact way, and to discriminate between them.
In an unsupervised context, i.e., no prior model of the moving object(s) is
available, such a structure has to be learned from the data in a bottom-up
fashion. In recent times, volumetric approaches in which the motion is captured
from a number of cameras and a voxel-set representation of the body is built
from the camera views, have gained ground due to attractive features such as
inherent view-invariance and robustness to occlusions. Automatic, unsupervised
segmentation of moving bodies along entire sequences, in a temporally-coherent
and robust way, has the potential to provide a means of constructing a
bottom-up model of the moving body, and track motion cues that may be later
exploited for motion classification. Spectral methods such as locally linear
embedding (LLE) can be useful in this context, as they preserve "protrusions",
i.e., high-curvature regions of the 3D volume, of articulated shapes, while
improving their separation in a lower dimensional space, making them in this
way easier to cluster. In this paper we therefore propose a spectral approach
to unsupervised and temporally-coherent body-protrusion segmentation along time
sequences. Volumetric shapes are clustered in an embedding space, clusters are
propagated in time to ensure coherence, and merged or split to accommodate
changes in the body's topology. Experiments on both synthetic and real
sequences of dense voxel-set data are shown. This supports the ability of the
proposed method to cluster body-parts consistently over time in a totally
unsupervised fashion, its robustness to sampling density and shape quality, and
its potential for bottom-up model constructionComment: 31 pages, 26 figure
UNSUPERVISED DETECTION AND LOCALIZATION OF ANOMALOUS MOTION PATTERNS IN SURVEILLANCE VIDEO
Master'sMASTER OF SCIENC
Lagrangian and inertial transport in atmospheric and chaotic flows
This thesis presents a compendium of publications related to transport studies analyzed
from the perspective of dynamical systems. The goal is to address the role that particle
properties and the flow have on the organization of trajectories and hence the transport.
To observe how transport is structured, we focus on the most widely used method: the
Finite Time Lyapunov Exponents. These exponents measure the separation rate of the particles
starting from nearby initial positions, estimating the hyperbolicity of the trajectories. This
method allows us to make a first approach to the problem, obtaining the borders or frontiers
between regions with different dynamics given a simplified vision of transport. The transport
structures related with this method, are called Lagrangian Coherent Structures.
In the first study, the Lagrangian transport in the troposphere was analyzed. The
atmospheric flow is characterized by being turbulent in a continuum of spatiotemporal scales.
Within these scales, it was observed that there are structures such as the Atmospheric Rivers
that maintain a spatial and temporal coherence of the order of days acting as organizers of water
vapor transport and therefore dominating the dynamics of the region at the moment they occur.
At the same time, the persistence and repetition of these structures, together with all the other
tropospheric structures, introduce mixing into the atmosphere. Those areas in middle latitudes
where these structures develop have higher mixing variability. This is mainly due to seasonal
changes. However, those regions with less variability, such as the equatorial zones, the mixing
and its variability on day scales, are mainly associated with inter-annual variability events such
as El Ni ˜no or La Ni ˜na or the Intertropical Convergence Zone (ITCZ). In addition, the mixing
information of the air masses from a climatic point of view, was used as a predictor of rainfall for
the Iberian region. The Atlantic margin is characterized by an intense activity of Atmospheric
Rivers, being one of the main causes of precipitation. However, the problem of determining the
activity of rainfall months in advance is complex, for this reason the use of new variables as
potential predictors is required. It has been obtained that the mixing, in the Atlantic region, is
related to the precipitation on the Iberian Peninsula.
Addressing on the second study, we focus on the influence of forces on the particles motion
so the resolution of motion equation is required to obtain the trajectories they describe. The
particles are modeled as small spheres with mass, but the fact that their movement is decoupled
from the flow makes their trajectories depend initially on other properties such as the initial
velocity. It was observed that this dependence, for certain flows, is even higher than small
perturbations in its position, mainly in those regions where there is a high spatial variability
of the fluid such as regions with shear. The same happens for bubbles where flotation effects
appear. They are very sensitive to the inertial effects and especially to the disturbances of the
radius as well as the effects of merging with other bubbles, being especially relevant in the
initial instants of the movement. In addition, it has been observed that particles properties and
their collective motion play a key role in the synchronization of finite-size chemical oscillators.
To experimentally support some of the aforementioned behaviors, experimental data are
needed to measure the trajectories of the particles. Particle Tracking Velocimetry (PTV)
methods, track the trajectories of individual particles in three-dimensional space. In the last
part of this thesis, we present an experimental setup and some preliminary results of trajectories
of the particles mentioned above in a high turbulent flow
- …