87 research outputs found
Graph-based topic models for trajectory clustering in crowd videos
Probabilistic topic modelings, such as latent Dirichlet allocation (LDA) and correlated topic models (CTM), have recently emerged as powerful statistical tools for processing video content. They share an important property, i.e., using a common set of topics to model all data. However such property can be too restrictive for modeling
complex visual data such as crowd scenes where multiple fields of heterogeneous data jointly provide rich information about objects and events. This paper proposes graph-based extensions of LDA and CTM, referred to as GLDA and GCTM, to learn and analyze motion patterns by trajectory clustering in a highly cluttered and crowded environment. Unlike previous works that relied on a scene prior, we apply a spatio-temporal graph (STG) to uncover the spatial
and temporal coherence between the trajectories of crowd motion during the learning process. The presented models advance the conventional approaches by integrating a manifold-based clustering as initialization and iterative statistical inference as optimization. The output of GLDA and GCTM are mid-level features that represent the motion patterns used later to generate trajectory clusters. Experiments on three different datasets show the effectiveness of the approaches in trajectory clustering and crowd motion modeling
Data-Driven Motion Pattern Segmentation in a Crowded Environments
International audienceMotion is a strong clue for unsupervised grouping of individuals in a crowded environment. We show that collective motion in the crowd can be discovered by temporal analysis of points trajectories. First k-NN graph is constructed to represent the topological structure of point trajectories detected in crowd. Then the data-driven graph seg-mentation helps to reveal the interaction of individuals even when mixed motion is presented in data. The method was evaluated against the latest state-of-the-art methods and achieved better performance by more than 20 percent
Recommended from our members
Multiperson Tracking by Online Learned Grouping Model With Nonlinear Motion Context
Generative Models for Novelty Detection Applications in abnormal event and situational changedetection from data series
Novelty detection is a process for distinguishing the observations that differ in some respect
from the observations that the model is trained on. Novelty detection is one of the fundamental
requirements of a good classification or identification system since sometimes the
test data contains observations that were not known at the training time. In other words, the
novelty class is often is not presented during the training phase or not well defined.
In light of the above, one-class classifiers and generative methods can efficiently model
such problems. However, due to the unavailability of data from the novelty class, training
an end-to-end model is a challenging task itself. Therefore, detecting the Novel classes in
unsupervised and semi-supervised settings is a crucial step in such tasks.
In this thesis, we propose several methods to model the novelty detection problem in
unsupervised and semi-supervised fashion. The proposed frameworks applied to different
related applications of anomaly and outlier detection tasks. The results show the superior of
our proposed methods in compare to the baselines and state-of-the-art methods
TOPIC: A Parallel Association Paradigm for Multi-Object Tracking under Complex Motions and Diverse Scenes
Video data and algorithms have been driving advances in multi-object tracking
(MOT). While existing MOT datasets focus on occlusion and appearance
similarity, complex motion patterns are widespread yet overlooked. To address
this issue, we introduce a new dataset called BEE23 to highlight complex
motions. Identity association algorithms have long been the focus of MOT
research. Existing trackers can be categorized into two association paradigms:
single-feature paradigm (based on either motion or appearance feature) and
serial paradigm (one feature serves as secondary while the other is primary).
However, these paradigms are incapable of fully utilizing different features.
In this paper, we propose a parallel paradigm and present the Two rOund
Parallel matchIng meChanism (TOPIC) to implement it. The TOPIC leverages both
motion and appearance features and can adaptively select the preferable one as
the assignment metric based on motion level. Moreover, we provide an
Attention-based Appearance Reconstruct Module (AARM) to reconstruct appearance
feature embeddings, thus enhancing the representation of appearance features.
Comprehensive experiments show that our approach achieves state-of-the-art
performance on four public datasets and BEE23. Notably, our proposed parallel
paradigm surpasses the performance of existing association paradigms by a large
margin, e.g., reducing false negatives by 12% to 51% compared to the
single-feature association paradigm. The introduced dataset and association
paradigm in this work offers a fresh perspective for advancing the MOT field.
The source code and dataset are available at
https://github.com/holmescao/TOPICTrack
Measuring Crowd Collectiveness
Collective motions are common in crowd systems and have attracted a great deal of attention in a variety of mul-tidisciplinary fields. Collectiveness, which indicates the degree of individuals acting as a union in collective mo-tion, is a fundamental and universal measurement for vari-ous crowd systems. By integrating path similarities among crowds on collective manifold, this paper proposes a de-scriptor of collectiveness and an efficient computation for the crowd and its constituent individuals. The algorithm of the Collective Merging is then proposed to detect collective motions from random motions. We validate the effective-ness and robustness of the proposed collectiveness descrip-tor on the system of self-driven particles. We then compare the collectiveness descriptor to human perception for col-lective motion and show high consistency. Our experiments regarding the detection of collective motions and the mea-surement of collectiveness in videos of pedestrian crowds and bacteria colony demonstrate a wide range of applica-tions of the collectiveness descriptor1. 1
- …