Robust 3D Action Recognition through Sampling Local Appearances and Global Distributions

3D action recognition has broad applications in human-computer interaction and intelligent surveillance. However, recognizing similar actions remains challenging since previous literature fails to capture motion and shape cues effectively from noisy depth data. In this paper, we propose a novel two-layer Bag-of-Visual-Words (BoVW) model, which suppresses the noise disturbances and jointly encodes both motion and shape cues. First, background clutter is removed by a background modeling method that is designed for depth data. Then, motion and shape cues are jointly used to generate robust and distinctive spatial-temporal interest points (STIPs): motion-based STIPs and shape-based STIPs. In the first layer of our model, a multi-scale 3D local steering kernel (M3DLSK) descriptor is proposed to describe local appearances of cuboids around motion-based STIPs. In the second layer, a spatial-temporal vector (STV) descriptor is proposed to describe the spatial-temporal distributions of shape-based STIPs. Using the Bag-of-Visual-Words (BoVW) model, motion and shape cues are combined to form a fused action representation. Our model performs favorably compared with common STIP detection and description methods. Thorough experiments verify that our model is effective in distinguishing similar actions and robust to background clutter, partial occlusions and pepper noise

Condensation of Eigen Microstate in Statistical Ensemble and Phase Transition

In a statistical ensemble with $M$ microstates, we introduce an $M \times M$ correlation matrix with the correlations between microstates as its elements. Using eigenvectors of the correlation matrix, we can define eigen microstates of the ensemble. The normalized eigenvalue by $M$ represents the weight factor in the ensemble of the corresponding eigen microstate. In the limit $M \to \infty$, weight factors go to zero in the ensemble without localization of microstate. The finite limit of weight factor when $M \to \infty$ indicates a condensation of the corresponding eigen microstate. This indicates a phase transition with new phase characterized by the condensed eigen microstate. We propose a finite-size scaling relation of weight factors near critical point, which can be used to identify the phase transition and its universality class of general complex systems. The condensation of eigen microstate and the finite-size scaling relation of weight factors have been confirmed by the Monte Carlo data of one-dimensional and two-dimensional Ising models.Comment: 9 pages, 16 figures, accepted for publication in Sci. China-Phys. Mech. Astro