Action recognition with improved trajectories

Abstract

Recently dense trajectories were shown to be an efficient video representation for action recognition and achieved state-of-the-art results on a variety of datasets. This pa-per improves their performance by taking into account cam-era motion to correct them. To estimate camera motion, we match feature points between frames using SURF descrip-tors and dense optical flow, which are shown to be com-plementary. These matches are, then, used to robustly es-timate a homography with RANSAC. Human motion is in general different from camera motion and generates incon-sistent matches. To improve the estimation, a human de-tector is employed to remove these matches. Given the es-timated camera motion, we remove trajectories consistent with it. We also use this estimation to cancel out camera motion from the optical flow. This significantly improves motion-based descriptors, such as HOF and MBH. Experi-mental results on four challenging action datasets (i.e., Hol-lywood2, HMDB51, Olympic Sports and UCF50) signifi-cantly outperform the current state of the art. 1

Similar works

Full text

thumbnail-image
oai:CiteSeerX.psu:10.1.1.985.3199Last time updated on 11/2/2017

This paper was published in CiteSeerX.

Having an issue?

Is data on this page outdated, violates copyrights or anything else? Report the problem now and we will take corresponding actions after reviewing your request.