Multi-modal feature fusion for action recognition in rgb-d sequences


Microsoft Kinect’s output is a multi-modal signal which gives RGB videos, depth sequences and skeleton information si-multaneously. Various action recognition techniques focused on different single modalities of the signals and built their classifiers over the features extracted from one of these chan-nels. For better recognition performance, it’s desirable to fuse these multi-modal information into an integrated set of dis-criminative features. Most of current fusion methods merged heterogeneous features in a holistic manner and ignored the complementary properties of these modalities in finer levels. In this paper, we proposed a new hierarchical bag-of-words feature fusion technique based on multi-view structured spar-sity learning to fuse atomic features from RGB and skeletons for the task of action recognition

Similar works

Full text

oaioai:CiteSeerX.psu:10.1...Last time updated on 11/2/2017

This paper was published in CiteSeerX.

Having an issue?

Is data on this page outdated, violates copyrights or anything else? Report the problem now and we will take corresponding actions after reviewing your request.