Bouthemy, P

Cernuschi-Frias,, B

Crivelli, T

Yao, JJ

HKU Scholars Hub

Motion Textures: Modeling, Classification, and Segmentation Using Mixed-State Markov Random Fields

A motion texture is an instantaneous motion map extracted from a dynamic texture. We observe that such motion maps exhibit values of two types: a discrete component at zero (absence of motion) and continuous motion values. We thus develop a mixed-state Markov random field model to represent motion textures. The core of our approach is to show that motion information is powerful enough to classify and segment dynamic textures if it is properly modeled regarding its specific nature and the local interactions involved. A parsimonious set of 11 parameters constitutes the descriptive feature of a motion texture. The motivation of the proposed formulation runs toward the analysis of dynamic video contents, and we tackle two related problems. First, we present a method for recognition and classification of motion textures, by means of the Kullback-Leibler distance between mixed-state statistical models. Second, we define a two-frame motion texture maximum a posteriori (MAP)-based segmentation method applicable to motion textures with deforming boundaries. We also investigate a new issue, the space-time dynamic texture segmentation, by combining the spatial segmentation and the recognition methods. Numerous experimental results are reported for those three problems which demonstrate the efficiency and accuracy of the proposed two-frame approach.Fil: Yao, Jian-Feng . The University of Hong Kong. Department of Statistics and Actuarial Science; Hong KongFil: Crivelli, Tomás. Universidad de Buenos Aires. Facultad de Ingenieria. Departamento de Electronica; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Cernuschi Frias, Bruno. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Saavedra 15. Instituto Argentino de Matemáticas; ArgentinaFil: Bouthemy, P.. Inria, Centre Rennes - Bretagne Atlantique; Franci

Yao, Jian-Feng

Crivelli, Tomás

Cernuschi Frias, Bruno

Bouthemy, P.

CONICET Digital

SIAM Journal on Imaging Sciences

Motion Textures: Modeling, Classification And Segmentation Using Mixed-State Markov Random Fields

International audienceA motion texture is an instantaneous motion map extracted from a dynamic texture. We observe that such motion maps exhibit values of two types: a discrete component at zero (absence of motion) and continuous motion values. We thus develop a mixed-state Markov random field model to represent motion textures. The core of our approach is to show that motion information is powerful enough to classify and segment dynamic textures if it is properly modeled regarding its specific nature and the local interactions involved. A parsimonious set of 11 parameters constitutes the descriptive feature of a motion texture. The motivation of the proposed formulation runs toward the analysis of dynamic video contents, and we tackle two related problems. First, we present a method for recognition and classification of motion textures, by means of the Kullback-Leibler distance between mixed-state statistical models. Second, we define a two-frame motion texture maximum a posteriori (MAP)- based segmentation method applicable to motion textures with deforming boundaries. We also investigate a new issue, the space-time dynamic texture segmentation, by combining the spatial segmentation and the recognition methods. Numer ous experimental results are reported for those three problems which demonstrate the efficiency and accuracy of the proposed two-frame approach

Motion Textures: Modeling, Classification, and Segmentation Using Mixed-State Markov Random Fields

Abstract

Similar works

Full text

Available Versions

HKU Scholars Hub

CONICET Digital

INRIA a CCSD electronic archive server