Proposal of Query by Short-time Action Descriptions in a Scene

This paper proposes a new video representation for content-based retrieval using short-time action descriptions. The conventional methods use feature values such as transformed coefficients, etc. in query matching, whereas the proposed method employs the short-time action description which corresponds to a set of temporally and spatially local 2D appearance images in a scene. The advantage of the proposed method is the ability of obtaining not only simple action patterns by a single person or object but also relatively complicated action patterns by several persons or objects in a scene. The simulation results applied to soccer scenes confirm that the proposed method improves the efficiency and flexibility in retrieving rather complicated actions, compared to the conventional methods.