8,666 research outputs found
Dynamic texture recognition using time-causal and time-recursive spatio-temporal receptive fields
This work presents a first evaluation of using spatio-temporal receptive
fields from a recently proposed time-causal spatio-temporal scale-space
framework as primitives for video analysis. We propose a new family of video
descriptors based on regional statistics of spatio-temporal receptive field
responses and evaluate this approach on the problem of dynamic texture
recognition. Our approach generalises a previously used method, based on joint
histograms of receptive field responses, from the spatial to the
spatio-temporal domain and from object recognition to dynamic texture
recognition. The time-recursive formulation enables computationally efficient
time-causal recognition. The experimental evaluation demonstrates competitive
performance compared to state-of-the-art. Especially, it is shown that binary
versions of our dynamic texture descriptors achieve improved performance
compared to a large range of similar methods using different primitives either
handcrafted or learned from data. Further, our qualitative and quantitative
investigation into parameter choices and the use of different sets of receptive
fields highlights the robustness and flexibility of our approach. Together,
these results support the descriptive power of this family of time-causal
spatio-temporal receptive fields, validate our approach for dynamic texture
recognition and point towards the possibility of designing a range of video
analysis methods based on these new time-causal spatio-temporal primitives.Comment: 29 pages, 16 figure
Convolutional Neural Network on Three Orthogonal Planes for Dynamic Texture Classification
Dynamic Textures (DTs) are sequences of images of moving scenes that exhibit
certain stationarity properties in time such as smoke, vegetation and fire. The
analysis of DT is important for recognition, segmentation, synthesis or
retrieval for a range of applications including surveillance, medical imaging
and remote sensing. Deep learning methods have shown impressive results and are
now the new state of the art for a wide range of computer vision tasks
including image and video recognition and segmentation. In particular,
Convolutional Neural Networks (CNNs) have recently proven to be well suited for
texture analysis with a design similar to a filter bank approach. In this
paper, we develop a new approach to DT analysis based on a CNN method applied
on three orthogonal planes x y , xt and y t . We train CNNs on spatial frames
and temporal slices extracted from the DT sequences and combine their outputs
to obtain a competitive DT classifier. Our results on a wide range of commonly
used DT classification benchmark datasets prove the robustness of our approach.
Significant improvement of the state of the art is shown on the larger
datasets.Comment: 19 pages, 10 figure
A VLSI-oriented and power-efficient approach for dynamic texture recognition applied to smoke detection
The recognition of dynamic textures is fundamental in processing image sequences as they are very common
in natural scenes. The computation of the optic flow is the most popular method to detect, segment and analyse
dynamic textures. For weak dynamic textures, this method is specially adequate. However, for strong dynamic
textures, it implies heavy computational load and therefore an important energy consumption. In this paper,
we propose a novel approach intented to be implemented by very low-power integrated vision devices. It
is based on a simple and flexible computation at the focal plane implemented by power-efficient hardware.
The first stages of the processing are dedicated to remove redundant spatial information in order to obtain
a simplified representation of the original scene. This simplified representation can be used by subsequent
digital processing stages to finally decide about the presence and evolution of a certain dynamic texture in the
scene. As an application of the proposed approach, we present the preliminary results of smoke detection for
the development of a forest fire detection system based on a wireless vision sensor network.Junta de Andalucía (CICE) 2006-TIC-235
- …