Multiscale optical flow computation from the monogenic signal

National audienceWe have developed an algorithm for the estimation of cardiac motion from medical images. The algorithm exploits monogenic signal theory, recently introduced as an N-dimensional generalization of the analytic signal. The displacement is computed locally by assuming the conservation of the monogenic phase over time. A local affine displacement model replaces the standard translation model to account for more complex motions as contraction/expansion and shear. A coarse-to-fine B-spline scheme allows a robust and effective computation of the models parameters and a pyramidal refinement scheme helps handle large motions. Robustness against noise is increased by replacing the standard pointwise computation of the monogenic orientation with a more robust least-squares orientation estimate. This paper reviews the results obtained on simulated cardiac images from different modalities, namely 2D and 3D cardiac ultrasound and tagged magnetic resonance. We also show how the proposed algorithm represents a valuable alternative to state-of-the-art algorithms in the respective fields

Cardiac motion assessement from echocardiographic image sequences by means of the structure multivector

International audienceWe recently contributed an algorithm for the estimation of cardiac deformation from echocardiographic image sequences based on the monogenic signal. By exploiting the phase information instead of the pixel intensity, the algorithm was robust to the temporal contrast variations normally encountered in cardiac ultrasound. In this paper we propose an improvement of that framework making use of an extension of the monogenic signal formalism, called structure multivector. The structure multivector models the image as the superposition of two perpendicular waves with associated amplitude, phase and orientation. Such a model is well adapted to describe the granular pattern of the characteristic speckle noise. The displacement is computed by solving the optical flow equation jointly for the two image phases. A local affine model accounts for typical cardiac motions as contraction/expansion and shearing; a coarse-to-fine B-spline scheme allows for a robust and effective computation of the model parameters and a pyramidal refinement scheme helps deal with large motions. Performance was evaluated on realistic simulated cardiac ultrasound sequences and compared to our previous monogenic-based algorithm and classical speckle tracking. Endpoint-error was used as accuracy metric. With respect to them we achieved error reductions of 13% and 30% respectively

Mean Oriented Riesz Features for Micro Expression Classification

Micro-expressions are brief and subtle facial expressions that go on and off the face in a fraction of a second. This kind of facial expressions usually occurs in high stake situations and is considered to reflect a human's real intent. There has been some interest in micro-expression analysis, however, a great majority of the methods are based on classically established computer vision methods such as local binary patterns, histogram of gradients and optical flow. A novel methodology for micro-expression recognition using the Riesz pyramid, a multi-scale steerable Hilbert transform is presented. In fact, an image sequence is transformed with this tool, then the image phase variations are extracted and filtered as proxies for motion. Furthermore, the dominant orientation constancy from the Riesz transform is exploited to average the micro-expression sequence into an image pair. Based on that, the Mean Oriented Riesz Feature description is introduced. Finally the performance of our methods are tested in two spontaneous micro-expressions databases and compared to state-of-the-art methods

Optical Flow Estimation in Ultrasound Images Using a Sparse Representation

This paper introduces a 2D optical flow estimation method for cardiac ultrasound imaging based on a sparse representation. The optical flow problem is regularized using a classical gradient-based smoothness term combined with a sparsity inducing regularization that uses a learned cardiac flow dictionary. A particular emphasis is put on the influence of the spatial and sparse regularizations on the optical flow estimation problem. A comparison with state-of-the-art methods using realistic simulations shows the competitiveness of the proposed method for cardiac motion estimation in ultrasound images

08291 Abstracts Collection -- Statistical and Geometrical Approaches to Visual Motion Analysis

From 13.07.2008 to 18.07.2008, the Dagstuhl Seminar 08291 ``Statistical and Geometrical Approaches to Visual Motion Analysis\u27\u27 was held in the International Conference and Research Center (IBFI), Schloss Dagstuhl. During the seminar, several participants presented their current research, and ongoing work and open problems were discussed. Abstracts of the presentations given during the seminar as well as abstracts of seminar results and ideas are put together in this paper. The first section describes the seminar topics and goals in general

Elliptical monogenic representation of color images and local frequency analysis

International audienceWe define a new color extension for the monogenic representation of images by using an elliptical tri-valued oscillation model jointly with the vector structure tensor formalism. The proposed method provides a rich local colorimetric and geometric analysis, in particular a color phase concept, which can be computed by a numerically stable algorithm. This representation is finally used to estimate the local frequency of color images