DeepMatching: Hierarchical Deformable Dense Matching

We introduce a novel matching algorithm, called DeepMatching, to compute dense correspondences between images. DeepMatching relies on a hierarchical, multi-layer, correlational architecture designed for matching images and was inspired by deep convolutional approaches. The proposed matching algorithm can handle non-rigid deformations and repetitive textures and efficiently determines dense correspondences in the presence of significant changes between images. We evaluate the performance of DeepMatching, in comparison with state-of-the-art matching algorithms, on the Mikolajczyk (Mikolajczyk et al 2005), the MPI-Sintel (Butler et al 2012) and the Kitti (Geiger et al 2013) datasets. DeepMatching outperforms the state-of-the-art algorithms and shows excellent results in particular for repetitive textures.We also propose a method for estimating optical flow, called DeepFlow, by integrating DeepMatching in the large displacement optical flow (LDOF) approach of Brox and Malik (2011). Compared to existing matching algorithms, additional robustness to large displacements and complex motion is obtained thanks to our matching approach. DeepFlow obtains competitive performance on public benchmarks for optical flow estimation

On motion in dynamic magnetic resonance imaging: Applications in cardiac function and abdominal diffusion

La imagen por resonancia magnética (MRI), hoy en día, representa una potente herramienta para el diagnóstico clínico debido a su flexibilidad y sensibilidad a un amplio rango de propiedades del tejido. Sus principales ventajas son su sobresaliente versatilidad y su capacidad para proporcionar alto contraste entre tejidos blandos. Gracias a esa versatilidad, la MRI se puede emplear para observar diferentes fenómenos físicos dentro del cuerpo humano combinando distintos tipos de pulsos dentro de la secuencia. Esto ha permitido crear distintas modalidades con múltiples aplicaciones tanto biológicas como clínicas. La adquisición de MR es, sin embargo, un proceso lento, lo que conlleva una solución de compromiso entre resolución y tiempo de adquisición (Lima da Cruz, 2016; Royuela-del Val, 2017). Debido a esto, la presencia de movimiento fisiológico durante la adquisición puede conllevar una grave degradación de la calidad de imagen, así como un incremento del tiempo de adquisición, aumentando así tambien la incomodidad del paciente. Esta limitación práctica representa un gran obstáculo para la viabilidad clínica de la MRI. En esta Tesis Doctoral se abordan dos problemas de interés en el campo de la MRI en los que el movimiento fisiológico tiene un papel protagonista. Éstos son, por un lado, la estimación robusta de parámetros de rotación y esfuerzo miocárdico a partir de imágenes de MR-Tagging dinámica para el diagnóstico y clasificación de cardiomiopatías y, por otro, la reconstrucción de mapas del coeficiente de difusión aparente (ADC) a alta resolución y con alta relación señal a ruido (SNR) a partir de adquisiciones de imagen ponderada en difusión (DWI) multiparamétrica en el hígado.Departamento de Teoría de la Señal y Comunicaciones e Ingeniería TelemáticaDoctorado en Tecnologías de la Información y las Telecomunicacione

Modeling small objects under uncertainties : novel algorithms and applications.

Active Shape Models (ASM), Active Appearance Models (AAM) and Active Tensor Models (ATM) are common approaches to model elastic (deformable) objects. These models require an ensemble of shapes and textures, annotated by human experts, in order identify the model order and parameters. A candidate object may be represented by a weighted sum of basis generated by an optimization process. These methods have been very effective for modeling deformable objects in biomedical imaging, biometrics, computer vision and graphics. They have been tried mainly on objects with known features that are amenable to manual (expert) annotation. They have not been examined on objects with severe ambiguities to be uniquely characterized by experts. This dissertation presents a unified approach for modeling, detecting, segmenting and categorizing small objects under uncertainty, with focus on lung nodules that may appear in low dose CT (LDCT) scans of the human chest. The AAM, ASM and the ATM approaches are used for the first time on this application. A new formulation to object detection by template matching, as an energy optimization, is introduced. Nine similarity measures of matching have been quantitatively evaluated for detecting nodules less than 1 em in diameter. Statistical methods that combine intensity, shape and spatial interaction are examined for segmentation of small size objects. Extensions of the intensity model using the linear combination of Gaussians (LCG) approach are introduced, in order to estimate the number of modes in the LCG equation. The classical maximum a posteriori (MAP) segmentation approach has been adapted to handle segmentation of small size lung nodules that are randomly located in the lung tissue. A novel empirical approach has been devised to simultaneously detect and segment the lung nodules in LDCT scans. The level sets methods approach was also applied for lung nodule segmentation. A new formulation for the energy function controlling the level set propagation has been introduced taking into account the specific properties of the nodules. Finally, a novel approach for classification of the segmented nodules into categories has been introduced. Geometric object descriptors such as the SIFT, AS 1FT, SURF and LBP have been used for feature extraction and matching of small size lung nodules; the LBP has been found to be the most robust. Categorization implies classification of detected and segmented objects into classes or types. The object descriptors have been deployed in the detection step for false positive reduction, and in the categorization stage to assign a class and type for the nodules. The AAMI ASMI A TM models have been used for the categorization stage. The front-end processes of lung nodule modeling, detection, segmentation and classification/categorization are model-based and data-driven. This dissertation is the first attempt in the literature at creating an entirely model-based approach for lung nodule analysis

Multimodal Three Dimensional Scene Reconstruction, The Gaussian Fields Framework

The focus of this research is on building 3D representations of real world scenes and objects using different imaging sensors. Primarily range acquisition devices (such as laser scanners and stereo systems) that allow the recovery of 3D geometry, and multi-spectral image sequences including visual and thermal IR images that provide additional scene characteristics. The crucial technical challenge that we addressed is the automatic point-sets registration task. In this context our main contribution is the development of an optimization-based method at the core of which lies a unified criterion that solves simultaneously for the dense point correspondence and transformation recovery problems. The new criterion has a straightforward expression in terms of the datasets and the alignment parameters and was used primarily for 3D rigid registration of point-sets. However it proved also useful for feature-based multimodal image alignment. We derived our method from simple Boolean matching principles by approximation and relaxation. One of the main advantages of the proposed approach, as compared to the widely used class of Iterative Closest Point (ICP) algorithms, is convexity in the neighborhood of the registration parameters and continuous differentiability, allowing for the use of standard gradient-based optimization techniques. Physically the criterion is interpreted in terms of a Gaussian Force Field exerted by one point-set on the other. Such formulation proved useful for controlling and increasing the region of convergence, and hence allowing for more autonomy in correspondence tasks. Furthermore, the criterion can be computed with linear complexity using recently developed Fast Gauss Transform numerical techniques. In addition, we also introduced a new local feature descriptor that was derived from visual saliency principles and which enhanced significantly the performance of the registration algorithm. The resulting technique was subjected to a thorough experimental analysis that highlighted its strength and showed its limitations. Our current applications are in the field of 3D modeling for inspection, surveillance, and biometrics. However, since this matching framework can be applied to any type of data, that can be represented as N-dimensional point-sets, the scope of the method is shown to reach many more pattern analysis applications

Deep learning‐based method for reducing residual motion effects in diffusion parameter estimation

PURPOSE: Conventional motion-correction techniques for diffusion MRI can introduce motion-level-dependent bias in derived metrics. To address this challenge, a deep learning-based technique was developed to minimize such residual motion effects. METHODS: The data-rejection approach was adopted in which motion-corrupted data are discarded before model-fitting. A deep learning-based parameter estimation algorithm, using a hierarchical convolutional neural network (H-CNN), was combined with motion assessment and corrupted volume rejection. The method was designed to overcome the limitations of existing methods of this kind that produce parameter estimations whose quality depends strongly on a proportion of the data discarded. Evaluation experiments were conducted for the estimation of diffusion kurtosis and diffusion-tensor-derived measures at both the individual and group levels. The performance was compared with the robust approach of iteratively reweighted linear least squares (IRLLS) after motion correction with and without outlier replacement. RESULTS: Compared with IRLLS, the H-CNN-based technique is minimally sensitive to motion effects. It was tested at severe motion levels when 70% to 90% of the data are rejected and when random motion is present. The technique had a stable performance independent of the numbers and schemes of data rejection. A further test on a data set from children with attention-deficit hyperactivity disorder shows the technique can potentially ameliorate spurious group-level difference caused by head motion. CONCLUSION: This method shows great potential for reducing residual motion effects in motion-corrupted diffusion-weighted-imaging data, bringing benefits that include reduced bias in derived metrics in individual scans and reduced motion-level-dependent bias in population studies employing diffusion MRI

Improving the A-Contrario computation of a fundamental matrix in computer vision

Laboratoire MAP5 (Mathématiques appliquées Paris 5), CNRS UMR8145 Université Paris V - Paris DescartesThe fundamental matrix is a two-view tensor playing a central role in Computer Vision geometry. We address its robust estimation given pairs of matched image features, affected by noise and outliers, which searches for a maximal subset of correct matches and the associated fundamental matrix. Overcoming the broadly used parametric RANSAC method, ORSA follows a probabilistic a contrario approach to look for the set of matches being least expected with respect to a uniform random distribution of image points. ORSA lacks performance when this assumption is clearly violated. We will propose an improvement of the ORSA method, based on its same a contrario framework and the use of a non-parametric estimate of the distribution of image features. The role and estimation of the fundamental matrix and the data SIFT matches will be carefully explained with examples. Our proposal performs significantly well for common scenarios of low inlier ratios and local feature concentrations

Comparison of Methods for Matching of Images with Weakly Textured Areas

Tato bakalářská práce se zabývá srovnáním metod pro hledání korespondencí mezi snímky, kteréžto metody jsou potom využity v 3D rekonstrukci. Především se práce zaměřuje na jejich schopnost vypořádat se s těžko rekonstruovatelnými fakotry a oblastmi, které snižují kvalitu rekonstrukce na daných datasetech.This thesis contains a closer look at comparison correspondence search methods used in 3D image reconstructions. Primarily at their ability to tackle reconstruction-problematic factors and areas that are decreasing the quality of reconstruction of given datasets

Dense Motion Estimation for Smoke

Motion estimation for highly dynamic phenomena such as smoke is an open challenge for Computer Vision. Traditional dense motion estimation algorithms have difficulties with non-rigid and large motions, both of which are frequently observed in smoke motion. We propose an algorithm for dense motion estimation of smoke. Our algorithm is robust, fast, and has better performance over different types of smoke compared to other dense motion estimation algorithms, including state of the art and neural network approaches. The key to our contribution is to use skeletal flow, without explicit point matching, to provide a sparse flow. This sparse flow is upgraded to a dense flow. In this paper we describe our algorithm in greater detail, and provide experimental evidence to support our claims.Comment: ACCV201