Left-invariant evolutions of wavelet transforms on the Similitude Group

Enhancement of multiple-scale elongated structures in noisy image data is relevant for many biomedical applications but commonly used PDE-based enhancement techniques often fail at crossings in an image. To get an overview of how an image is composed of local multiple-scale elongated structures we construct a multiple scale orientation score, which is a continuous wavelet transform on the similitude group, SIM(2). Our unitary transform maps the space of images onto a reproducing kernel space defined on SIM(2), allowing us to robustly relate Euclidean (and scaling) invariant operators on images to left-invariant operators on the corresponding continuous wavelet transform. Rather than often used wavelet (soft-)thresholding techniques, we employ the group structure in the wavelet domain to arrive at left-invariant evolutions and flows (diffusion), for contextual crossing preserving enhancement of multiple scale elongated structures in noisy images. We present experiments that display benefits of our work compared to recent PDE techniques acting directly on the images and to our previous work on left-invariant diffusions on orientation scores defined on Euclidean motion group.Comment: 40 page

Eigendecompositions of Transfer Operators in Reproducing Kernel Hilbert Spaces

Transfer operators such as the Perron--Frobenius or Koopman operator play an important role in the global analysis of complex dynamical systems. The eigenfunctions of these operators can be used to detect metastable sets, to project the dynamics onto the dominant slow processes, or to separate superimposed signals. We extend transfer operator theory to reproducing kernel Hilbert spaces and show that these operators are related to Hilbert space representations of conditional distributions, known as conditional mean embeddings in the machine learning community. Moreover, numerical methods to compute empirical estimates of these embeddings are akin to data-driven methods for the approximation of transfer operators such as extended dynamic mode decomposition and its variants. One main benefit of the presented kernel-based approaches is that these methods can be applied to any domain where a similarity measure given by a kernel is available. We illustrate the results with the aid of guiding examples and highlight potential applications in molecular dynamics as well as video and text data analysis

A regularization approach for reconstruction and visualization of 3-D data

Esta tesis trata sobre reconstrucción de superficies a partir de imágenes de rango utilizando algunas extensiones de la Regularización de Tikhonov, que produce Splines aplicables a datos en n dimensiones. La idea central es que estos splines se pueden obtener mediante la teoría de regularización, utilizando un equilibrio entre la suavidad y la fidelidad a los datos, por tanto, serán aplicables tanto en la interpolación como en la aproximación de datos exactos o ruidosos. En esta tesis proponemos un enfoque variacional que incluye los datos e información a priori acerca de la solución, dada en forma de funcionales. Solucionamos problemas de optimización que resultan ser una extensión de la teoría de Tikhonov, con el propósito de incluir funcionales con propiedades locales y globales que pueden ser ajustadas mediante parámetros de regularización. El a priori es analizado en términos de las propiedades físicas y geométricas de los funcionales para luego ser agregados a la formulación variacional. Los resultados obtenidos se prueban con datos para reconstrucción de superficies, mostrando notables propiedades de reproducción y aproximación. En particular, utilizamos la reconstrucción de superficies para ilustrar las aplicaciones prácticas, pero nuestro enfoque tiene muchas más aplicaciones. En el centro de nuestra propuesta esta la teoría general de problemas inversos y las aplicaciones de algunas ideas provenientes del análisis funcional. Los splines que obtenemos son combinaciones lineales de las soluciones fundamentales de ciertos operadores en derivadas parciales, frecuentes en la teoría de la elasticidad y no se hace ninguna suposición previa sobre el modelo estadístico de los datos de entrada, de manera que se pueden tomar en términos de una inferencia estadística no paramétrica. Estos splines son implementables en una forma muy estable y se pueden aplicar en problemas de interpolación y suavizado. / Abstract: This thesis is about surface reconstruction from range images using some extensions of Tikhonov regularization that produces splines applicable on n-dimensional data. The central idea is that these splines can be obtained by regularization theory, using a trade-off between fidelity to data and smoothness properties; as a consequence, they are applicable both in interpolation and approximation of exact or noisy data. We propose a variational framework that includes data and a priori information about the solution, given in the form of functionals. We solve optimization problems which are extensions of Tikhonov theory, in order to include functionals with local and global features that can be tuned by regularization parameters. The a priori is thought in terms of geometric and physical properties of functionals and then added to the variational formulation. The results obtained are tested on data for surface reconstruction, showing remarkable reproducing and approximating properties. In this case we use surface reconstruction to illustrate practical applications; nevertheless, our approach has many other applications. In the core of our approach is the general theory of inverse problems and the application of some abstract ideas from functional analysis. The splines obtained are linear combinations of certain fundamental solutions of partial differential operators from elasticity theory and no prior assumption is made on a statistical model for the input data, so it can be thought in terms of nonparametric statistical inference. They are implementable in a very stable form and can be applied for both interpolation and smoothing problems.Doctorad

Learning and inverse problems: from theory to solar physics applications

The problem of approximating a function from a set of discrete measurements has been extensively studied since the seventies. Our theoretical analysis proposes a formalization of the function approximation problem which allows dealing with inverse problems and supervised kernel learning as two sides of the same coin. The proposed formalization takes into account arbitrary noisy data (deterministically or statistically defined), arbitrary loss functions (possibly seen as a log-likelihood), handling both direct and indirect measurements. The core idea of this part relies on the analogy between statistical learning and inverse problems. One of the main evidences of the connection occurring across these two areas is that regularization methods, usually developed for ill-posed inverse problems, can be used for solving learning problems. Furthermore, spectral regularization convergence rate analyses provided in these two areas, share the same source conditions but are carried out with either increasing number of samples in learning theory or decreasing noise level in inverse problems. Even more in general, regularization via sparsity-enhancing methods is widely used in both areas and it is possible to apply well-known $ell_1$-penalized methods for solving both learning and inverse problems. In the first part of the Thesis, we analyze such a connection at three levels: (1) at an infinite dimensional level, we define an abstract function approximation problem from which the two problems can be derived; (2) at a discrete level, we provide a unified formulation according to a suitable definition of sampling; and (3) at a convergence rates level, we provide a comparison between convergence rates given in the two areas, by quantifying the relation between the noise level and the number of samples. In the second part of the Thesis, we focus on a specific class of problems where measurements are distributed according to a Poisson law. We provide a data-driven, asymptotically unbiased, and globally quadratic approximation of the Kullback-Leibler divergence and we propose Lasso-type methods for solving sparse Poisson regression problems, named PRiL for Poisson Reweighed Lasso and an adaptive version of this method, named APRiL for Adaptive Poisson Reweighted Lasso, proving consistency properties in estimation and variable selection, respectively. Finally we consider two problems in solar physics: 1) the problem of forecasting solar flares (learning application) and 2) the desaturation problem of solar flare images (inverse problem application). The first application concerns the prediction of solar storms using images of the magnetic field on the sun, in particular physics-based features extracted from active regions from data provided by Helioseismic and Magnetic Imager (HMI) on board the Solar Dynamics Observatory (SDO). The second application concerns the reconstruction problem of Extreme Ultra-Violet (EUV) solar flare images recorded by a second instrument on board SDO, the Atmospheric Imaging Assembly (AIA). We propose a novel sparsity-enhancing method SE-DESAT to reconstruct images affected by saturation and diffraction, without using any a priori estimate of the background solar activity