A function space framework for structural total variation regularization with applications in inverse problems

In this work, we introduce a function space setting for a wide class of structural/weighted total variation (TV) regularization methods motivated by their applications in inverse problems. In particular, we consider a regularizer that is the appropriate lower semi-continuous envelope (relaxation) of a suitable total variation type functional initially defined for sufficiently smooth functions. We study examples where this relaxation can be expressed explicitly, and we also provide refinements for weighted total variation for a wide range of weights. Since an integral characterization of the relaxation in function space is, in general, not always available, we show that, for a rather general linear inverse problems setting, instead of the classical Tikhonov regularization problem, one can equivalently solve a saddle-point problem where no a priori knowledge of an explicit formulation of the structural TV functional is needed. In particular, motivated by concrete applications, we deduce corresponding results for linear inverse problems with norm and Poisson log-likelihood data discrepancy terms. Finally, we provide proof-of-concept numerical examples where we solve the saddle-point problem for weighted TV denoising as well as for MR guided PET image reconstruction

An optimal subgradient algorithm for large-scale convex optimization in simple domains

This paper shows that the optimal subgradient algorithm, OSGA, proposed in \cite{NeuO} can be used for solving structured large-scale convex constrained optimization problems. Only first-order information is required, and the optimal complexity bounds for both smooth and nonsmooth problems are attained. More specifically, we consider two classes of problems: (i) a convex objective with a simple closed convex domain, where the orthogonal projection on this feasible domain is efficiently available; (ii) a convex objective with a simple convex functional constraint. If we equip OSGA with an appropriate prox-function, the OSGA subproblem can be solved either in a closed form or by a simple iterative scheme, which is especially important for large-scale problems. We report numerical results for some applications to show the efficiency of the proposed scheme. A software package implementing OSGA for above domains is available

A function space framework for structural total variation regularization with applications in inverse problems

In this work, we introduce a function space setting for a wide class of structural/weighted total variation (TV) regularization methods motivated by their applications in inverse problems. In particular, we consider a regularizer that is the appropriate lower semi-continuous envelope (relaxation) of a suitable total variation type functional initially defined for sufficiently smooth functions. We study examples where this relaxation can be expressed explicitly, and we also provide refinements for weighted total variation for a wide range of weights. Since an integral characterization of the relaxation in function space is, in general, not always available, we show that, for a rather general linear inverse problems setting, instead of the classical Tikhonov regularization problem, one can equivalently solve a saddle-point problem where no a priori knowledge of an explicit formulation of the structural TV functional is needed. In particular, motivated by concrete applications, we deduce corresponding results for linear inverse problems with norm and Poisson log-likelihood data discrepancy terms. Finally, we provide proof-of-concept numerical examples where we solve the saddle-point problem for weighted TV denoising as well as for MR guided PET image reconstruction

Spatial Resolution Properties of Penalized-Likelihood Image Reconstruction: Space-Invariant Tomographs

This paper examines the spatial resolution properties of penalized-likelihood image reconstruction methods by analyzing the local impulse response. The analysis shows that standard regularization penalties induce space-variant local impulse response functions, even for space-invariant tomographic systems. Paradoxically, for emission image reconstruction, the local resolution is generally poorest in high-count regions. We show that the linearized local impulse response induced by quadratic roughness penalties depends on the object only through its projections. This analysis leads naturally to a modified regularization penalty that yields reconstructed images with nearly uniform resolution. The modified penalty also provides a very practical method for choosing the regularization parameter to obtain a specified resolution in images reconstructed by penalized-likelihood methods.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/85890/1/Fessler97.pd

Assessment of a Neural Network-Based Subspace MRI Reconstruction Method for Myocardial T1 Mapping Using Inversion-Recovery Radial FLASH

openLa mappatura T1 del miocardio si è affermata come un promettente biomarker per la caratterizzazione non invasiva del muscolo cardiaco nell'ambito della risonanza magnetica cardiovascolare. Questo approccio ha il potenziale di sostituire la biopsia nella diagnosi di diverse condizioni patologiche del miocardio, come la fibrosi, l'accumulo di ferro o amiloidosi. Negli ultimi anni, il deep learning ha suscitato un crescente interesse per la ricostruzione delle immagini, portando a notevoli miglioramenti rispetto alle tecniche che richiedono la predefinizione dei parametri di regolarizzazione da parte dell'operatore, rendendo così il processo parzialmente soggettivo. Il miglioramento è reso possibile grazie alla capacità delle reti neurali di apprendere automaticamente le proprietà presenti nelle immagini del dataset utilizzato per il training. La presente tesi si focalizza sull'analisi di un nuovo metodo di ricostruzione subspaziale delle immagini di risonanza magnetica basato su reti neurali per la mappatura T1 del miocardio, che utilizza una sequenza chiamata single-shot inversion-recovery radial FLASH. È stata impiegata una rete neurale nota come NLINV-Net, la quale trae ispirazione dalla tecnica di ricostruzione delle immagini NLINV. NLINV-Net risolve il problema inverso non lineare per il parallel imaging srotolando l'iteratively regularized Gauss-Newton method e incorporando nel processo termini di regolarizzazione basati su reti neurali. La rete neurale ha appreso le correlazioni esistenti tra i singoli parametri codificati dalla sequenza FLASH in modo auto-supervisionato, ovvero senza richiedere un riferimento esterno. NLINV-Net ha dimostrato di superare NLINV per la precisione dei valori T1, producendo mappe T1 di alta qualità. Le mappe ottenute con NLINV-Net sono paragonabili a quelle ottenute con un altro metodo di riferimento, che combina parallel imaging e compressed sensing utilizzando la regolarizzazione l1-Wavelet nella risoluzione del problema lineare inverso per il parallel imaging. Il vantaggio di NLINV-Net rispetto al suddetto metodo di appoggio è quello di sbarazzarsi della predefinizione dei parametri di regolarizzazione da parte dell'operatore. In questo modo, NLINV-Net fornisce una solida base per la mappatura T1 del miocardio utilizzando la sequenza single-shot inversion-recovery radial FLASH.In cardiovascular MRI, myocardial T1 mapping provides an imaging biomarker for the non-invasive characterization of the myocardial tissue, with the potential to replace invasive biopsy for the diagnosis of several pathological heart muscle conditions such as fibrosis, iron overload, or amyloid infiltration. Over the last few years, deep learning has become increasingly appealing for image reconstruction to improve upon the commonly employed user-dependent regularization terms by automatically learning image properties from the training dataset. This thesis investigates a novel neural network-based subspace MRI reconstruction method for myocardial T1 mapping, which uses a single-shot inversion-recovery radial FLASH sequence. The neural network utilized in this study is NLINV-Net, which draws inspiration from the NLINV image reconstruction technique. NLINV-Net addresses the nonlinear inverse problem for parallel imaging by unrolling the iteratively regularized Gauss-Newton method and incorporating neural network-based regularization terms into the process. It learned in a self-supervised fashion, i.e., without a reference, correlations between the individual parameters encoded with the FLASH sequence, and, consequently, a well-tuned regularization. NLINV-Net outperformed NLINV in terms of T1 precision and generated high-quality T1 maps. The T1 maps computed using NLINV-Net were comparable to the ones obtained using another baseline method, which combines parallel imaging and compressed sensing using the l1-Wavelet regularization when solving the linear inverse problem for parallel imaging. In this case, the advantage of NLINV-Net is that it removes the subjective regularization parameter tuning that comes with the forenamed benchmark method. Thus, it provides an excellent basis for myocardial T1 mapping using a single-shot inversion-recovery radial FLASH sequence

Fusion of magnetic resonance and ultrasound images for endometriosis detection

Endometriosis is a gynecologic disorder that typically affects women in their reproductive age and is associated with chronic pelvic pain and infertility. In the context of pre-operative diagnosis and guided surgery, endometriosis is a typical example of pathology that requires the use of both magnetic resonance (MR) and ultrasound (US) modalities. These modalities are used side by sidebecause they contain complementary information. However, MRI and US images have different spatial resolutions, fields of view and contrasts and are corrupted by different kinds of noise, which results in important challenges related to their analysis by radiologists. The fusion of MR and US images is a way of facilitating the task of medical experts and improve the pre-operative diagnosis and the surgery mapping. The object of this PhD thesis is to propose a new automatic fusion method for MRI and US images. First, we assume that the MR and US images to be fused are aligned, i.e., there is no geometric distortion between these images. We propose a fusion method for MR and US images, which aims at combining the advantages of each modality, i.e., good contrast and signal to noise ratio for the MR image and good spatial resolution for the US image. The proposed algorithm is based on an inverse problem, performing a super-resolution of the MR image and a denoising of the US image. A polynomial function is introduced to modelthe relationships between the gray levels of the MR and US images. However, the proposed fusion method is very sensitive to registration errors. Thus, in a second step, we introduce a joint fusion and registration method for MR and US images. Registration is a complicated task in practical applications. The proposed MR/US image fusion performs jointly super-resolution of the MR image and despeckling of the US image, and is able to automatically account for registration errors. A polynomial function is used to link ultrasound and MR images in the fusion process while an appropriate similarity measure is introduced to handle the registration problem. The proposed registration is based on a non-rigid transformation containing a local elastic B-spline model and a global affine transformation. The fusion and registration operations are performed alternatively simplifying the underlying optimization problem. The interest of the joint fusion and registration is analyzed using synthetic and experimental phantom images