First order algorithms in variational image processing

Variational methods in imaging are nowadays developing towards a quite universal and flexible tool, allowing for highly successful approaches on tasks like denoising, deblurring, inpainting, segmentation, super-resolution, disparity, and optical flow estimation. The overall structure of such approaches is of the form ${\cal D}(Ku) + \alpha {\cal R} (u) \rightarrow \min_u$ ; where the functional ${\cal D}$ is a data fidelity term also depending on some input data $f$ and measuring the deviation of $Ku$ from such and ${\cal R}$ is a regularization functional. Moreover $K$ is a (often linear) forward operator modeling the dependence of data on an underlying image, and $\alpha$ is a positive regularization parameter. While ${\cal D}$ is often smooth and (strictly) convex, the current practice almost exclusively uses nonsmooth regularization functionals. The majority of successful techniques is using nonsmooth and convex functionals like the total variation and generalizations thereof or $\ell_1$-norms of coefficients arising from scalar products with some frame system. The efficient solution of such variational problems in imaging demands for appropriate algorithms. Taking into account the specific structure as a sum of two very different terms to be minimized, splitting algorithms are a quite canonical choice. Consequently this field has revived the interest in techniques like operator splittings or augmented Lagrangians. Here we shall provide an overview of methods currently developed and recent results as well as some computational studies providing a comparison of different methods and also illustrating their success in applications.Comment: 60 pages, 33 figure

Joint Reconstruction of Multi-channel, Spectral CT Data via Constrained Total Nuclear Variation Minimization

We explore the use of the recently proposed "total nuclear variation" (TNV) as a regularizer for reconstructing multi-channel, spectral CT images. This convex penalty is a natural extension of the total variation (TV) to vector-valued images and has the advantage of encouraging common edge locations and a shared gradient direction among image channels. We show how it can be incorporated into a general, data-constrained reconstruction framework and derive update equations based on the first-order, primal-dual algorithm of Chambolle and Pock. Early simulation studies based on the numerical XCAT phantom indicate that the inter-channel coupling introduced by the TNV leads to better preservation of image features at high levels of regularization, compared to independent, channel-by-channel TV reconstructions.Comment: Submitted to Physics in Medicine and Biolog

A Framework for Directional and Higher-Order Reconstruction in Photoacoustic Tomography

Photoacoustic tomography is a hybrid imaging technique that combines high optical tissue contrast with high ultrasound resolution. Direct reconstruction methods such as filtered backprojection, time reversal and least squares suffer from curved line artefacts and blurring, especially in case of limited angles or strong noise. In recent years, there has been great interest in regularised iterative methods. These methods employ prior knowledge on the image to provide higher quality reconstructions. However, easy comparisons between regularisers and their properties are limited, since many tomography implementations heavily rely on the specific regulariser chosen. To overcome this bottleneck, we present a modular reconstruction framework for photoacoustic tomography. It enables easy comparisons between regularisers with different properties, e.g. nonlinear, higher-order or directional. We solve the underlying minimisation problem with an efficient first-order primal-dual algorithm. Convergence rates are optimised by choosing an operator dependent preconditioning strategy. Our reconstruction methods are tested on challenging 2D synthetic and experimental data sets. They outperform direct reconstruction approaches for strong noise levels and limited angle measurements, offering immediate benefits in terms of acquisition time and quality. This work provides a basic platform for the investigation of future advanced regularisation methods in photoacoustic tomography.Comment: submitted to "Physics in Medicine and Biology". Changes from v1 to v2: regularisation with directional wavelet has been added; new experimental tests have been include

A Review of Automated Image Understanding within 3D Baggage Computed Tomography Security Screening

Baggage inspection is the principal safeguard against the transportation of prohibited and potentially dangerous materials at airport security checkpoints. Although traditionally performed by 2D X-ray based scanning, increasingly stringent security regulations have led to a growing demand for more advanced imaging technologies. The role of X-ray Computed Tomography is thus rapidly expanding beyond the traditional materials-based detection of explosives. The development of computer vision and image processing techniques for the automated understanding of 3D baggage-CT imagery is however, complicated by poor image resolutions, image clutter and high levels of noise and artefacts. We discuss the recent and most pertinent advancements and identify topics for future research within the challenging domain of automated image understanding for baggage security screening CT

Triple-source saddle-curve cone-beam photon counting CT image reconstruction:A simulation study

Purpose: The most common detector material in the PC CT system, cannot achieve the best performance at a relatively higher photon flux rate. In the reconstruction view, the most commonly used filtered back projection, is not able to provide sufficient reconstructed image quality in spectral computed tomography (CT). Developing a triple-source saddle-curve cone-beam photon counting CT image reconstruction method can improve the temporal resolution. Methods: Triple-source saddle-curve cone-beam trajectory was rearranged into four trajectory sets for simulation and reconstruction. Projection images in different energy bins were simulated by forward projection and photon counting CT respond model simulation. After simulation, the object was reconstructed using Katsevich's theory after photon counts correction using the pseudo inverse of photon counting CT response matrix. The material decomposition can be performed based on images in different energy bins. Results: Root mean square error (RMSE) and structural similarity index (SSIM) are calculated to quantify the image quality of reconstruction images. Compared with FDK images, the RMSE for the triple-source image was improved by 27%, 21%, 14%, 8%, and 6% for the reconstrued image of 20–33, 33–47, 47–58, 58–69, 69–80 keV energy bin. The SSIM was improved by 1.031%, 0.665%, 0.396%, 0.235%, 0.174% for corresponding energy bin. The decomposition image based on corrected images shows improved RMSE and SSIM, each by 33.861% and 0.345%. SSIM of corrected decomposition image of iodine reaches 99.415% of the original image. Conclusions: A new Triple-source saddle-curve cone-beam PC CT image reconstruction method was developed in this work. The exact reconstruction of the triple-source saddle-curve improved both the image quality and temporal resolution