Joint Image Reconstruction and Segmentation Using the Potts Model

We propose a new algorithmic approach to the non-smooth and non-convex Potts problem (also called piecewise-constant Mumford-Shah problem) for inverse imaging problems. We derive a suitable splitting into specific subproblems that can all be solved efficiently. Our method does not require a priori knowledge on the gray levels nor on the number of segments of the reconstruction. Further, it avoids anisotropic artifacts such as geometric staircasing. We demonstrate the suitability of our method for joint image reconstruction and segmentation. We focus on Radon data, where we in particular consider limited data situations. For instance, our method is able to recover all segments of the Shepp-Logan phantom from $7$ angular views only. We illustrate the practical applicability on a real PET dataset. As further applications, we consider spherical Radon data as well as blurred data

Study of Computational Image Matching Techniques: Improving Our View of Biomedical Image Data

Image matching techniques are proven to be necessary in various fields of science and engineering, with many new methods and applications introduced over the years. In this PhD thesis, several computational image matching methods are introduced and investigated for improving the analysis of various biomedical image data. These improvements include the use of matching techniques for enhancing visualization of cross-sectional imaging modalities such as Computed Tomography (CT) and Magnetic Resonance Imaging (MRI), denoising of retinal Optical Coherence Tomography (OCT), and high quality 3D reconstruction of surfaces from Scanning Electron Microscope (SEM) images. This work greatly improves the process of data interpretation of image data with far reaching consequences for basic sciences research. The thesis starts with a general notion of the problem of image matching followed by an overview of the topics covered in the thesis. This is followed by introduction and investigation of several applications of image matching/registration in biomdecial image processing: a) registration-based slice interpolation, b) fast mesh-based deformable image registration and c) use of simultaneous rigid registration and Robust Principal Component Analysis (RPCA) for speckle noise reduction of retinal OCT images. Moving towards a different notion of image matching/correspondence, the problem of view synthesis and 3D reconstruction, with a focus on 3D reconstruction of microscopic samples from 2D images captured by SEM, is considered next. Starting from sparse feature-based matching techniques, an extensive analysis is provided for using several well-known feature detector/descriptor techniques, namely ORB, BRIEF, SURF and SIFT, for the problem of multi-view 3D reconstruction. This chapter contains qualitative and quantitative comparisons in order to reveal the shortcomings of the sparse feature-based techniques. This is followed by introduction of a novel framework using sparse-dense matching/correspondence for high quality 3D reconstruction of SEM images. As will be shown, the proposed framework results in better reconstructions when compared with state-of-the-art sparse-feature based techniques. Even though the proposed framework produces satisfactory results, there is room for improvements. These improvements become more necessary when dealing with higher complexity microscopic samples imaged by SEM as well as in cases with large displacements between corresponding points in micrographs. Therefore, based on the proposed framework, a new approach is proposed for high quality 3D reconstruction of microscopic samples. While in case of having simpler microscopic samples the performance of the two proposed techniques are comparable, the new technique results in more truthful reconstruction of highly complex samples. The thesis is concluded with an overview of the thesis and also pointers regarding future directions of the research using both multi-view and photometric techniques for 3D reconstruction of SEM images

Photo-acoustic tomographic image reconstruction from reduced data using physically inspired regularization

We propose a model-based image reconstruction method for photoacoustic tomography(PAT) involving a novel form of regularization and demonstrate its ability to recover good quality images from significantly reduced size datasets. The regularization is constructed to suit the physical structure of typical PAT images. We construct it by combining second-order derivatives and intensity into a non-convex form to exploit a structural property of PAT images that we observe: in PAT images, high intensities and high second-order derivatives are jointly sparse. The specific form of regularization constructed here is a modification of the form proposed for fluorescence image restoration. This regularization is combined with a data fidelity cost, and the required image is obtained as the minimizer of this cost. As this regularization is non-convex, the efficiency of the minimization method is crucial in obtaining artifact-free reconstructions. We develop a custom minimization method for efficiently handling this non-convex minimization problem. Further, as non-convex minimization requires a large number of iterations and the PAT forward model in the data-fidelity term has to be applied in the iterations, we propose a computational structure for efficient implementation of the forward model with reduced memory requirements. We evaluate the proposed method on both simulated and real measured data sets and compare them with a recent reconstruction method that is based on a well-known fast iterative shrinkage threshold algorithm (FISTA).Comment: This manuscript has been published in Journal of Instrumentatio

Methods for the Electrical Impedance Tomography Inverse Problem: Deep Learning and Regularization with Wavelets

Electrical impedance tomography, also known as EIT, is a type of diffusive imaging modality that is non-invasive, radiation-free, and cost-effective for recovering electrical properties within a closed domain from surface measurements. The process involves injecting electrical current into a set of electrodes to measure the voltage on the smooth surface of the domain. The recovered EIT images show how well different materials or tissues within the domain conduct or impede electrical flow, which is helpful in detecting and locating anomalies. For the EIT inverse problem, it is challenging to recover reliable and resolvable electrical conductivity images since it is highly nonlinear and severely ill-posed, especially when the data is corrupted with noise. To address this issue, we propose (1) a wavelet-based modified Gauss-Newton (WGN) method that uses wavelets as a form of regularization and parameter reduction. In (1), we enforce regularization through the use of wavelet coefficients by projecting the original formulation to the wavelet domain and then only retaining the wavelet coefficients of highest power. The projected wavelet formulation is of a smaller dimension and, therefore, shows promise in improving the ill-posedness of the EIT inverse problem. Different wavelet families are implemented to capture localized features, smoothness, and irregularities within the domain. In addition, we also propose (2) a novel deep learning algorithm to solve the EIT inverse problem. In (2), we develop a deep neural network (DNN) with multiple transposed convolutional layers and activation functions to recover the EIT images. The DNN is first trained on a large set of EIT images and data, and then we recover EIT images in real-time from the trained DNN. We compare the image reconstructions from the DNN with a benchmark algorithm. For model validation, we employed a set of synthetic examples with various anomalies to test the performance and efficacy of both the DNN and WGN method. The results from both methods show promise in improving EIT image reconstructions

The use of the Kalman filter in the automated segmentation of EIT lung images

In this paper, we present a new pipeline for the fast and accurate segmentation of impedance images of the lungs using electrical impedance tomography (EIT). EIT is an emerging, promising, non-invasive imaging modality that produces real-time, low spatial but high temporal resolution images of impedance inside a body. Recovering impedance itself constitutes a nonlinear ill-posed inverse problem, therefore the problem is usually linearized, which produces impedance-change images, rather than static impedance ones. Such images are highly blurry and fuzzy along object boundaries. We provide a mathematical reasoning behind the high suitability of the Kalman filter when it comes to segmenting and tracking conductivity changes in EIT lung images. Next, we use a two-fold approach to tackle the segmentation problem. First, we construct a global lung shape to restrict the search region of the Kalman filter. Next, we proceed with augmenting the Kalman filter by incorporating an adaptive foreground detection system to provide the boundary contours for the Kalman filter to carry out the tracking of the conductivity changes as the lungs undergo deformation in a respiratory cycle. The proposed method has been validated by using performance statistics such as misclassified area, and false positive rate, and compared to previous approaches. The results show that the proposed automated method can be a fast and reliable segmentation tool for EIT imaging

Conductivity-Based Nanocomposite Structural Health Monitoring via Electrical Impedance Tomography.

Nanocomposites have incredible potential when integrated as matrices in fiber-reinforced composites for transformative conductivity-based structural health monitoring (SHM). Key to this potential is the dependence of nanocomposite conductivity on well-connected nanofiller networks. Damage that severs the network or strain that affects the connectivity will manifest as a conductivity change. These damage or strain-induced conductivity changes can then be detected and spatially located by electrical impedance tomography (EIT). The nanofiller network therefore acts as an integrated sensor network giving unprecedented insight into the mechanical state of the structure. Despite the potential of combining nanocomposite matrices with EIT, important limitations exist. EIT, for example, requires large electrode arrays that are too unwieldy to be practically implemented on in-service structures. EIT also tends to be insensitive to small, highly localized conductivity losses as is expected from common modes fiber-reinforced composite damage such as matrix cracking and delamination. Furthermore, there are gaps in the fundamental understanding of nanocomposite conductivity. This thesis advances the state of the art by addressing the aforementioned limitations of EIT for conductivity-based SHM. This is done by insightfully leveraging the unique properties of nanocomposite conductivity to circumvent EIT's limitations. First, nanocomposite conductive properties are studied. This results in fundamental contributions to the understanding of nanocomposite piezoresistivity, the influence of nanofiller alignment on transverse percolation and conductivity, and conductivity evolution due to electrical loading. Next, the potential of EIT for conductivity-based health monitoring is studied and demonstrated for damage detection in carbon nanofiber (CNF)/epoxy and glass fiber/epoxy laminates manufactured with carbon black (CB) filler and for strain detection in CNF/polyurethane (PU). Lastly, the previously developed insights into nanocomposite conductive properties and damage detection via EIT are combined to greatly enhance EIT for SHM. This is done by first exploring how the sensitivity of EIT to delamination can be enhanced through nanofiller alignment and tailoring. A method of coupling the EIT image reconstruction process with known conductivity changes such as those induced by straining piezoresistive nanocomposites is developed and presented. This approach will tremendously bolster the image quality of EIT or, synonymously, significantly abate the number of electrodes required by EIT.PhDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/111613/1/ttallman_1.pd

High-order regularized regression in Electrical Impedance Tomography

We present a novel approach for the inverse problem in electrical impedance tomography based on regularized quadratic regression. Our contribution introduces a new formulation for the forward model in the form of a nonlinear integral transform, that maps changes in the electrical properties of a domain to their respective variations in boundary data. Using perturbation theory the transform is approximated to yield a high-order misfit unction which is then used to derive a regularized inverse problem. In particular, we consider the nonlinear problem to second-order accuracy, hence our approximation method improves upon the local linearization of the forward mapping. The inverse problem is approached using Newton's iterative algorithm and results from simulated experiments are presented. With a moderate increase in computational complexity, the method yields superior results compared to those of regularized linear regression and can be implemented to address the nonlinear inverse problem