Image Restoration

This book represents a sample of recent contributions of researchers all around the world in the field of image restoration. The book consists of 15 chapters organized in three main sections (Theory, Applications, Interdisciplinarity). Topics cover some different aspects of the theory of image restoration, but this book is also an occasion to highlight some new topics of research related to the emergence of some original imaging devices. From this arise some real challenging problems related to image reconstruction/restoration that open the way to some new fundamental scientific questions closely related with the world we interact with

Bayesian Approaches For Image Restoration

Ph.DDOCTOR OF PHILOSOPH

Data-driven Channel Learning for Next-generation Communication Systems

University of Minnesota Ph.D. dissertation. October 2019. Major: Electrical/Computer Engineering. Advisor: Georgios Giannakis. 1 computer file (PDF); x, 116 pages.The turn of the decade has trademarked the `global society' as an information society, where the creation, distribution, integration, and manipulation of information have significant political, economic, technological, academic, and cultural implications. Its main drivers are digital information and communication technologies, which have resulted in a "data deluge", as the number of smart and Internet-capable devices increases rapidly. Unfortunately, establishing information infrastructure to collect data becomes more challenging particularly as communication networks for those devices become larger, denser, and more heterogeneous to meet the quality-of-service (QoS) for the users. Furthermore, scarcity in spectral resources due to an increased demand for mobile devices urges the development of a new methodology for wireless communications possibly facing unprecedented constraints both on hardware and software. At the same time, recent advances in machine learning tools enable statistical inference with efficiency as well as scalability in par with the volume and dimensionality of the data. These considerations justify the pressing need for machine learning tools that are amenable to new hardware and software constraints, and can scale with the size of networks, to facilitate the advanced operation of next-generation communication systems. The present thesis is centered on analytical and algorithmic foundations enabling statistical inference of critical information under practical hardware/software constraints to design and operate wireless communication networks. The vision is to establish a unified and comprehensive framework based on state-of-the-art data-driven learning and Bayesian inference tools to learn the channel-state information that is accurate yet efficient and non-demanding in terms of resources. The central goal is to theoretically, algorithmically, and experimentally demonstrate how valuable insights from data-driven learning can lead to solutions that markedly advance the state-of-the-art performance on inference of channel-state information. To this end, the present thesis investigates two main research thrusts: i) channel-gain cartography leveraging low-rank and sparsity; and ii) Bayesian approaches to channel-gain cartography for spatially heterogeneous environment. The aforementioned research thrusts introduce novel algorithms that aim to tackle the issues of next-generation communication networks. Potential of the proposed algorithms is showcased by rigorous theoretical results and extensive numerical tests

Improving SLI Performance in Optically Challenging Environments

The construction of 3D models of real-world scenes using non-contact methods is an important problem in computer vision. Some of the more successful methods belong to a class of techniques called structured light illumination (SLI). While SLI methods are generally very successful, there are cases where their performance is poor. Examples include scenes with a high dynamic range in albedo or scenes with strong interreflections. These scenes are referred to as optically challenging environments. The work in this dissertation is aimed at improving SLI performance in optically challenging environments. A new method of high dynamic range imaging (HDRI) based on pixel-by-pixel Kalman filtering is developed. Using objective metrics, it is show to achieve as much as a 9.4 dB improvement in signal-to-noise ratio and as much as a 29% improvement in radiometric accuracy over a classic method. Quality checks are developed to detect and quantify multipath interference and other quality defects using phase measuring profilometry (PMP). Techniques are established to improve SLI performance in the presence of strong interreflections. Approaches in compressed sensing are applied to SLI, and interreflections in a scene are modeled using SLI. Several different applications of this research are also discussed

Compressive Sensing Based Estimation of Direction of Arrival in Antenna Arrays

This thesis is concerned with the development of new compressive sensing (CS) techniques both in element space and beamspace for estimating the direction of arrival of various types of sources, including moving sources as well as fluctuating sources, using one-dimensional antenna arrays. The problem of estimating the angle of arrival of a plane electromagnetic wave is referred to as the direction of arrival (DOA) estimation problem. Such algorithms for estimating DOA in antenna arrays are often used in wireless communication network to increase their capacity and throughput. DOA techniques can be used to design and adapt the directivity of the array antennas. For example, an antenna array can be designed to detect a number of incoming signals and accept signals from certain directions only, while rejecting signals that are declared as interference. This spatio-temporal estimation and filtering capability can be exploited for multiplexing co-channel users and rejecting harmful co-channel interference that may occur because of jamming or multipath effects. In this study, three CS-based DOA estimation methods are proposed, one in the element space (ES), and the other two in the beamspace (BS). The proposed techniques do not require a priori knowledge of the number of sources to be estimated. Further, all these techniques are capable of handling both non-fluctuating and fluctuating source signals as well as moving signals. The virtual array concept is utilized in order to be able to identify more number of sources than the number of the sensors used. In element space, an extended version of the least absolute shrinkage and selection operator (LASSO) algorithm, the adaptable LASSO (A-LASSO), is presented. A-LASSO is utilized to solve the DOA problem in compressive sensing framework. It is shown through extensive simulations that the proposed algorithm outperforms the classical DOA estimation techniques as well as LASSO using a small number of snapshots. Furthermore, it is able to estimate coherent as well as spatially-close sources. This technique is then extended to the case of DOA estimation of the sources in unknown noise fields. In beamspace, two compressive sensing techniques are proposed for DOA estimation, one in full beamspace and the other in multiple beam beamspace. Both these techniques are able to estimate correlated source signals as well as spatially-close sources using a small number of snapshots. Furthermore, it is shown that the computational complexity of the two beamspace-based techniques is much less than that of the element-space based technique. It is shown through simulations that the performance of the DOA estimation techniques in multiple beam beamspace is superior to that of the other two techniques proposed in this thesis, in addition to having the lowest computational complexity. Finally, the feasibility for real-time implementation of the proposed CS-based DOA estimation techniques, both in the element-space and the beamspace, is examined. It is shown that the execution time of the proposed algorithms on Raspberry Pi board are compatible for real-time implementation

Spatiotemporal brain imaging and modeling

Thesis (Ph. D.)--Harvard-MIT Division of Health Sciences and Technology, February 2004.Includes bibliographical references.This thesis integrates hardware development, data analysis, and mathematical modeling to facilitate our understanding of brain cognition. Exploration of these brain mechanisms requires both structural and functional knowledge to (i) reconstruct the spatial distribution of the activity, (ii) to estimate when these areas are activated and what is the temporal sequence of activations, and (iii)to determine how the information flows in the large-scale neural network during the execution of cognitive and/or behavioral tasks. Advanced noninvasive medical imaging modalities are able to locate brain activities at high spatial and temporal resolutions. Quantitative modeling of these data is needed to understand how large-scale distributed neuronal interactions underlying perceptual, cognitive, and behavioral functions emerge and change over time. This thesis explores hardware enhancement and novel analytical approaches to improve the spatiotemporal resolution of single (MRI) or combined (MRI/fMRI and MEG/EEG) imaging modalities. In addition, mathematical approaches for identifying large-scale neural networks and their correlation to behavioral measurements are investigated. Part I of the thesis investigates parallel MRI. New hardware and image reconstruction techniques are introduced to improve spatiotemporal resolution and to reduce image distortion in structural and functional MRI. Part II discusses the localization of MEG/EEG signals on the cortical surface using anatomical information from AMTRI, and takes advantage of the high temporal resolution of MEG/EEG measurements to study cortical oscillations in the human auditory system. Part III introduces a multivariate modeling technique to identify "nodes" and "connectivity" in a(cont.) large-scale neural network and its correlation to behavior measurements in the human motor system.by Fa-Hsuan Lin.Ph.D

Exploring information retrieval using image sparse representations:from circuit designs and acquisition processes to specific reconstruction algorithms

New advances in the field of image sensors (especially in CMOS technology) tend to question the conventional methods used to acquire the image. Compressive Sensing (CS) plays a major role in this, especially to unclog the Analog to Digital Converters which are generally representing the bottleneck of this type of sensors. In addition, CS eliminates traditional compression processing stages that are performed by embedded digital signal processors dedicated to this purpose. The interest is twofold because it allows both to consistently reduce the amount of data to be converted but also to suppress digital processing performed out of the sensor chip. For the moment, regarding the use of CS in image sensors, the main route of exploration as well as the intended applications aims at reducing power consumption related to these components (i.e. ADC & DSP represent 99% of the total power consumption). More broadly, the paradigm of CS allows to question or at least to extend the Nyquist-Shannon sampling theory. This thesis shows developments in the field of image sensors demonstrating that is possible to consider alternative applications linked to CS. Indeed, advances are presented in the fields of hyperspectral imaging, super-resolution, high dynamic range, high speed and non-uniform sampling. In particular, three research axes have been deepened, aiming to design proper architectures and acquisition processes with their associated reconstruction techniques taking advantage of image sparse representations. How the on-chip implementation of Compressed Sensing can relax sensor constraints, improving the acquisition characteristics (speed, dynamic range, power consumption) ? How CS can be combined with simple analysis to provide useful image features for high level applications (adding semantic information) and improve the reconstructed image quality at a certain compression ratio ? Finally, how CS can improve physical limitations (i.e. spectral sensitivity and pixel pitch) of imaging systems without a major impact neither on the sensing strategy nor on the optical elements involved ? A CMOS image sensor has been developed and manufactured during this Ph.D. to validate concepts such as the High Dynamic Range - CS. A new design approach was employed resulting in innovative solutions for pixels addressing and conversion to perform specific acquisition in a compressed mode. On the other hand, the principle of adaptive CS combined with the non-uniform sampling has been developed. Possible implementations of this type of acquisition are proposed. Finally, preliminary works are exhibited on the use of Liquid Crystal Devices to allow hyperspectral imaging combined with spatial super-resolution. The conclusion of this study can be summarized as follows: CS must now be considered as a toolbox for defining more easily compromises between the different characteristics of the sensors: integration time, converters speed, dynamic range, resolution and digital processing resources. However, if CS relaxes some material constraints at the sensor level, it is possible that the collected data are difficult to interpret and process at the decoder side, involving massive computational resources compared to so-called conventional techniques. The application field is wide, implying that for a targeted application, an accurate characterization of the constraints concerning both the sensor (encoder), but also the decoder need to be defined