Recent Progress in Image Deblurring

This paper comprehensively reviews the recent development of image deblurring, including non-blind/blind, spatially invariant/variant deblurring techniques. Indeed, these techniques share the same objective of inferring a latent sharp image from one or several corresponding blurry images, while the blind deblurring techniques are also required to derive an accurate blur kernel. Considering the critical role of image restoration in modern imaging systems to provide high-quality images under complex environments such as motion, undesirable lighting conditions, and imperfect system components, image deblurring has attracted growing attention in recent years. From the viewpoint of how to handle the ill-posedness which is a crucial issue in deblurring tasks, existing methods can be grouped into five categories: Bayesian inference framework, variational methods, sparse representation-based methods, homography-based modeling, and region-based methods. In spite of achieving a certain level of development, image deblurring, especially the blind case, is limited in its success by complex application conditions which make the blur kernel hard to obtain and be spatially variant. We provide a holistic understanding and deep insight into image deblurring in this review. An analysis of the empirical evidence for representative methods, practical issues, as well as a discussion of promising future directions are also presented.Comment: 53 pages, 17 figure

Pixel-level Image Fusion Algorithms for Multi-camera Imaging System

This thesis work is motivated by the potential and promise of image fusion technologies in the multi sensor image fusion system and applications. With specific focus on pixel level image fusion, the process after the image registration is processed, we develop graphic user interface for multi-sensor image fusion software using Microsoft visual studio and Microsoft Foundation Class library. In this thesis, we proposed and presented some image fusion algorithms with low computational cost, based upon spatial mixture analysis. The segment weighted average image fusion combines several low spatial resolution data source from different sensors to create high resolution and large size of fused image. This research includes developing a segment-based step, based upon stepwise divide and combine process. In the second stage of the process, the linear interpolation optimization is used to sharpen the image resolution. Implementation of these image fusion algorithms are completed based on the graphic user interface we developed. Multiple sensor image fusion is easily accommodated by the algorithm, and the results are demonstrated at multiple scales. By using quantitative estimation such as mutual information, we obtain the experiment quantifiable results. We also use the image morphing technique to generate fused image sequence, to simulate the results of image fusion. While deploying our pixel level image fusion algorithm approaches, we observe several challenges from the popular image fusion methods. While high computational cost and complex processing steps of image fusion algorithms provide accurate fused results, they also makes it hard to become deployed in system and applications that require real-time feedback, high flexibility and low computation abilit

Deep Learning Methods for Remote Sensing

Remote sensing is a field where important physical characteristics of an area are exacted using emitted radiation generally captured by satellite cameras, sensors onboard aerial vehicles, etc. Captured data help researchers develop solutions to sense and detect various characteristics such as forest fires, flooding, changes in urban areas, crop diseases, soil moisture, etc. The recent impressive progress in artificial intelligence (AI) and deep learning has sparked innovations in technologies, algorithms, and approaches and led to results that were unachievable until recently in multiple areas, among them remote sensing. This book consists of sixteen peer-reviewed papers covering new advances in the use of AI for remote sensing

Machine Learning for Microcontroller-Class Hardware -- A Review

The advancements in machine learning opened a new opportunity to bring intelligence to the low-end Internet-of-Things nodes such as microcontrollers. Conventional machine learning deployment has high memory and compute footprint hindering their direct deployment on ultra resource-constrained microcontrollers. This paper highlights the unique requirements of enabling onboard machine learning for microcontroller class devices. Researchers use a specialized model development workflow for resource-limited applications to ensure the compute and latency budget is within the device limits while still maintaining the desired performance. We characterize a closed-loop widely applicable workflow of machine learning model development for microcontroller class devices and show that several classes of applications adopt a specific instance of it. We present both qualitative and numerical insights into different stages of model development by showcasing several use cases. Finally, we identify the open research challenges and unsolved questions demanding careful considerations moving forward.Comment: Accepted for publication at IEEE Sensors Journa

Physics-based Reconstruction Methods for Magnetic Resonance Imaging

Conventional Magnetic Resonance Imaging (MRI) is hampered by long scan times and only qualitative image contrasts that prohibit a direct comparison between different systems. To address these limitations, model-based reconstructions explicitly model the physical laws that govern the MRI signal generation. By formulating image reconstruction as an inverse problem, quantitative maps of the underlying physical parameters can then be extracted directly from efficiently acquired k-space signals without intermediate image reconstruction -- addressing both shortcomings of conventional MRI at the same time. This review will discuss basic concepts of model-based reconstructions and report about our experience in developing several model-based methods over the last decade using selected examples that are provided complete with data and code.Comment: 8 figures, review accepted to Philos. Trans. R. Soc.

3D Imaging for Planning of Minimally Invasive Surgical Procedures

Novel minimally invasive surgeries are used for treating cardiovascular diseases and are performed under 2D fluoroscopic guidance with a C-arm system. 3D multidetector row computed tomography (MDCT) images are routinely used for preprocedural planning and postprocedural follow-up. For preprocedural planning, the ability to integrate the MDCT with fluoroscopic images for intraprocedural guidance is of clinical interest. Registration may be facilitated by rotating the C-arm to acquire 3D C-arm CT images. This dissertation describes the development of optimal scan and contrast parameters for C-arm CT in 6 swine. A 5-s ungated C-arm CT acquisition during rapid ventricular pacing with aortic root injection using minimal contrast (36 mL), producing high attenuation (1226), few artifacts (2.0), and measurements similar to those from MDCT (p\u3e0.05) was determined optimal. 3D MDCT and C-arm CT images were registered to overlay the aortic structures from MDCT onto fluoroscopic images for guidance in placing the prosthesis. This work also describes the development of a methodology to develop power equation (R2\u3e0.998) for estimating dose with C-arm CT based on applied tube voltage. Application in 10 patients yielded 5.48┬▒177 2.02 mGy indicating minimal radiation burden. For postprocedural follow-up, combinations of non-contrast, arterial, venous single energy CT (SECT) scans are used to monitor patients at multiple time intervals resulting in high cumulative radiation dose. Employing a single dual-energy CT (DECT) scan to replace two SECT scans can reduce dose. This work focuses on evaluating the feasibility of DECT imaging in the arterial phase. The replacement of non-contrast and arterial SECT acquisitions with one arterial DECT acquisition in 30 patients allowed generation of virtual non-contrast (VNC) images with 31 dose savings. Aortic luminal attenuation in VNC (32┬▒177 2 HU) was similar to true non-contrast images (35┬▒177 4 HU) indicating presence of unattenuated blood. To improve discrimination between c

Computational Cameras: Approaches, Benefits and Limits

A computational camera uses a combination of optics and software to produce images that cannot be taken with traditional cameras. In the last decade, computational imaging has emerged as a vibrant field of research. A wide variety of computational cameras have been demonstrated - some designed to achieve new imaging functionalities and others to reduce the complexity of traditional imaging. In this article, we describe how computational cameras have evolved and present a taxonomy for the technical approaches they use. We explore the benefits and limits of computational imaging, and describe how it is related to the adjacent and overlapping fields of digital imaging, computational photography and computational image sensors