Learning Blind Motion Deblurring

As handheld video cameras are now commonplace and available in every smartphone, images and videos can be recorded almost everywhere at anytime. However, taking a quick shot frequently yields a blurry result due to unwanted camera shake during recording or moving objects in the scene. Removing these artifacts from the blurry recordings is a highly ill-posed problem as neither the sharp image nor the motion blur kernel is known. Propagating information between multiple consecutive blurry observations can help restore the desired sharp image or video. Solutions for blind deconvolution based on neural networks rely on a massive amount of ground-truth data which is hard to acquire. In this work, we propose an efficient approach to produce a significant amount of realistic training data and introduce a novel recurrent network architecture to deblur frames taking temporal information into account, which can efficiently handle arbitrary spatial and temporal input sizes. We demonstrate the versatility of our approach in a comprehensive comparison on a number of challening real-world examples.Comment: International Conference on Computer Vision (ICCV) (2017

Enhancing Video Deblurring using Efficient Fourier Aggregation

Video Deblurring is a process of removing blur from all the video frames and achieving the required level of smoothness. Numerous recent approaches attempt to remove image blur due to camera shake,either with one or multiple input images, by explicitly solving an inverse and inherently ill-posed deconvolution problem.An efficient video deblurring system to handle the blurs due to shaky camera and complex motion blurs due to moving objects has been proposed.The proposed algorithm is strikingly simple: it performs a weighted average in the Fourier domain, with weights depending on the Fourier spectrum magnitude. The method can be seen as a generalization of the align and average procedure, with a weighted average, motivated by hand-shake physiology and theoretically supported, taking place in the Fourier domain. The method�s rationale is that camera shake has a random nature, and therefore, each image in the burst is generally blurred differently.The proposed system has effectively deblurred the video and results showed that the reconstructed video is sharper and less noisy than the original ones.The proposed Fourier Burst Accumulation algorithm produced similar or better results than the state-of-the-art multi-image deconvolution while being significantly faster and with lower memory footprint.The method is robust to moving objects as it acquired the consistent registration scheme

Camera Shake Removal With Multiple Images Via Weighted Fourier Burst Accumulation

Blur introduced in an image from camera shake is mostly due to the 3D rotation of the camera. This results in a blur kernel which is non uniform throughout the image. Hence each image in the burst is blurred differently. Various experiments were done to find the deblurred image either with single image or with multiple image. In this paper we analyze multiple image approaches, which capture and combine multiple frames in order to make deblurring more robust and tractable. If the photographer takes many images known as burst, we show that a clear and sharp image can be obtained by combining these multiple images. Also for this work the blurring kernel is unknown (blind) and also it is not found. The methodology used here is Fourier Burst Accumulation which performs a weighted average in Fourier Domain where the weights depend on Fourier spectrum magnitude. In simple words the method can be generalized as Align and Average procedure. Experiments with real camera data and extensive comparisons, show that the proposed burst accumulation algorithm achieves results faster

Active Short-Long Exposure Deblurring

Mobile phones can capture image bursts to produce high quality still photographs. The simplest form of a burst is two frame short-long (S-L) exposure. S-L exposure is particularly suitable in low light conditions where short exposure frames are sharp but noisy and dark, and long exposure frames are affected by motion blur but have better scene chromaticity and luminance. In this work, we take a step further and define active short-long exposure deblurring where the viewfinder frames before the burst are used to optimize the S-L exposure parameters. We introduce deep architectures and data generation for active S-L exposure deblurring. The approach is experimentally validated with realistic data and it shows clear improvements. For the most difficult scenes (worst 5%) the PSNR is improved by +1.39dB.acceptedVersionPeer reviewe