3,024 research outputs found
Performance Analysis of Different Applications of Image Inpainting Based on Exemplar Technique
In this age of rapidly developing image processing, inpainting has been a popular and practical art. Researchers have paid considerable attention to image inpainting throughout the years due to its enormous significance and effectiveness in a wide range of image processing applications, including the removal of scratches, the elimination of objects, and the modification of faces. It is one of the most challenging issues in image processing, demanding a comprehensive understanding of the image's texture and structure. The quality of inpainted image is a crucial factor which determines how close the inpainted image is to the original image. Many improvements have been implemented in the exemplar-based approach to increase the quality of inpainted regions containing structure and texture information. There are numerous ways to assess the quality of an inpainted image. In this study, the applications of exemplar based inpainting are evaluated using standard analytical measures including Sum of Absolute Difference (SAD), Peak Signal-to-Noise Ratio (PSNR), Correlation Coefficient, and Structural Similarity Index Measure (SSIM)
Image Restoration Using Joint Statistical Modeling in Space-Transform Domain
This paper presents a novel strategy for high-fidelity image restoration by
characterizing both local smoothness and nonlocal self-similarity of natural
images in a unified statistical manner. The main contributions are three-folds.
First, from the perspective of image statistics, a joint statistical modeling
(JSM) in an adaptive hybrid space-transform domain is established, which offers
a powerful mechanism of combining local smoothness and nonlocal self-similarity
simultaneously to ensure a more reliable and robust estimation. Second, a new
form of minimization functional for solving image inverse problem is formulated
using JSM under regularization-based framework. Finally, in order to make JSM
tractable and robust, a new Split-Bregman based algorithm is developed to
efficiently solve the above severely underdetermined inverse problem associated
with theoretical proof of convergence. Extensive experiments on image
inpainting, image deblurring and mixed Gaussian plus salt-and-pepper noise
removal applications verify the effectiveness of the proposed algorithm.Comment: 14 pages, 18 figures, 7 Tables, to be published in IEEE Transactions
on Circuits System and Video Technology (TCSVT). High resolution pdf version
and Code can be found at: http://idm.pku.edu.cn/staff/zhangjian/IRJSM
Inpainting of Cyclic Data using First and Second Order Differences
Cyclic data arise in various image and signal processing applications such as
interferometric synthetic aperture radar, electroencephalogram data analysis,
and color image restoration in HSV or LCh spaces. In this paper we introduce a
variational inpainting model for cyclic data which utilizes our definition of
absolute cyclic second order differences. Based on analytical expressions for
the proximal mappings of these differences we propose a cyclic proximal point
algorithm (CPPA) for minimizing the corresponding functional. We choose
appropriate cycles to implement this algorithm in an efficient way. We further
introduce a simple strategy to initialize the unknown inpainting region.
Numerical results both for synthetic and real-world data demonstrate the
performance of our algorithm.Comment: accepted Converence Paper at EMMCVPR'1
A deep learning framework for quality assessment and restoration in video endoscopy
Endoscopy is a routine imaging technique used for both diagnosis and
minimally invasive surgical treatment. Artifacts such as motion blur, bubbles,
specular reflections, floating objects and pixel saturation impede the visual
interpretation and the automated analysis of endoscopy videos. Given the
widespread use of endoscopy in different clinical applications, we contend that
the robust and reliable identification of such artifacts and the automated
restoration of corrupted video frames is a fundamental medical imaging problem.
Existing state-of-the-art methods only deal with the detection and restoration
of selected artifacts. However, typically endoscopy videos contain numerous
artifacts which motivates to establish a comprehensive solution.
We propose a fully automatic framework that can: 1) detect and classify six
different primary artifacts, 2) provide a quality score for each frame and 3)
restore mildly corrupted frames. To detect different artifacts our framework
exploits fast multi-scale, single stage convolutional neural network detector.
We introduce a quality metric to assess frame quality and predict image
restoration success. Generative adversarial networks with carefully chosen
regularization are finally used to restore corrupted frames.
Our detector yields the highest mean average precision (mAP at 5% threshold)
of 49.0 and the lowest computational time of 88 ms allowing for accurate
real-time processing. Our restoration models for blind deblurring, saturation
correction and inpainting demonstrate significant improvements over previous
methods. On a set of 10 test videos we show that our approach preserves an
average of 68.7% which is 25% more frames than that retained from the raw
videos.Comment: 14 page
- …