655 research outputs found
Fully Convolutional Network with Multi-Step Reinforcement Learning for Image Processing
This paper tackles a new problem setting: reinforcement learning with
pixel-wise rewards (pixelRL) for image processing. After the introduction of
the deep Q-network, deep RL has been achieving great success. However, the
applications of deep RL for image processing are still limited. Therefore, we
extend deep RL to pixelRL for various image processing applications. In
pixelRL, each pixel has an agent, and the agent changes the pixel value by
taking an action. We also propose an effective learning method for pixelRL that
significantly improves the performance by considering not only the future
states of the own pixel but also those of the neighbor pixels. The proposed
method can be applied to some image processing tasks that require pixel-wise
manipulations, where deep RL has never been applied. We apply the proposed
method to three image processing tasks: image denoising, image restoration, and
local color enhancement. Our experimental results demonstrate that the proposed
method achieves comparable or better performance, compared with the
state-of-the-art methods based on supervised learning.Comment: Accepted to AAAI 201
Image Denoising using Attention-Residual Convolutional Neural Networks
During the image acquisition process, noise is usually added to the data
mainly due to physical limitations of the acquisition sensor, and also
regarding imprecisions during the data transmission and manipulation. In that
sense, the resultant image needs to be processed to attenuate its noise without
losing details. Non-learning-based strategies such as filter-based and noise
prior modeling have been adopted to solve the image denoising problem.
Nowadays, learning-based denoising techniques showed to be much more effective
and flexible approaches, such as Residual Convolutional Neural Networks. Here,
we propose a new learning-based non-blind denoising technique named Attention
Residual Convolutional Neural Network (ARCNN), and its extension to blind
denoising named Flexible Attention Residual Convolutional Neural Network
(FARCNN). The proposed methods try to learn the underlying noise expectation
using an Attention-Residual mechanism. Experiments on public datasets corrupted
by different levels of Gaussian and Poisson noise support the effectiveness of
the proposed approaches against some state-of-the-art image denoising methods.
ARCNN achieved an overall average PSNR results of around 0.44dB and 0.96dB for
Gaussian and Poisson denoising, respectively FARCNN presented very consistent
results, even with slightly worsen performance compared to ARCNN.Comment: Published in: 2020 33rd SIBGRAPI Conference on Graphics, Patterns and
Images (SIBGRAPI
Deep Burst Denoising
Noise is an inherent issue of low-light image capture, one which is
exacerbated on mobile devices due to their narrow apertures and small sensors.
One strategy for mitigating noise in a low-light situation is to increase the
shutter time of the camera, thus allowing each photosite to integrate more
light and decrease noise variance. However, there are two downsides of long
exposures: (a) bright regions can exceed the sensor range, and (b) camera and
scene motion will result in blurred images. Another way of gathering more light
is to capture multiple short (thus noisy) frames in a "burst" and intelligently
integrate the content, thus avoiding the above downsides. In this paper, we use
the burst-capture strategy and implement the intelligent integration via a
recurrent fully convolutional deep neural net (CNN). We build our novel,
multiframe architecture to be a simple addition to any single frame denoising
model, and design to handle an arbitrary number of noisy input frames. We show
that it achieves state of the art denoising results on our burst dataset,
improving on the best published multi-frame techniques, such as VBM4D and
FlexISP. Finally, we explore other applications of image enhancement by
integrating content from multiple frames and demonstrate that our DNN
architecture generalizes well to image super-resolution
- …