16 research outputs found
Non-locally Enhanced Encoder-Decoder Network for Single Image De-raining
Single image rain streaks removal has recently witnessed substantial progress
due to the development of deep convolutional neural networks. However, existing
deep learning based methods either focus on the entrance and exit of the
network by decomposing the input image into high and low frequency information
and employing residual learning to reduce the mapping range, or focus on the
introduction of cascaded learning scheme to decompose the task of rain streaks
removal into multi-stages. These methods treat the convolutional neural network
as an encapsulated end-to-end mapping module without deepening into the
rationality and superiority of neural network design. In this paper, we delve
into an effective end-to-end neural network structure for stronger feature
expression and spatial correlation learning. Specifically, we propose a
non-locally enhanced encoder-decoder network framework, which consists of a
pooling indices embedded encoder-decoder network to efficiently learn
increasingly abstract feature representation for more accurate rain streaks
modeling while perfectly preserving the image detail. The proposed
encoder-decoder framework is composed of a series of non-locally enhanced dense
blocks that are designed to not only fully exploit hierarchical features from
all the convolutional layers but also well capture the long-distance
dependencies and structural information. Extensive experiments on synthetic and
real datasets demonstrate that the proposed method can effectively remove
rain-streaks on rainy image of various densities while well preserving the
image details, which achieves significant improvements over the recent
state-of-the-art methods.Comment: Accepted to ACM Multimedia 201