3,240 research outputs found
Joint Transmission Map Estimation and Dehazing using Deep Networks
Single image haze removal is an extremely challenging problem due to its
inherent ill-posed nature. Several prior-based and learning-based methods have
been proposed in the literature to solve this problem and they have achieved
superior results. However, most of the existing methods assume constant
atmospheric light model and tend to follow a two-step procedure involving
prior-based methods for estimating transmission map followed by calculation of
dehazed image using the closed form solution. In this paper, we relax the
constant atmospheric light assumption and propose a novel unified single image
dehazing network that jointly estimates the transmission map and performs
dehazing. In other words, our new approach provides an end-to-end learning
framework, where the inherent transmission map and dehazed result are learned
directly from the loss function. Extensive experiments on synthetic and real
datasets with challenging hazy images demonstrate that the proposed method
achieves significant improvements over the state-of-the-art methods.Comment: This paper has been accepted in IEEE-TCSV
Unsupervised Single Image Underwater Depth Estimation
Depth estimation from a single underwater image is one of the most
challenging problems and is highly ill-posed. Due to the absence of large
generalized underwater depth datasets and the difficulty in obtaining ground
truth depth-maps, supervised learning techniques such as direct depth
regression cannot be used. In this paper, we propose an unsupervised method for
depth estimation from a single underwater image taken `in the wild' by using
haze as a cue for depth. Our approach is based on indirect depth-map estimation
where we learn the mapping functions between unpaired RGB-D terrestrial images
and arbitrary underwater images to estimate the required depth-map. We propose
a method which is based on the principles of cycle-consistent learning and uses
dense-block based auto-encoders as generator networks. We evaluate and compare
our method both quantitatively and qualitatively on various underwater images
with diverse attenuation and scattering conditions and show that our method
produces state-of-the-art results for unsupervised depth estimation from a
single underwater image.Comment: Accepted for publication at IEEE International Conference on Image
Processing (ICIP), 201
A Cascaded Convolutional Neural Network for Single Image Dehazing
Images captured under outdoor scenes usually suffer from low contrast and
limited visibility due to suspended atmospheric particles, which directly
affects the quality of photos. Despite numerous image dehazing methods have
been proposed, effective hazy image restoration remains a challenging problem.
Existing learning-based methods usually predict the medium transmission by
Convolutional Neural Networks (CNNs), but ignore the key global atmospheric
light. Different from previous learning-based methods, we propose a flexible
cascaded CNN for single hazy image restoration, which considers the medium
transmission and global atmospheric light jointly by two task-driven
subnetworks. Specifically, the medium transmission estimation subnetwork is
inspired by the densely connected CNN while the global atmospheric light
estimation subnetwork is a light-weight CNN. Besides, these two subnetworks are
cascaded by sharing the common features. Finally, with the estimated model
parameters, the haze-free image is obtained by the atmospheric scattering model
inversion, which achieves more accurate and effective restoration performance.
Qualitatively and quantitatively experimental results on the synthetic and
real-world hazy images demonstrate that the proposed method effectively removes
haze from such images, and outperforms several state-of-the-art dehazing
methods.Comment: This manuscript is accepted by IEEE ACCES
An All-in-One Network for Dehazing and Beyond
This paper proposes an image dehazing model built with a convolutional neural
network (CNN), called All-in-One Dehazing Network (AOD-Net). It is designed
based on a re-formulated atmospheric scattering model. Instead of estimating
the transmission matrix and the atmospheric light separately as most previous
models did, AOD-Net directly generates the clean image through a light-weight
CNN. Such a novel end-to-end design makes it easy to embed AOD-Net into other
deep models, e.g., Faster R-CNN, for improving high-level task performance on
hazy images. Experimental results on both synthesized and natural hazy image
datasets demonstrate our superior performance than the state-of-the-art in
terms of PSNR, SSIM and the subjective visual quality. Furthermore, when
concatenating AOD-Net with Faster R-CNN and training the joint pipeline from
end to end, we witness a large improvement of the object detection performance
on hazy images
Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing
In this paper, we present an end-to-end network, called Cycle-Dehaze, for
single image dehazing problem, which does not require pairs of hazy and
corresponding ground truth images for training. That is, we train the network
by feeding clean and hazy images in an unpaired manner. Moreover, the proposed
approach does not rely on estimation of the atmospheric scattering model
parameters. Our method enhances CycleGAN formulation by combining
cycle-consistency and perceptual losses in order to improve the quality of
textural information recovery and generate visually better haze-free images.
Typically, deep learning models for dehazing take low resolution images as
input and produce low resolution outputs. However, in the NTIRE 2018 challenge
on single image dehazing, high resolution images were provided. Therefore, we
apply bicubic downscaling. After obtaining low-resolution outputs from the
network, we utilize the Laplacian pyramid to upscale the output images to the
original resolution. We conduct experiments on NYU-Depth, I-HAZE, and O-HAZE
datasets. Extensive experiments demonstrate that the proposed approach improves
CycleGAN method both quantitatively and qualitatively.Comment: Accepted at CVPRW: NTIRE 201
Night Time Haze and Glow Removal using Deep Dilated Convolutional Network
In this paper, we address the single image haze removal problem in a
nighttime scene. The night haze removal is a severely ill-posed problem
especially due to the presence of various visible light sources with varying
colors and non-uniform illumination. These light sources are of different
shapes and introduce noticeable glow in night scenes. To address these effects
we introduce a deep learning based DeGlow-DeHaze iterative architecture which
accounts for varying color illumination and glows. First, our convolution
neural network (CNN) based DeGlow model is able to remove the glow effect
significantly and on top of it a separate DeHaze network is included to remove
the haze effect. For our recurrent network training, the hazy images and the
corresponding transmission maps are synthesized from the NYU depth datasets and
consequently restored a high-quality haze-free image. The experimental results
demonstrate that our hybrid CNN model outperforms other state-of-the-art
methods in terms of computation speed and image quality. We also show the
effectiveness of our model on a number of real images and compare our results
with the existing night haze heuristic models.Comment: 13 pages, 10 figures, 2 Table
Benchmarking Single Image Dehazing and Beyond
We present a comprehensive study and evaluation of existing single image
dehazing algorithms, using a new large-scale benchmark consisting of both
synthetic and real-world hazy images, called REalistic Single Image DEhazing
(RESIDE). RESIDE highlights diverse data sources and image contents, and is
divided into five subsets, each serving different training or evaluation
purposes. We further provide a rich variety of criteria for dehazing algorithm
evaluation, ranging from full-reference metrics, to no-reference metrics, to
subjective evaluation and the novel task-driven evaluation. Experiments on
RESIDE shed light on the comparisons and limitations of state-of-the-art
dehazing algorithms, and suggest promising future directions.Comment: IEEE Transactions on Image Processing(TIP 2019
Generic Model-Agnostic Convolutional Neural Network for Single Image Dehazing
Haze and smog are among the most common environmental factors impacting image
quality and, therefore, image analysis. This paper proposes an end-to-end
generative method for image dehazing. It is based on designing a fully
convolutional neural network to recognize haze structures in input images and
restore clear, haze-free images. The proposed method is agnostic in the sense
that it does not explore the atmosphere scattering model. Somewhat
surprisingly, it achieves superior performance relative to all existing
state-of-the-art methods for image dehazing even on SOTS outdoor images, which
are synthesized using the atmosphere scattering model.
Project detail and code can be found here:
https://github.com/Seanforfun/GMAN_Net_Haze_Remova
DR-Net: Transmission Steered Single Image Dehazing Network with Weakly Supervised Refinement
Despite the recent progress in image dehazing, several problems remain
largely unsolved such as robustness for varying scenes, the visual quality of
reconstructed images, and effectiveness and flexibility for applications. To
tackle these problems, we propose a new deep network architecture for single
image dehazing called DR-Net. Our model consists of three main subnetworks: a
transmission prediction network that predicts transmission map for the input
image, a haze removal network that reconstructs latent image steered by the
transmission map, and a refinement network that enhances the details and color
properties of the dehazed result via weakly supervised learning. Compared to
previous methods, our method advances in three aspects: (i) pure data-driven
model; (ii) the end-to-end system; (iii) superior robustness, accuracy, and
applicability. Extensive experiments demonstrate that our DR-Net outperforms
the state-of-the-art methods on both synthetic and real images in qualitative
and quantitative metrics. Additionally, the utility of DR-Net has been
illustrated by its potential usage in several important computer vision tasks.Comment: 8 pages, 8 figures, submitted to CVPR 201
Gated Fusion Network for Single Image Dehazing
In this paper, we propose an efficient algorithm to directly restore a clear
image from a hazy input. The proposed algorithm hinges on an end-to-end
trainable neural network that consists of an encoder and a decoder. The encoder
is exploited to capture the context of the derived input images, while the
decoder is employed to estimate the contribution of each input to the final
dehazed result using the learned representations attributed to the encoder. The
constructed network adopts a novel fusion-based strategy which derives three
inputs from an original hazy image by applying White Balance (WB), Contrast
Enhancing (CE), and Gamma Correction (GC). We compute pixel-wise confidence
maps based on the appearance differences between these different inputs to
blend the information of the derived inputs and preserve the regions with
pleasant visibility. The final dehazed image is yielded by gating the important
features of the derived inputs. To train the network, we introduce a
multi-scale approach such that the halo artifacts can be avoided. Extensive
experimental results on both synthetic and real-world images demonstrate that
the proposed algorithm performs favorably against the state-of-the-art
algorithms
- …