106 research outputs found
Benchmarking Single Image Dehazing and Beyond
We present a comprehensive study and evaluation of existing single image
dehazing algorithms, using a new large-scale benchmark consisting of both
synthetic and real-world hazy images, called REalistic Single Image DEhazing
(RESIDE). RESIDE highlights diverse data sources and image contents, and is
divided into five subsets, each serving different training or evaluation
purposes. We further provide a rich variety of criteria for dehazing algorithm
evaluation, ranging from full-reference metrics, to no-reference metrics, to
subjective evaluation and the novel task-driven evaluation. Experiments on
RESIDE shed light on the comparisons and limitations of state-of-the-art
dehazing algorithms, and suggest promising future directions.Comment: IEEE Transactions on Image Processing(TIP 2019
The Effectiveness of Instance Normalization: a Strong Baseline for Single Image Dehazing
We propose a novel deep neural network architecture for the challenging
problem of single image dehazing, which aims to recover the clear image from a
degraded hazy image. Instead of relying on hand-crafted image priors or
explicitly estimating the components of the widely used atmospheric scattering
model, our end-to-end system directly generates the clear image from an input
hazy image. The proposed network has an encoder-decoder architecture with skip
connections and instance normalization. We adopt the convolutional layers of
the pre-trained VGG network as encoder to exploit the representation power of
deep features, and demonstrate the effectiveness of instance normalization for
image dehazing. Our simple yet effective network outperforms the
state-of-the-art methods by a large margin on the benchmark datasets
Dense Haze: A benchmark for image dehazing with dense-haze and haze-free images
Single image dehazing is an ill-posed problem that has recently drawn
important attention. Despite the significant increase in interest shown for
dehazing over the past few years, the validation of the dehazing methods
remains largely unsatisfactory, due to the lack of pairs of real hazy and
corresponding haze-free reference images. To address this limitation, we
introduce Dense-Haze - a novel dehazing dataset. Characterized by dense and
homogeneous hazy scenes, Dense-Haze contains 33 pairs of real hazy and
corresponding haze-free images of various outdoor scenes. The hazy scenes have
been recorded by introducing real haze, generated by professional haze
machines. The hazy and haze-free corresponding scenes contain the same visual
content captured under the same illumination parameters. Dense-Haze dataset
aims to push significantly the state-of-the-art in single-image dehazing by
promoting robust methods for real and various hazy scenes. We also provide a
comprehensive qualitative and quantitative evaluation of state-of-the-art
single image dehazing techniques based on the Dense-Haze dataset. Not
surprisingly, our study reveals that the existing dehazing techniques perform
poorly for dense homogeneous hazy scenes and that there is still much room for
improvement.Comment: 5 pages, 2 figure
O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor images
Haze removal or dehazing is a challenging ill-posed problem that has drawn a
significant attention in the last few years. Despite this growing interest, the
scientific community is still lacking a reference dataset to evaluate
objectively and quantitatively the performance of proposed dehazing methods.
The few datasets that are currently considered, both for assessment and
training of learning-based dehazing techniques, exclusively rely on synthetic
hazy images. To address this limitation, we introduce the first outdoor scenes
database (named O-HAZE) composed of pairs of real hazy and corresponding
haze-free images. In practice, hazy images have been captured in presence of
real haze, generated by professional haze machines, and OHAZE contains 45
different outdoor scenes depicting the same visual content recorded in
haze-free and hazy conditions, under the same illumination parameters. To
illustrate its usefulness, O-HAZE is used to compare a representative set of
state-of-the-art dehazing techniques, using traditional image quality metrics
such as PSNR, SSIM and CIEDE2000. This reveals the limitations of current
techniques, and questions some of their underlying assumptions.Comment: arXiv admin note: text overlap with arXiv:1804.0509
Single Image Haze Removal using a Generative Adversarial Network
Traditional methods to remove haze from images rely on estimating a
transmission map. When dealing with single images, this becomes an ill-posed
problem due to the lack of depth information. In this paper, we propose an
end-to-end learning based approach which uses a modified conditional Generative
Adversarial Network to directly remove haze from an image. We employ the usage
of the Tiramisu model in place of the classic U-Net model as the generator
owing to its higher parameter efficiency and performance. Moreover, a patch
based discriminator was used to reduce artefacts in the output. To further
improve the perceptual quality of the output, a hybrid weighted loss function
was designed and used to train the model. Experiments on synthetic and real
world hazy images demonstrates that our model performs competitively with the
state of the art methods.Comment: Accepted for the WiSPNET 2020 conference. Please refer to the GitHub
repository for information on updates to the paper:
https://github.com/thatbrguy/Dehaze-GA
Does Haze Removal Help CNN-based Image Classification?
Hazy images are common in real scenarios and many dehazing methods have been
developed to automatically remove the haze from images. Typically, the goal of
image dehazing is to produce clearer images from which human vision can better
identify the object and structural details present in the images. When the
ground-truth haze-free image is available for a hazy image, quantitative
evaluation of image dehazing is usually based on objective metrics, such as
Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity (SSIM). However, in
many applications, large-scale images are collected not for visual examination
by human. Instead, they are used for many high-level vision tasks, such as
automatic classification, recognition and categorization. One fundamental
problem here is whether various dehazing methods can produce clearer images
that can help improve the performance of the high-level tasks. In this paper,
we empirically study this problem in the important task of image classification
by using both synthetic and real hazy image datasets. From the experimental
results, we find that the existing image-dehazing methods cannot improve much
the image-classification performance and sometimes even reduce the
image-classification performance
Joint Transmission Map Estimation and Dehazing using Deep Networks
Single image haze removal is an extremely challenging problem due to its
inherent ill-posed nature. Several prior-based and learning-based methods have
been proposed in the literature to solve this problem and they have achieved
superior results. However, most of the existing methods assume constant
atmospheric light model and tend to follow a two-step procedure involving
prior-based methods for estimating transmission map followed by calculation of
dehazed image using the closed form solution. In this paper, we relax the
constant atmospheric light assumption and propose a novel unified single image
dehazing network that jointly estimates the transmission map and performs
dehazing. In other words, our new approach provides an end-to-end learning
framework, where the inherent transmission map and dehazed result are learned
directly from the loss function. Extensive experiments on synthetic and real
datasets with challenging hazy images demonstrate that the proposed method
achieves significant improvements over the state-of-the-art methods.Comment: This paper has been accepted in IEEE-TCSV
Image Dehazing using Bilinear Composition Loss Function
In this paper, we introduce a bilinear composition loss function to address
the problem of image dehazing. Previous methods in image dehazing use a
two-stage approach which first estimate the transmission map followed by clear
image estimation. The drawback of a two-stage method is that it tends to boost
local image artifacts such as noise, aliasing and blocking. This is especially
the case for heavy haze images captured with a low quality device. Our method
is based on convolutional neural networks. Unique in our method is the bilinear
composition loss function which directly model the correlations between
transmission map, clear image, and atmospheric light. This allows errors to be
back-propagated to each sub-network concurrently, while maintaining the
composition constraint to avoid overfitting of each sub-network. We evaluate
the effectiveness of our proposed method using both synthetic and real world
examples. Extensive experiments show that our method outperfoms
state-of-the-art methods especially for haze images with severe noise level and
compressions
Physics-Based Generative Adversarial Models for Image Restoration and Beyond
We present an algorithm to directly solve numerous image restoration problems
(e.g., image deblurring, image dehazing, image deraining, etc.). These problems
are highly ill-posed, and the common assumptions for existing methods are
usually based on heuristic image priors. In this paper, we find that these
problems can be solved by generative models with adversarial learning. However,
the basic formulation of generative adversarial networks (GANs) does not
generate realistic images, and some structures of the estimated images are
usually not preserved well. Motivated by an interesting observation that the
estimated results should be consistent with the observed inputs under the
physics models, we propose a physics model constrained learning algorithm so
that it can guide the estimation of the specific task in the conventional GAN
framework. The proposed algorithm is trained in an end-to-end fashion and can
be applied to a variety of image restoration and related low-level vision
problems. Extensive experiments demonstrate that our method performs favorably
against the state-of-the-art algorithms.Comment: IEEE TPAM
Haze Visibility Enhancement: A Survey and Quantitative Benchmarking
This paper provides a comprehensive survey of methods dealing with visibility
enhancement of images taken in hazy or foggy scenes. The survey begins with
discussing the optical models of atmospheric scattering media and image
formation. This is followed by a survey of existing methods, which are grouped
to multiple image methods, polarizing filters based methods, methods with known
depth, and single-image methods. We also provide a benchmark of a number of
well known single-image methods, based on a recent dataset provided by Fattal
and our newly generated scattering media dataset that contains ground truth
images for quantitative evaluation. To our knowledge, this is the first
benchmark using numerical metrics to evaluate dehazing techniques. This
benchmark allows us to objectively compare the results of existing methods and
to better identify the strengths and limitations of each method
- …