5 research outputs found
Intrinsic Image Transfer for Illumination Manipulation
This paper presents a novel intrinsic image transfer (IIT) algorithm for
illumination manipulation, which creates a local image translation between two
illumination surfaces. This model is built on an optimization-based framework
consisting of three photo-realistic losses defined on the sub-layers factorized
by an intrinsic image decomposition. We illustrate that all losses can be
reduced without the necessity of taking an intrinsic image decomposition under
the well-known spatial-varying illumination illumination-invariant reflectance
prior knowledge. Moreover, with a series of relaxations, all of them can be
directly defined on images, giving a closed-form solution for image
illumination manipulation. This new paradigm differs from the prevailing
Retinex-based algorithms, as it provides an implicit way to deal with the
per-pixel image illumination. We finally demonstrate its versatility and
benefits to the illumination-related tasks such as illumination compensation,
image enhancement, and high dynamic range (HDR) image compression, and show the
high-quality results on natural image datasets
Physics-based Shading Reconstruction for Intrinsic Image Decomposition
We investigate the use of photometric invariance and deep learning to compute
intrinsic images (albedo and shading). We propose albedo and shading gradient
descriptors which are derived from physics-based models. Using the descriptors,
albedo transitions are masked out and an initial sparse shading map is
calculated directly from the corresponding RGB image gradients in a
learning-free unsupervised manner. Then, an optimization method is proposed to
reconstruct the full dense shading map. Finally, we integrate the generated
shading map into a novel deep learning framework to refine it and also to
predict corresponding albedo image to achieve intrinsic image decomposition. By
doing so, we are the first to directly address the texture and intensity
ambiguity problems of the shading estimations. Large scale experiments show
that our approach steered by physics-based invariant descriptors achieve
superior results on MIT Intrinsics, NIR-RGB Intrinsics, Multi-Illuminant
Intrinsic Images, Spectral Intrinsic Images, As Realistic As Possible, and
competitive results on Intrinsic Images in the Wild datasets while achieving
state-of-the-art shading estimations.Comment: Submitted to Computer Vision and Image Understanding (CVIU