36,130 research outputs found
Mask-ShadowGAN: Learning to Remove Shadows from Unpaired Data
This paper presents a new method for shadow removal using unpaired data,
enabling us to avoid tedious annotations and obtain more diverse training
samples. However, directly employing adversarial learning and cycle-consistency
constraints is insufficient to learn the underlying relationship between the
shadow and shadow-free domains, since the mapping between shadow and
shadow-free images is not simply one-to-one. To address the problem, we
formulate Mask-ShadowGAN, a new deep framework that automatically learns to
produce a shadow mask from the input shadow image and then takes the mask to
guide the shadow generation via re-formulated cycle-consistency constraints.
Particularly, the framework simultaneously learns to produce shadow masks and
learns to remove shadows, to maximize the overall performance. Also, we
prepared an unpaired dataset for shadow removal and demonstrated the
effectiveness of Mask-ShadowGAN on various experiments, even it was trained on
unpaired data.Comment: Accepted to ICCV 201
Beyond Low Rank + Sparse: Multi-scale Low Rank Matrix Decomposition
We present a natural generalization of the recent low rank + sparse matrix
decomposition and consider the decomposition of matrices into components of
multiple scales. Such decomposition is well motivated in practice as data
matrices often exhibit local correlations in multiple scales. Concretely, we
propose a multi-scale low rank modeling that represents a data matrix as a sum
of block-wise low rank matrices with increasing scales of block sizes. We then
consider the inverse problem of decomposing the data matrix into its
multi-scale low rank components and approach the problem via a convex
formulation. Theoretically, we show that under various incoherence conditions,
the convex program recovers the multi-scale low rank components \revised{either
exactly or approximately}. Practically, we provide guidance on selecting the
regularization parameters and incorporate cycle spinning to reduce blocking
artifacts. Experimentally, we show that the multi-scale low rank decomposition
provides a more intuitive decomposition than conventional low rank methods and
demonstrate its effectiveness in four applications, including illumination
normalization for face images, motion separation for surveillance videos,
multi-scale modeling of the dynamic contrast enhanced magnetic resonance
imaging and collaborative filtering exploiting age information
- …