44 research outputs found
Fast Preprocessing for Robust Face Sketch Synthesis
Exemplar-based face sketch synthesis methods usually meet the challenging
problem that input photos are captured in different lighting conditions from
training photos. The critical step causing the failure is the search of similar
patch candidates for an input photo patch. Conventional illumination invariant
patch distances are adopted rather than directly relying on pixel intensity
difference, but they will fail when local contrast within a patch changes. In
this paper, we propose a fast preprocessing method named Bidirectional
Luminance Remapping (BLR), which interactively adjust the lighting of training
and input photos. Our method can be directly integrated into state-of-the-art
exemplar-based methods to improve their robustness with ignorable computational
cost.Comment: IJCAI 2017. Project page:
http://www.cs.cityu.edu.hk/~yibisong/ijcai17_sketch/index.htm
Learning to Hallucinate Face Images via Component Generation and Enhancement
We propose a two-stage method for face hallucination. First, we generate
facial components of the input image using CNNs. These components represent the
basic facial structures. Second, we synthesize fine-grained facial structures
from high resolution training images. The details of these structures are
transferred into facial components for enhancement. Therefore, we generate
facial components to approximate ground truth global appearance in the first
stage and enhance them through recovering details in the second stage. The
experiments demonstrate that our method performs favorably against
state-of-the-art methodsComment: IJCAI 2017. Project page:
http://www.cs.cityu.edu.hk/~yibisong/ijcai17_sr/index.htm
Video Face Super-Resolution with Motion-Adaptive Feedback Cell
Video super-resolution (VSR) methods have recently achieved a remarkable
success due to the development of deep convolutional neural networks (CNN).
Current state-of-the-art CNN methods usually treat the VSR problem as a large
number of separate multi-frame super-resolution tasks, at which a batch of low
resolution (LR) frames is utilized to generate a single high resolution (HR)
frame, and running a slide window to select LR frames over the entire video
would obtain a series of HR frames. However, duo to the complex temporal
dependency between frames, with the number of LR input frames increase, the
performance of the reconstructed HR frames become worse. The reason is in that
these methods lack the ability to model complex temporal dependencies and hard
to give an accurate motion estimation and compensation for VSR process. Which
makes the performance degrade drastically when the motion in frames is complex.
In this paper, we propose a Motion-Adaptive Feedback Cell (MAFC), a simple but
effective block, which can efficiently capture the motion compensation and feed
it back to the network in an adaptive way. Our approach efficiently utilizes
the information of the inter-frame motion, the dependence of the network on
motion estimation and compensation method can be avoid. In addition, benefiting
from the excellent nature of MAFC, the network can achieve better performance
in the case of extremely complex motion scenarios. Extensive evaluations and
comparisons validate the strengths of our approach, and the experimental
results demonstrated that the proposed framework is outperform the
state-of-the-art methods.Comment: To appear in AAAI 202
A survey on heterogeneous face recognition: Sketch, infra-red, 3D and low-resolution
Heterogeneous face recognition (HFR) refers to matching face imagery across different domains. It has received much interest from the research community as a result of its profound implications in law enforcement. A wide variety of new invariant features, cross-modality matching models and heterogeneous datasets are being established in recent years. This survey provides a comprehensive review of established techniques and recent developments in HFR. Moreover, we offer a detailed account of datasets and benchmarks commonly used for evaluation. We finish by assessing the state of the field and discussing promising directions for future research