2 research outputs found
Video Face Recognition: Component-wise Feature Aggregation Network (C-FAN)
We propose a new approach to video face recognition. Our component-wise
feature aggregation network (C-FAN) accepts a set of face images of a subject
as an input, and outputs a single feature vector as the face representation of
the set for the recognition task. The whole network is trained in two steps:
(i) train a base CNN for still image face recognition; (ii) add an aggregation
module to the base network to learn the quality value for each feature
component, which adaptively aggregates deep feature vectors into a single
vector to represent the face in a video. C-FAN automatically learns to retain
salient face features with high quality scores while suppressing features with
low quality scores. The experimental results on three benchmark datasets,
YouTube Faces, IJB-A, and IJB-S show that the proposed C-FAN network is capable
of generating a compact feature vector with 512 dimensions for a video sequence
by efficiently aggregating feature vectors of all the video frames to achieve
state of the art performance
On Improving the Generalization of Face Recognition in the Presence of Occlusions
In this paper, we address a key limitation of existing 2D face recognition
methods: robustness to occlusions. To accomplish this task, we systematically
analyzed the impact of facial attributes on the performance of a
state-of-the-art face recognition method and through extensive experimentation,
quantitatively analyzed the performance degradation under different types of
occlusion. Our proposed Occlusion-aware face REcOgnition (OREO) approach
learned discriminative facial templates despite the presence of such
occlusions. First, an attention mechanism was proposed that extracted local
identity-related region. The local features were then aggregated with the
global representations to form a single template. Second, a simple, yet
effective, training strategy was introduced to balance the non-occluded and
occluded facial images. Extensive experiments demonstrated that OREO improved
the generalization ability of face recognition under occlusions by (10.17%) in
a single-image-based setting and outperformed the baseline by approximately
(2%) in terms of rank-1 accuracy in an image-set-based scenario.Comment: Technical Repor