103 research outputs found
A Comparative Evaluation of Heart Rate Estimation Methods using Face Videos
This paper presents a comparative evaluation of methods for remote heart rate
estimation using face videos, i.e., given a video sequence of the face as
input, methods to process it to obtain a robust estimation of the subjects
heart rate at each moment. Four alternatives from the literature are tested,
three based in hand crafted approaches and one based on deep learning. The
methods are compared using RGB videos from the COHFACE database. Experiments
show that the learning-based method achieves much better accuracy than the hand
crafted ones. The low error rate achieved by the learning based model makes
possible its application in real scenarios, e.g. in medical or sports
environments.Comment: Accepted in "IEEE International Workshop on Medical Computing
(MediComp) 2020
Learning Domain Invariant Information to Enhance Presentation Attack Detection in Visible Face Recognition Systems
Face signatures, including size, shape, texture, skin tone, eye color, appearance, and scars/marks, are widely used as discriminative, biometric information for access control. Despite recent advancements in facial recognition systems, presentation attacks on facial recognition systems have become increasingly sophisticated. The ability to detect presentation attacks or spoofing attempts is a pressing concern for the integrity, security, and trust of facial recognition systems. Multi-spectral imaging has been previously introduced as a way to improve presentation attack detection by utilizing sensors that are sensitive to different regions of the electromagnetic spectrum (e.g., visible, near infrared, long-wave infrared). Although multi-spectral presentation attack detection systems may be discriminative, the need for additional sensors and computational resources substantially increases complexity and costs. Instead, we propose a method that exploits information from infrared imagery during training to increase the discriminability of visible-based presentation attack detection systems. We introduce (1) a new cross-domain presentation attack detection framework that increases the separability of bonafide and presentation attacks using only visible spectrum imagery, (2) an inverse domain regularization technique for added training stability when optimizing our cross-domain presentation attack detection framework, and (3) a dense domain adaptation subnetwork to transform representations between visible and non-visible domains.
Adviser: Benjamin Rigga
Deep Models and Shortwave Infrared Information to Detect Face Presentation Attacks
This paper addresses the problem of face presentation attack detection using
different image modalities. In particular, the usage of short wave infrared
(SWIR) imaging is considered. Face presentation attack detection is performed
using recent models based on Convolutional Neural Networks using only carefully
selected SWIR image differences as input. Conducted experiments show superior
performance over similar models acting on either color images or on a
combination of different modalities (visible, NIR, thermal and depth), as well
as on a SVM-based classifier acting on SWIR image differences. Experiments have
been carried on a new public and freely available database, containing a wide
variety of attacks. Video sequences have been recorded thanks to several
sensors resulting in 14 different streams in the visible, NIR, SWIR and thermal
spectra, as well as depth data. The best proposed approach is able to almost
perfectly detect all impersonation attacks while ensuring low bonafide
classification errors. On the other hand, obtained results show that
obfuscation attacks are more difficult to detect. We hope that the proposed
database will foster research on this challenging problem. Finally, all the
code and instructions to reproduce presented experiments is made available to
the research community
Deep Learning for Face Anti-Spoofing: A Survey
Face anti-spoofing (FAS) has lately attracted increasing attention due to its
vital role in securing face recognition systems from presentation attacks
(PAs). As more and more realistic PAs with novel types spring up, traditional
FAS methods based on handcrafted features become unreliable due to their
limited representation capacity. With the emergence of large-scale academic
datasets in the recent decade, deep learning based FAS achieves remarkable
performance and dominates this area. However, existing reviews in this field
mainly focus on the handcrafted features, which are outdated and uninspiring
for the progress of FAS community. In this paper, to stimulate future research,
we present the first comprehensive review of recent advances in deep learning
based FAS. It covers several novel and insightful components: 1) besides
supervision with binary label (e.g., '0' for bonafide vs. '1' for PAs), we also
investigate recent methods with pixel-wise supervision (e.g., pseudo depth
map); 2) in addition to traditional intra-dataset evaluation, we collect and
analyze the latest methods specially designed for domain generalization and
open-set FAS; and 3) besides commercial RGB camera, we summarize the deep
learning applications under multi-modal (e.g., depth and infrared) or
specialized (e.g., light field and flash) sensors. We conclude this survey by
emphasizing current open issues and highlighting potential prospects.Comment: IEEE Transactions on Pattern Analysis and Machine Intelligence
(TPAMI
Face Anti-Spoofing by Learning Polarization Cues in a Real-World Scenario
Face anti-spoofing is the key to preventing security breaches in biometric
recognition applications. Existing software-based and hardware-based face
liveness detection methods are effective in constrained environments or
designated datasets only. Deep learning method using RGB and infrared images
demands a large amount of training data for new attacks. In this paper, we
present a face anti-spoofing method in a real-world scenario by automatic
learning the physical characteristics in polarization images of a real face
compared to a deceptive attack. A computational framework is developed to
extract and classify the unique face features using convolutional neural
networks and SVM together. Our real-time polarized face anti-spoofing (PAAS)
detection method uses a on-chip integrated polarization imaging sensor with
optimized processing algorithms. Extensive experiments demonstrate the
advantages of the PAAS technique to counter diverse face spoofing attacks
(print, replay, mask) in uncontrolled indoor and outdoor conditions by learning
polarized face images of 33 people. A four-directional polarized face image
dataset is released to inspire future applications within biometric
anti-spoofing field.Comment: 14pages,8figure
- …