Face Recognition in Real-world Images

Face recognition systems are designed to handle well-aligned images captured under controlled situations. However real-world images present varying orientations, expressions, and illumination conditions. Traditional face recognition algorithms perform poorly on such images. In this paper we present a method for face recognition adapted to real-world conditions that can be trained using very few training examples and is computationally efficient. Our method consists of performing a novel alignment process followed by classification using sparse representation techniques. We present our recognition rates on a difficult dataset that represents real-world faces where we significantly outperform state-of-the-art methods

Multimodal 2D-3D face recognition

Up to date, many advances have been made to 2D face recognition (2D FR) due to its broad range of applications in security and commercial areas as well as in smart devices. However, 2D FR is still quite vulnerable under unconstrained conditions of the image acquisition process. To overcome 2D FR limitations, researchers shift to 3D face recognition technology but this technology is computationally expensive and inapplicable to real-world face recognition systems. Multimodal 2D-3D face recognition can combine the strength of both 2D and 3D modalities. In this paper a multimodal 2D-3D face recognition approach has been proposed based on geometric and textural characteristics of 2D and 3D modalities. The conducted experiments show that the proposed approach achieved promising results with illumination and head pose variations. The performance is evaluated using the landmark Bosphorus facial database

An Evaluation of Forensic Facial Recognition

Recent advances in machine learning and computer vision have led to reported facial recognition accuracies surpassing human performance. We question if these systems will translate to real-world forensic scenarios in which a potentially low-resolution, low-quality, partially-occluded image is compared against a standard facial database. We describe the construction of a large-scale synthetic facial dataset along with a controlled facial forensic lineup, the combination of which allows for a controlled evaluation of facial recognition under a range of real-world conditions. Using this synthetic dataset, and a popular dataset of real faces, we evaluate the accuracy of two popular neural-based recognition systems. We find that previously reported face recognition accuracies of more than 95% drop to as low as 65% in this more challenging forensic scenario

Robust correlated and individual component analysis

© 1979-2012 IEEE.Recovering correlated and individual components of two, possibly temporally misaligned, sets of data is a fundamental task in disciplines such as image, vision, and behavior computing, with application to problems such as multi-modal fusion (via correlated components), predictive analysis, and clustering (via the individual ones). Here, we study the extraction of correlated and individual components under real-world conditions, namely i) the presence of gross non-Gaussian noise and ii) temporally misaligned data. In this light, we propose a method for the Robust Correlated and Individual Component Analysis (RCICA) of two sets of data in the presence of gross, sparse errors. We furthermore extend RCICA in order to handle temporal incongruities arising in the data. To this end, two suitable optimization problems are solved. The generality of the proposed methods is demonstrated by applying them onto 4 applications, namely i) heterogeneous face recognition, ii) multi-modal feature fusion for human behavior analysis (i.e., audio-visual prediction of interest and conflict), iii) face clustering, and iv) thetemporal alignment of facial expressions. Experimental results on 2 synthetic and 7 real world datasets indicate the robustness and effectiveness of the proposed methodson these application domains, outperforming other state-of-the-art methods in the field

FACE RECOGNITION IN AUTHENTIC TIME VIDEOS

Face detection systems are capable of handling well-aligned images captured under controlled situations. However, objects in world and their images present before us varied orientations, mismatched expressions, and well or poor lit conditions. Traditional face detection and recognition algorithms display a below par performance on such images. In this paper, we present a method for face detection and recognition which is adapted to real-world conditions that can be trained using very few training examples and is technically efficient. Our method consists of performing a frontal image alignment process followed by classification using sparse representation techniques. We perform our face detection and recognition based on a realistically simple and feasible algorithm, which are implemented to extract the best performance

A Practical Case Study: Face Recognition on Low Quality Images Using Gabor Wavelet and Support Vector Machines

Face recognition is a problem that arises on many real world applications, such as those related with Ambient Intelligence (AmI). The specific nature and goals of AmI applications, however, requires minimizing the invasiveness of data collection methods, often resulting in a drastic reduction of data quality and a plague of unforeseen effects which can put standard face recognition systems out of action. In order to deal with this, a face recognition system for AmI applications must not only be carefully designed but also subject to an exhaustive configuration plan to ensure it offers the required accuracy, robustness and real-time performance. This document covers the design and tuning of a holistic face recognition system targeting an Ambient Intelligence scenario. It has to work under partially uncontrolled capturing conditions: frontal images with pose variation up to 40 degrees, changing illumination, variable image size and degraded quality. The proposed system is based on Support Vector Machine (SVM) classifiers and applies Gabor Filters intensively. A complete sensitivity analysis shows how the recognition accuracy can be boosted through careful configuration and proper parameter setting, although the most adequate setting depends on the requirements for the final system.This work was supported in part by Projects CICYT TIN2008-06742-C02-02/TSI, CICYT TEC2008-06732-C02-02/TEC, SINPROB,CAMMADRINET S-0505 /TIC/0255 and DPS2008-07029-C02-02.Publicad

ClusterFace: Joint Clustering and Classification for Set-Based Face Recognition

Deep learning technology has enabled successful modeling of complex facial features when high quality images are available. Nonetheless, accurate modeling and recognition of human faces in real world scenarios `on the wild' or under adverse conditions remains an open problem. When unconstrained faces are mapped into deep features, variations such as illumination, pose, occlusion, etc., can create inconsistencies in the resultant feature space. Hence, deriving conclusions based on direct associations could lead to degraded performance. This rises the requirement for a basic feature space analysis prior to face recognition. This paper devises a joint clustering and classification scheme which learns deep face associations in an easy-to-hard way. Our method is based on hierarchical clustering where the early iterations tend to preserve high reliability. The rationale of our method is that a reliable clustering result can provide insights on the distribution of the feature space, that can guide the classification that follows. Experimental evaluations on three tasks, face verification, face identification and rank-order search, demonstrates better or competitive performance compared to the state-of-the-art, on all three experiments