Face Attribute Prediction Using Off-the-Shelf CNN Features

Predicting attributes from face images in the wild is a challenging computer vision problem. To automatically describe face attributes from face containing images, traditionally one needs to cascade three technical blocks --- face localization, facial descriptor construction, and attribute classification --- in a pipeline. As a typical classification problem, face attribute prediction has been addressed using deep learning. Current state-of-the-art performance was achieved by using two cascaded Convolutional Neural Networks (CNNs), which were specifically trained to learn face localization and attribute description. In this paper, we experiment with an alternative way of employing the power of deep representations from CNNs. Combining with conventional face localization techniques, we use off-the-shelf architectures trained for face recognition to build facial descriptors. Recognizing that the describable face attributes are diverse, our face descriptors are constructed from different levels of the CNNs for different attributes to best facilitate face attribute prediction. Experiments on two large datasets, LFWA and CelebA, show that our approach is entirely comparable to the state-of-the-art. Our findings not only demonstrate an efficient face attribute prediction approach, but also raise an important question: how to leverage the power of off-the-shelf CNN representations for novel tasks.Comment: In proceeding of 2016 International Conference on Biometrics (ICB

Privacy Protection Performance of De-identified Face Images with and without Background

Li Meng, 'Privacy Protection Performance of De-identified Face Images with and without Background', paper presented at the 39th International Information and Communication Technology (ICT) Convention. Grand Hotel Adriatic Congress Centre and Admiral Hotel, Opatija, Croatia, May 30 - June 3, 2016.This paper presents an approach to blending a de-identified face region with its original background, for the purpose of completing the process of face de-identification. The re-identification risk of the de-identified FERET face images has been evaluated for the k-Diff-furthest face de-identification method, using several face recognition benchmark methods including PCA, LBP, HOG and LPQ. The experimental results show that the k-Diff-furthest face de-identification delivers high privacy protection within the face region while blending the de-identified face region with its original background may significantly increases the re-identification risk, indicating that de-identification must also be applied to image areas beyond the face region

Self-supervised learning of a facial attribute embedding from video

We propose a self-supervised framework for learning facial attributes by simply watching videos of a human face speaking, laughing, and moving over time. To perform this task, we introduce a network, Facial Attributes-Net (FAb-Net), that is trained to embed multiple frames from the same video face-track into a common low-dimensional space. With this approach, we make three contributions: first, we show that the network can leverage information from multiple source frames by predicting confidence/attention masks for each frame; second, we demonstrate that using a curriculum learning regime improves the learned embedding; finally, we demonstrate that the network learns a meaningful face embedding that encodes information about head pose, facial landmarks and facial expression, i.e. facial attributes, without having been supervised with any labelled data. We are comparable or superior to state-of-the-art self-supervised methods on these tasks and approach the performance of supervised methods.Comment: To appear in BMVC 2018. Supplementary material can be found at http://www.robots.ox.ac.uk/~vgg/research/unsup_learn_watch_faces/fabnet.htm

Large- Scale Content Based Face Image Retrieval using Attribute Enhanced Sparse Codewords.

Content based image retrieval (CBIR) have turn into majority dynamic exploration regions within previous couple of existence. Numerous index strategies be in light of worldwide component circulations. Be that as it may, these worldwide circulations have restricted segregating force since they are not able to catch nearby picture data. Photographs with individuals are the foremost attention of users. Consequently with exponentially increasing pictures, huge size contented base features representation recovery is a facilitating knowledge in favor of various developing applications. The main objective is to apply automatically spotted human characteristics that comprise semantic cue of facade pictures toward increase gratified base facade recovery through creating semantic codeword pro effectual huge size countenance recovery. With leveraging person characteristics into scalable as well as methodical structure, suggest and offer two orthogonal systems named attribute improved meager code and attribute entrenched upturned index toward develop facade recovery. We compare proposed method with other three methods namely LBP, ATTR and SC methods. The results illustrate that the proposed methods can attain qualified enhancement in Mean Average Precision (MAP) associated to the existing methods. DOI: 10.17762/ijritcc2321-8169.15084