Facial Makeup Detection Using HSV Color Space and Texture Analysis

Facial Makeup Detection Using HSV Color Space and Texture Analysis In recent decades, 2D and 3D face analyses in digital systems have become increasingly important because of their vast applications in security systems or any digital systems that interact with humans. In fact the human face expresses many of the individual’s characteristics such as gender, ethnicity, emotion, age, beauty and health. Makeup is one of the common techniques used by people to alter the appearance of their faces. Analyzing face beauty by computer is essential to aestheticians and computer scientists. The objective of this research is to detect makeup on images of human faces by image processing and pattern recognition techniques. Detecting changes of face, caused by cosmetics such as eye-shadow, lipstick and liquid foundation, are the targets of this study. Having a proper facial database that consists of the information related to makeup is necessary. Collecting the first facial makeup database was a valuable achievement for this research. This database consists of almost 1290 frontal pictures from 21 individuals before and after makeup. Along with the images, meta data such as ethnicity, country of origin, smoking habits, drinking habits, age, and job is provided. The uniqueness of this database stems from, first being the only database that has images of women both before and after makeup, and second because of having light-source from different angles as well as its meta data collected during the process. Selecting the best features that lead to the best classification result is a challenging issue, since any variation in the head pose, lighting conditions and face orientation can add complexity to a proper evaluation of whether any makeup has been applied or not. In addition, the similarity of cosmetic’s color to the skin color adds another level of difficulty. In this effort, by choosing the best possible features, related to edge information, color specification and texture characteristics this problem was addressed. Because hue and saturation and intensity can be studied separately in HSV (Hue, Saturation, and Value) color space, it is selected for this application. The proposed technique is tested on 120 selected images from our new database. A supervised learning model called SVM (Support Vector Machine) classifier is used and the accuracy obtained is 90.62% for eye-shadow detection, 93.33% for lip-stick and 52.5% for liquid foundation detection respectively. A main highlight of this technique is to specify where makeup has been applied on the face, which can be used to identify the proper makeup style for the individual. This application will be a great improvement in the aesthetic field, through which aestheticians can facilitate their work by identifying the type of makeup appropriate for each person and giving the proper suggestions to the person involved by reducing the number of trials

Driver Distraction Identification with an Ensemble of Convolutional Neural Networks

The World Health Organization (WHO) reported 1.25 million deaths yearly due to road traffic accidents worldwide and the number has been continuously increasing over the last few years. Nearly fifth of these accidents are caused by distracted drivers. Existing work of distracted driver detection is concerned with a small set of distractions (mostly, cell phone usage). Unreliable ad-hoc methods are often used.In this paper, we present the first publicly available dataset for driver distraction identification with more distraction postures than existing alternatives. In addition, we propose a reliable deep learning-based solution that achieves a 90% accuracy. The system consists of a genetically-weighted ensemble of convolutional neural networks, we show that a weighted ensemble of classifiers using a genetic algorithm yields in a better classification confidence. We also study the effect of different visual elements in distraction detection by means of face and hand localizations, and skin segmentation. Finally, we present a thinned version of our ensemble that could achieve 84.64% classification accuracy and operate in a real-time environment.Comment: arXiv admin note: substantial text overlap with arXiv:1706.0949

Gender-From-Iris or Gender-From-Mascara?

Predicting a person's gender based on the iris texture has been explored by several researchers. This paper considers several dimensions of experimental work on this problem, including person-disjoint train and test, and the effect of cosmetics on eyelash occlusion and imperfect segmentation. We also consider the use of multi-layer perceptron and convolutional neural networks as classifiers, comparing the use of data-driven and hand-crafted features. Our results suggest that the gender-from-iris problem is more difficult than has so far been appreciated. Estimating accuracy using a mean of N person-disjoint train and test partitions, and considering the effect of makeup - a combination of experimental conditions not present in any previous work - we find a much weaker ability to predict gender-from-iris texture than has been suggested in previous work

May the Best (Looking) Man Win: The Unconscious Role of Attractiveness in Employment Decisions

[Excerpt] In 1972, Karen Dion, Ellen Berscheid, and Elaine Walster set out to determine whether people hold “stereotyped notions of the personality traits possessed by individuals of varying attractiveness.” The results of the study were astonishing: based only on the photographs provided, participants predicted attractive subjects would be happier, possess more socially desirable personalities, practice more prestigious occupations, and exhibit higher marital competence. Their findings were published in an article entitled “What is Beautiful is Good” and gave rise to an enduring theory of the same name. In the decades since the Dion et al. experiment, the “what is beautiful is good” hypothesis has played a particularly meaningful role in occupational studies. Given the high-stakes nature of job acquisition, many researchers have asked, for example, whether attractive job candidates are more likely to be hired than their peers. In short, attractive individuals will receive more job offers, better advancement opportunities, and higher salaries than their less attractive peers—despite numerous findings that they are no more intelligent or capable. This article aims to explore the sources and potential resolution of appearance-based employment decisions. In other words, now that we know appearance-based employment discrimination exists, where does it come from and what do we do about it? Part I examines the psychology of attractiveness, exploring what registers as attractive and what unconscious responses attractiveness commonly evokes. It begins with a definition of beauty in terms of both biological and performed traits and concludes with a discussion of beauty facts versus fictions. Part II provides an overview of existing legal remedies to victims of appearance-based discrimination and explains why legal reform is an ill-suited solution. After ruling out the law, this article concludes that appearance-based employment decisions should be curbed internally, via management and human resources efforts

Facial Image Analysis for Body Mass Index, Makeup and Identity

The principal aim of facial image analysis in computer vision is to extract valuable information(e.g., age, gender, ethnicity, and identity) by interpreting perceived electronic signals from face images. In this dissertation, we develop facial image analysis systems for body mass index (BMI) prediction, makeup detection, as well as facial identity with makeup changes and BMI variations.;BMI is a commonly used measure of body fatness. In the first part of this thesis, we study BMI related topics. At first, we develop a computational method to predict BMI information from face images automatically. We formulate the BMI prediction from facial features as a machine vision problem. Three regression methods, including least square estimation, Gaussian processes for regression, and support vector regression are employed to predict the BMI value. Our preliminary results show that it is feasible to develop a computational system for BMI prediction from face images. Secondly, we address the influence of BMI changes on face identity. Both synthesized and real face images are assembled as the databases to facilitate our study. Empirically, we found that large BMI alterations can significantly reduce the matching accuracy of the face recognition system. Then we study if the influence of BMI changes can be reduced to improve the face recognition performance. The partial least squares (PLS) method is applied for this purpose. Experimental results show the feasibility to develop algorithms to address the influence of facial adiposity variations on face recognition, caused by BMI changes.;Makeup can affect facial appearance obviously. In the second part of this thesis, we deal with makeup influence on face identity. It is principal to perform makeup detection at first to address makeup influence. Four categories of features are proposed to characterize facial makeup cues in our study, including skin color tone, skin smoothness, texture, and highlight. A patch selection scheme and discriminative mapping are presented to enhance the performance of makeup detection. Secondly, we study dual attributes from makeup and non-makeup faces separately to reflect facial appearance changes caused by makeup in a semantic level. Cross-makeup attribute classification and accuracy change analysis is operated to divide dual attributes into four categories according to different makeup effects. To develop a face recognition system that is robust to facial makeup, PLS method is proposed on features extracted from local patches. We also propose a dual-attributes based method for face verification. Shared dual attributes can be used to measure facial similarity, rather than a direct matching with low-level features. Experimental results demonstrate the feasibility to eliminate the influence of makeup on face recognition.;In summary, contributions of this dissertation center in developing facial image analysis systems to deal with newly emerged topics effectively, i.e., BMI prediction, makeup detection, and the rcognition of face identity with makeup and BMI changes. In particular,to the best of our knowledge, BMI related topics, i.e., BMI prediction; the influence of BMI changes on face recognition; and face recognition robust to BMI changes are first explorations to the biometrics society

Learning Face Age Progression: A Pyramid Architecture of GANs

The two underlying requirements of face age progression, i.e. aging accuracy and identity permanence, are not well studied in the literature. In this paper, we present a novel generative adversarial network based approach. It separately models the constraints for the intrinsic subject-specific characteristics and the age-specific facial changes with respect to the elapsed time, ensuring that the generated faces present desired aging effects while simultaneously keeping personalized properties stable. Further, to generate more lifelike facial details, high-level age-specific features conveyed by the synthesized face are estimated by a pyramidal adversarial discriminator at multiple scales, which simulates the aging effects in a finer manner. The proposed method is applicable to diverse face samples in the presence of variations in pose, expression, makeup, etc., and remarkably vivid aging effects are achieved. Both visual fidelity and quantitative evaluations show that the approach advances the state-of-the-art.Comment: CVPR 2018. V4 and V2 are the same, i.e. the conference version; V3 is a related but different work, which is mistakenly submitted and will be submitted as a new arXiv pape