Face Pose Estimation From Video Sequence Using Dynamic Bayesian Network.

This paper describes a technique to estimate human face pose from colour video sequence using Dynamic Bayesian Network(DBN). As face and facial features trackers usually track eyes, pupils, mouth corners and skin region(face), our proposed method utilizes merely three of these features – pupils, mouth centre and skin region – to compute the evidence for DBN inference

A theoretical eye model for uncalibrated real-time eye gaze estimation

Computer vision systems that monitor human activity can be utilized for many diverse applications. Some general applications stemming from such activity monitoring are surveillance, human-computer interfaces, aids for the handicapped, and virtual reality environments. For most of these applications, a non-intrusive system is desirable, either for reasons of covertness or comfort. Also desirable is generality across users, especially for humancomputer interfaces and surveillance. This thesis presents a method of gaze estimation that, without calibration, determines a relatively unconstrained user’s overall horizontal eye gaze. Utilizing anthropometric data and physiological models, a simple, yet general eye model is presented. The equations that describe the gaze angle of the eye in this model are presented. The procedure for choosing the proper features for gaze estimation is detailed and the algorithms utilized to find these points are described. Results from manual and automatic feature extraction are presented and analyzed. The error observed from this model is around 3± and the error observed from the implementation is around 6±. This amount of error is comparable to previous eye gaze estimation algorithms and it validates this model. The results presented across a set of subjects display consistency, which proves the generality of this model. A real-time implementation that operates around 17 frames per second displays the efficiency of the algorithms implemented. While there are many interesting directions for future work, the goals of this thesis were achieved

Face pose estimation in monocular images

People use orientation of their faces to convey rich, inter-personal information. For example, a person will direct his face to indicate who the intended target of the conversation is. Similarly in a conversation, face orientation is a non-verbal cue to listener when to switch role and start speaking, and a nod indicates that a person has understands, or agrees with, what is being said. Further more, face pose estimation plays an important role in human-computer interaction, virtual reality applications, human behaviour analysis, pose-independent face recognition, driver s vigilance assessment, gaze estimation, etc. Robust face recognition has been a focus of research in computer vision community for more than two decades. Although substantial research has been done and numerous methods have been proposed for face recognition, there remain challenges in this field. One of these is face recognition under varying poses and that is why face pose estimation is still an important research area. In computer vision, face pose estimation is the process of inferring the face orientation from digital imagery. It requires a serious of image processing steps to transform a pixel-based representation of a human face into a high-level concept of direction. An ideal face pose estimator should be invariant to a variety of image-changing factors such as camera distortion, lighting condition, skin colour, projective geometry, facial hairs, facial expressions, presence of accessories like glasses and hats, etc. Face pose estimation has been a focus of research for about two decades and numerous research contributions have been presented in this field. Face pose estimation techniques in literature have still some shortcomings and limitations in terms of accuracy, applicability to monocular images, being autonomous, identity and lighting variations, image resolution variations, range of face motion, computational expense, presence of facial hairs, presence of accessories like glasses and hats, etc. These shortcomings of existing face pose estimation techniques motivated the research work presented in this thesis. The main focus of this research is to design and develop novel face pose estimation algorithms that improve automatic face pose estimation in terms of processing time, computational expense, and invariance to different conditions

A Bayesian hierarchy for robust gaze estimation in human–robot interaction

In this text, we present a probabilistic solution for robust gaze estimation in the context of human–robot interaction. Gaze estimation, in the sense of continuously assessing gaze direction of an interlocutor so as to determine his/her focus of visual attention, is important in several important computer vision applications, such as the development of non-intrusive gaze-tracking equipment for psychophysical experiments in neuroscience, specialised telecommunication devices, video surveillance, human–computer interfaces (HCI) and artificial cognitive systems for human–robot interaction (HRI), our application of interest. We have developed a robust solution based on a probabilistic approach that inherently deals with the uncertainty of sensor models, but also and in particular with uncertainty arising from distance, incomplete data and scene dynamics. This solution comprises a hierarchical formulation in the form of a mixture model that loosely follows how geometrical cues provided by facial features are believed to be used by the human perceptual system for gaze estimation. A quantitative analysis of the proposed framework's performance was undertaken through a thorough set of experimental sessions. Results show that the framework performs according to the difficult requirements of HRI applications, namely by exhibiting correctness, robustness and adaptiveness

A Study on an Automatic System for Analyzing the Facial Beauty of Young Women

A Study on an Automatic System for Analyzing the Facial Beauty of Young Women Neha Sultan Beauty is one of the foremost ideas that define human personality. However, only recently has the concept of beauty been scientifically analyzed. This has mostly been due to extensive research done in the area of face recognition and image processing on identification and classification of human features as contributing to facial beauty. Current research aims at precisely and conclusively understanding how humans classify a given individual's face as beautiful. Due to the lack of published theoretical standards and ground truths for human facial beauty, this is often an ambiguous process. Current methods of analysis and classification of human facial beauty rely mainly on the geometric aspects of human facial beauty. The classifiers used in current research include the k-nearest neighbor algorithm, ridge regression, and basic principal component analysis. In this research, various approaches related to the comprehension and analysis of human beauty are presented and the use of these theories is outlined. Each set of theories is translated into a feature model that is tested for classification. Selecting the best set of features that result in the most accurate model for the representation of the human face is a key challenge. This research introduces the combined use of three main groups of features for classification of female facial beauty, to be used with classification through support vector machines. The classifier utilized is Support Vector Machine (SVM) and the accuracy obtained through this classifier is 86%. Current research in the field has produced algorithms with percentages of accuracy that are in the range of 75-85%. The approach used is one of analysis of the central tenets of beauty, the successive application of image processing techniques, and finally the usage of relevant machine learning methods to build an effective system for the automatic assessment of facial beauty. The ground truths used for verifying results are derived from ratings extracted from surveys conducted. The proposed methodology involves a novel algorithm for the representation of facial beauty, which combines the use of geometric, textural, and shape based features for the analysis of facial beauty. This algorithm initially develops an overall landmark model of the entire human face. A significant advantage of this methodology is the accurate model of the human face which synthesizes the geometric, textural and shape-related aspects of the face. The landmark model is then used for extracting critical characteristics which are then used in a feature vector for training using machine learning. The features extracted help to represent facial characteristics in three major areas. Geometric features help to represent the symmetrical properties and ratio-based properties of landmarks on the face. Textural features extracted help capture information related to skin texture and composition. Finally, face shape and outline features help to categorize the overall shape of a given face, which helps to represent the given female face shape and outline for further analysis of any deviations from the basic face shapes. These features are then used in a classifier to appropriately categorize each image. The database used for the source of images contains images of female subjects from a variety of backgrounds and levels of attractiveness

Unobtrusive and pervasive video-based eye-gaze tracking

Eye-gaze tracking has long been considered a desktop technology that finds its use inside the traditional office setting, where the operating conditions may be controlled. Nonetheless, recent advancements in mobile technology and a growing interest in capturing natural human behaviour have motivated an emerging interest in tracking eye movements within unconstrained real-life conditions, referred to as pervasive eye-gaze tracking. This critical review focuses on emerging passive and unobtrusive video-based eye-gaze tracking methods in recent literature, with the aim to identify different research avenues that are being followed in response to the challenges of pervasive eye-gaze tracking. Different eye-gaze tracking approaches are discussed in order to bring out their strengths and weaknesses, and to identify any limitations, within the context of pervasive eye-gaze tracking, that have yet to be considered by the computer vision community.peer-reviewe