Facial Component Detection in Thermal Imagery

This paper studies the problem of detecting facial components in thermal imagery (specifically eyes, nostrils and mouth). One of the immediate goals is to enable the automatic registration of facial thermal images. The detection of eyes and nostrils is performed using Haar features and the GentleBoost algorithm, which are shown to provide superior detection rates. The detection of the mouth is based on the detections of the eyes and the nostrils and is performed using measures of entropy and self similarity. The results show that reliable facial component detection is feasible using this methodology, getting a correct detection rate for both eyes and nostrils of 0.8. A correct eyes and nostrils detection enables a correct detection of the mouth in 65% of closed-mouth test images and in 73% of open-mouth test images

Proximity and gaze influences facial temperature:a thermal infrared imaging study

Direct gaze and interpersonal proximity are known to lead to changes in psycho-physiology, behaviour and brain function. We know little, however, about subtler facial reactions such as rise and fall in temperature, which may be sensitive to contextual effects and functional in social interactions. Using thermal infrared imaging cameras 18 female adult participants were filmed at two interpersonal distances (intimate and social) and two gaze conditions (averted and direct). The order of variation in distance was counterbalanced: half the participants experienced a female experimenter’s gaze at the social distance first before the intimate distance (a socially ‘normal’ order) and half experienced the intimate distance first and then the social distance (an odd social order). At both distances averted gaze always preceded direct gaze. We found strong correlations in thermal changes between six areas of the face (forehead, chin, cheeks, nose, maxilliary and periorbital regions) for all experimental conditions and developed a composite measure of thermal shifts for all analyses. Interpersonal proximity led to a thermal rise, but only in the ‘normal’ social order. Direct gaze, compared to averted gaze, led to a thermal increase at both distances with a stronger effect at intimate distance, in both orders of distance variation. Participants reported direct gaze as more intrusive than averted gaze, especially at the intimate distance. These results demonstrate the powerful effects of another person’s gaze on psycho-physiological responses, even at a distance and independent of context

Thermal Vision as a Method of Detection of Deception: A review of experiences

From introduction: "Turning pale or red in the face, besides expressive movements (mimic and pantomimic) belonged to the earliest observed symptoms of emotions, which sometimes were even directly treated as symptoms of the lie (Trovillio 1938/1939, Eysenck 1971). Th anks to experimental psychology and physiology, since the end of the 19th and early 20th centuries they have been known to result from changes in the blood supply to the face related to the functioning of the circulatory system, movement of muscles, and chemical changes in the blood and its energetic value (dependent on the amount of oxygen, catecholamines, etc.), a knowledge embracing also the fact that physiological changes accompanying emotions encompass the entire organism and are clearly correlated. Th us, theoretically, it suffi ces to observe any fragment of the organism to detect emotions, and the number of physiological correlates of emotions, if not unlimited, is certainly very large. Some of them are clearly visible for an external observer (for example, the expressive movements, blanching, blushing, tremors, etc.). Others can be observed only with specialist devices, with polygraph being the best known among them. "(...

Automatic blush detection in ‘concealed information’ test using visual stimuli

Blushing has been identified as an indicator of deception, shame, anxiety and embarrassment. Although normally associated with the skin coloration of the face, a blush response also affects skin surface temperature. In this paper, an approach to detect a blush response automatically is presented using the Argus P7225 thermal camera from e2v. The algorithm was tested on a sample population of 51 subjects, while using visual stimuli to elicit a response, and achieved recognition rates of ~77% TPR and ~60% TNR, indicating a thermal image sensor is the prospective device to pick up subtle temperature change synchronised with stimuli

A Review of Applied Techniques of the Detection of Criminal Deceit

The techniques of the detection of criminal deceit, including lie-detection technique and true-detection technique, are involved in determination and evaluation of response to specific information in the guilt knowledge. Under the support of a theory of emotion, a theory of control, a theory of cognitive processing and a theory of self-expression in the contemporary applied psychology and judicial psychology, this technique system has developed a psychophysiological technique, a non-verbal technique, a verbal technique, a brain scanning technique and a strategic use of evidence etc. Based on different aspects of deceit psychology, the techniques of the detection are explored from different mechanisms. With the support of judicial experience, and foundation from the empirical researches on physiology-psychology, cerebral nerve and other aspects, the techniques have validity and reliability at a different level.

Establishing a Foundation for Automated Human Credibility Screening

Automated human credibility screening is an emerging research area that has potential for high impact in fields as diverse as homeland security and accounting fraud detection. Systems that conduct interviews and make credibility judgments can provide objectivity, improved accuracy, and greater reliability to credibility assessment practices, need to be built. This study establishes a foundation for developing automated systems for human credibility screening

Automatic Measurement of Affect in Dimensional and Continuous Spaces: Why, What, and How?

This paper aims to give a brief overview of the current state-of-the-art in automatic measurement of affect signals in dimensional and continuous spaces (a continuous scale from -1 to +1) by seeking answers to the following questions: i) why has the field shifted towards dimensional and continuous interpretations of affective displays recorded in real-world settings? ii) what are the affect dimensions used, and the affect signals measured? and iii) how has the current automatic measurement technology been developed, and how can we advance the field