Effects of exposure to facial expression variation in face learning and recognition.

Facial expression is a major source of image variation in face images. Linking numerous expressions to the same face can be a huge challenge for face learning and recognition. It remains largely unknown what level of exposure to this image variation is critical for expression-invariant face recognition. We examined this issue in a recognition memory task, where the number of facial expressions of each face being exposed during a training session was manipulated. Faces were either trained with multiple expressions or a single expression, and they were later tested in either the same or different expressions. We found that recognition performance after learning three emotional expressions had no improvement over learning a single emotional expression (Experiments 1 and 2). However, learning three emotional expressions improved recognition compared to learning a single neutral expression (Experiment 3). These findings reveal both the limitation and the benefit of multiple exposures to variations of emotional expression in achieving expression-invariant face recognition. The transfer of expression training to a new type of expression is likely to depend on a relatively extensive level of training and a certain degree of variation across the types of expressions

The Effect of Real-World Personal Familiarity on the Speed of Face Information Processing

Background. Previous studies have explored the effects of familiarity on various kinds of visual face judgments, yet the role of familiarity in face processing is not fully understood. Across different face judgments and stimulus sets, the data is equivocal as to whether or not familiarity impacts recognition processes. Methodology/Principal Findings. Here, we examine the effect of real-world personal familiarity in three simple delayed-match-to-sample tasks in which subjects were required to match faces on the basis of orientation (upright v. inverted), gender and identity. We find that subjects had a significant speed advantage with familiar faces in all three tasks, with large effects for the gender and identity matching tasks. Conclusion/Significance. Our data indicates that real-world experience with a face exerts a powerful influence on face processing in tasks where identity information is irrelevant, even in tasks that could in principle be solved via low-level cues. These results underscore the importance of experience in shaping visual recognition processes

A visual processing advantage for young-adolescent deaf observers: Evidence from face and object matching tasks

It is unresolved whether the permanent auditory deprivation that deaf people experience leads to the enhanced visual processing of faces. The current study explored this question with a matching task in which observers searched for a target face among a concurrent lineup of ten faces. This was compared with a control task in which the same stimuli were presented upside down, to disrupt typical face processing, and an object matching task. A sample of young-adolescent deaf observers performed with higher accuracy than hearing controls across all of these tasks. These results clarify previous findings and provide evidence for a general visual processing advantage in deaf observers rather than a face-specific effect

InterFace : A software package for face image warping, averaging, and principal components analysis

We describe InterFace, a software package for research in face recognition. The package supports image warping, reshaping, averaging of multiple face images, and morphing between faces. It also supports principal components analysis (PCA) of face images, along with tools for exploring the “face space” produced by PCA. The package uses a simple graphical user interface, allowing users to perform these sophisticated image manipulations without any need for programming knowledge. The program is available for download in the form of an app, which requires that users also have access to the (freely available) MATLAB Runtime environment

Task-Specific Codes for Face Recognition: How they Shape the Neural Representation of Features for Detection and Individuation

The variety of ways in which faces are categorized makes face recognition challenging for both synthetic and biological vision systems. Here we focus on two face processing tasks, detection and individuation, and explore whether differences in task demands lead to differences both in the features most effective for automatic recognition and in the featural codes recruited by neural processing.Our study appeals to a computational framework characterizing the features representing object categories as sets of overlapping image fragments. Within this framework, we assess the extent to which task-relevant information differs across image fragments. Based on objective differences we find among task-specific representations, we test the sensitivity of the human visual system to these different face descriptions independently of one another. Both behavior and functional magnetic resonance imaging reveal effects elicited by objective task-specific levels of information. Behaviorally, recognition performance with image fragments improves with increasing task-specific information carried by different face fragments. Neurally, this sensitivity to the two tasks manifests as differential localization of neural responses across the ventral visual pathway. Fragments diagnostic for detection evoke larger neural responses than non-diagnostic ones in the right posterior fusiform gyrus and bilaterally in the inferior occipital gyrus. In contrast, fragments diagnostic for individuation evoke larger responses than non-diagnostic ones in the anterior inferior temporal gyrus. Finally, for individuation only, pattern analysis reveals sensitivity to task-specific information within the right "fusiform face area".OUR RESULTS DEMONSTRATE: 1) information diagnostic for face detection and individuation is roughly separable; 2) the human visual system is independently sensitive to both types of information; 3) neural responses differ according to the type of task-relevant information considered. More generally, these findings provide evidence for the computational utility and the neural validity of fragment-based visual representation and recognition

Do intoxicated witnesses produce poor facial composite images?

The effect of alcohol intoxication on witness memory and performance has been the subject of research for some time, however, whether intoxication affects facial composite construction has not been investigated. Intoxication was predicted to adversely affect facial composite construction. Thirty-two participants were allocated to one of four beverage conditions consisting of factorial combinations of alcohol or placebo at face encoding, and later construction. Participants viewed a video of a target person and constructed a composite of this target the following day. The resulting images were presented as a full face composite, or a part face consisting of either internal or external facial features to a second sample of participants who provided likeness ratings as a measure of facial composite quality. Intoxication at face encoding had a detrimental impact on the quality of facial composites produced the following day, suggesting that alcohol impaired the encoding of the target faces. The common finding that external compared to internal features are more accurately represented was demonstrated, even following alcohol at encoding. This finding was moderated by alcohol and target face gender such that alcohol at face encoding resulted in reduced likeness of external features for male composite faces only. Moderate alcohol intoxication impairs the quality of facial composites, adding to existing literature demonstrating little effect of alcohol on line-up studies. The impact of intoxication on face perception mechanisms, and the apparent narrowing of processing to external face areas such as hair, is discussed in the context of alcohol myopia theory

Natural Image Coding in V1: How Much Use is Orientation Selectivity?

Orientation selectivity is the most striking feature of simple cell coding in V1 which has been shown to emerge from the reduction of higher-order correlations in natural images in a large variety of statistical image models. The most parsimonious one among these models is linear Independent Component Analysis (ICA), whereas second-order decorrelation transformations such as Principal Component Analysis (PCA) do not yield oriented filters. Because of this finding it has been suggested that the emergence of orientation selectivity may be explained by higher-order redundancy reduction. In order to assess the tenability of this hypothesis, it is an important empirical question how much more redundancies can be removed with ICA in comparison to PCA, or other second-order decorrelation methods. This question has not yet been settled, as over the last ten years contradicting results have been reported ranging from less than five to more than hundred percent extra gain for ICA. Here, we aim at resolving this conflict by presenting a very careful and comprehensive analysis using three evaluation criteria related to redundancy reduction: In addition to the multi-information and the average log-loss we compute, for the first time, complete rate-distortion curves for ICA in comparison with PCA. Without exception, we find that the advantage of the ICA filters is surprisingly small. Furthermore, we show that a simple spherically symmetric distribution with only two parameters can fit the data even better than the probabilistic model underlying ICA. Since spherically symmetric models are agnostic with respect to the specific filter shapes, we conlude that orientation selectivity is unlikely to play a critical role for redundancy reduction

Feature instructions improve face-matching accuracy

Identity comparisons of photographs of unfamiliar faces are prone to error but important for applied settings, such as person identification at passport control. Finding techniques to improve face-matching accuracy is therefore an important contemporary research topic. This study investigated whether matching accuracy can be improved by instruction to attend to specific facial features. Experiment 1 showed that instruction to attend to the eyebrows enhanced matching accuracy for optimized same-day same-race face pairs but not for other-race faces. By contrast, accuracy was unaffected by instruction to attend to the eyes, and declined with instruction to attend to ears. Experiment 2 replicated the eyebrow-instruc- tion improvement with a different set of same-race faces, comprising both optimized same- day and more challenging different-day face pairs. These findings suggest that instruction to attend to specific features can enhance face-matching accuracy, but feature selection is cru- cial and generalization across face sets may be limited

Viewing it differently: Social scene perception in Williams syndrome and Autism

The genetic disorder Williams syndrome (WS) is associated with a propulsion towards social stimuli and interactions with people. In contrast, the neuro-developmental disorder autism is characterised by social withdrawal and lack of interest in socially relevant information. Using eye-tracking techniques we investigate how individuals with these two neuro-developmental disorders associated with distinct social characteristics view scenes containing people. The way individuals with these disorders view social stimuli may impact upon successful social interactions and communication. Whilst individuals with autism spend less time than is typical viewing people and faces in static pictures of social interactions, the opposite is apparent for those with WS whereby exaggerated fixations are prevalent towards the eyes. The results suggest more attention should be drawn towards understanding the implications of atypical social preferences in WS, in the same way that attention has been drawn to the social deficits associated with autism