Is gender encoded in the smile? A computational framework for the analysis of the smile driven dynamic face for gender recognition

YesAutomatic gender classification has become a topic of great interest to the visual computing research community in recent times. This is due to the fact that computer-based automatic gender recognition has multiple applications including, but not limited to, face perception, age, ethnicity, identity analysis, video surveillance and smart human computer interaction. In this paper, we discuss a machine learning approach for efficient identification of gender purely from the dynamics of a person’s smile. Thus, we show that the complex dynamics of a smile on someone’s face bear much relation to the person’s gender. To do this, we first formulate a computational framework that captures the dynamic characteristics of a smile. Our dynamic framework measures changes in the face during a smile using a set of spatial features on the overall face, the area of the mouth, the geometric flow around prominent parts of the face and a set of intrinsic features based on the dynamic geometry of the face. This enables us to extract 210 distinct dynamic smile parameters which form as the contributing features for machine learning. For machine classification, we have utilised both the Support Vector Machine and the k-Nearest Neighbour algorithms. To verify the accuracy of our approach, we have tested our algorithms on two databases, namely the CK+ and the MUG, consisting of a total of 109 subjects. As a result, using the k-NN algorithm, along with tenfold cross validation, for example, we achieve an accurate gender classification rate of over 85%. Hence, through the methodology we present here, we establish proof of the existence of strong indicators of gender dimorphism, purely in the dynamics of a person’s smile

Incidental retrieval of prior emotion mimicry.

When observing emotional expressions, similar sensorimotor states are activated in the observer, often resulting in physical mimicry. For example, when observing a smile, the zygomaticus muscles associated with smiling are activated in the observer, and when observing a frown, the corrugator brow muscles. We show that the consistency of an individual's facial emotion, whether they always frown or smile, can be encoded into memory. When the individuals are viewed at a later time expressing no emotion, muscle mimicry of the prior state can be detected, even when the emotion itself is task irrelevant. The results support simulation accounts of memory, where prior embodiments of other's states during encoding are reactivated when re-encountering a person

First report of generalized face processing difficulties in möbius sequence.

Reverse simulation models of facial expression recognition suggest that we recognize the emotions of others by running implicit motor programmes responsible for the production of that expression. Previous work has tested this theory by examining facial expression recognition in participants with Möbius sequence, a condition characterized by congenital bilateral facial paralysis. However, a mixed pattern of findings has emerged, and it has not yet been tested whether these individuals can imagine facial expressions, a process also hypothesized to be underpinned by proprioceptive feedback from the face. We investigated this issue by examining expression recognition and imagery in six participants with Möbius sequence, and also carried out tests assessing facial identity and object recognition, as well as basic visual processing. While five of the six participants presented with expression recognition impairments, only one was impaired at the imagery of facial expressions. Further, five participants presented with other difficulties in the recognition of facial identity or objects, or in lower-level visual processing. We discuss the implications of our findings for the reverse simulation model, and suggest that facial identity recognition impairments may be more severe in the condition than has previously been noted

Facial mimcry and emotion consistency : Influences of memory and context.

This study investigates whether mimicry of facial emotions is a stable response or can instead be modulated and influenced by memory of the context in which the emotion was initially observed, and therefore the meaning of the expression. The study manipulated emotion consistency implicitly, where a face expressing smiles or frowns was irrelevant and to be ignored while participants categorised target scenes. Some face identities always expressed emotions consistent with the scene (e.g., smiling with a positive scene), whilst others were always inconsistent (e.g., frowning with a positive scene). During this implicit learning of face identity and emotion consistency there was evidence for encoding of face-scene emotion consistency, with slower RTs, a reduction in trust, and inhibited facial EMG for faces expressing incompatible emotions. However, in a later task where the faces were subsequently viewed expressing emotions with no additional context, there was no evidence for retrieval of prior emotion consistency, as mimicry of emotion was similar for consistent and inconsistent individuals. We conclude that facial mimicry can be influenced by current emotion context, but there is little evidence of learning, as subsequent mimicry of emotionally consistent and inconsistent faces is similar

Total immersion : Designing for affective symbiosis in a virtual reality game with haptics, biosensors, and emotive agents

Peer reviewe

The development of spontaneous facial responses to others’ emotions in infancy. An EMG study

Viewing facial expressions often evokes facial responses in the observer. These spontaneous facial reactions (SFRs) are believed to play an important role for social interactions. However, their developmental trajectory and the underlying neurocognitive mechanisms are still little understood. In the current study, 4- and 7-month old infants were presented with facial expressions of happiness, anger, and fear. Electromyography (EMG) was used to measure activation in muscles relevant for forming these expressions: zygomaticus major (smiling), corrugator supercilii (frowning), and frontalis (forehead raising). The results indicated no selective activation of the facial muscles for the expressions in 4-month-old infants. For 7-month-old infants, evidence for selective facial reactions was found especially for happy faces (leading to increased zygomaticus major activation) and fearful faces (leading to increased frontalis activation), while angry faces did not show a clear differential response. This suggests that emotional SFRs may be the result of complex neurocognitive mechanisms which lead to partial mimicry but are also likely to be influenced by evaluative processes. Such mechanisms seem to undergo important developments at least until the second half of the first year of life

You turn me cold: evidence for temperature contagion

Introduction During social interactions, our own physiological responses influence those of others. Synchronization of physiological (and behavioural) responses can facilitate emotional understanding and group coherence through inter-subjectivity. Here we investigate if observing cues indicating a change in another's body temperature results in a corresponding temperature change in the observer. Methods Thirty-six healthy participants (age; 22.9±3.1 yrs) each observed, then rated, eight purpose-made videos (3 min duration) that depicted actors with either their right or left hand in visibly warm (warm videos) or cold water (cold videos). Four control videos with the actors' hand in front of the water were also shown. Temperature of participant observers' right and left hands was concurrently measured using a thermistor within a Wheatstone bridge with a theoretical temperature sensitivity of <0.0001°C. Temperature data were analysed in a repeated measures ANOVA (temperature × actor's hand × observer's hand). Results Participants rated the videos showing hands immersed in cold water as being significantly cooler than hands immersed in warm water, F(1,34) = 256.67, p0.1). There was however no evidence of left-right mirroring of these temperature effects p>0.1). Sensitivity to temperature contagion was also predicted by inter-individual differences in self-report empathy. Conclusions We illustrate physiological contagion of temperature in healthy individuals, suggesting that empathetic understanding for primary low-level physiological challenges (as well as more complex emotions) are grounded in somatic simulation

Motor signatures of emotional reactivity in frontotemporal dementia

Automatic motor mimicry is essential to the normal processing of perceived emotion, and disrupted automatic imitation might underpin socio-emotional deficits in neurodegenerative diseases, particularly the frontotemporal dementias. However, the pathophysiology of emotional reactivity in these diseases has not been elucidated. We studied facial electromyographic responses during emotion identification on viewing videos of dynamic facial expressions in 37 patients representing canonical frontotemporal dementia syndromes versus 21 healthy older individuals. Neuroanatomical associations of emotional expression identification accuracy and facial muscle reactivity were assessed using voxel-based morphometry. Controls showed characteristic profiles of automatic imitation, and this response predicted correct emotion identification. Automatic imitation was reduced in the behavioural and right temporal variant groups, while the normal coupling between imitation and correct identification was lost in the right temporal and semantic variant groups. Grey matter correlates of emotion identification and imitation were delineated within a distributed network including primary visual and motor, prefrontal, insular, anterior temporal and temporo-occipital junctional areas, with common involvement of supplementary motor cortex across syndromes. Impaired emotional mimesis may be a core mechanism of disordered emotional signal understanding and reactivity in frontotemporal dementia, with implications for the development of novel physiological biomarkers of socio-emotional dysfunction in these diseases

Dicer and miRNA in relation to clinicopathological variables in colorectal cancer patients

<p>Abstract</p> <p>Background</p> <p>Dicer is aberrantly expressed in several types of cancers. Applying real-time PCR, we detected the expression of Dicer mRNA in normal mucosa (n = 162), primary colorectal cancer (CRC) (n = 162) and liver metastasis (n = 37), and analysed the relationship between Dicer expression and clinicopathological features. We also correlated the expression of Dicer mRNA to the miRNA expression of miR-141, miR-200a, miR-200b, mir-200c and miR-429 in liver metastases.</p> <p>Methods</p> <p>RT-PCR and qPCR were used to analyse the Dicer expression in normal mucosa, primary tumour and liver metastasis by using the High Capacity cDNA Reverse Transcription Kit and TaqMan™^®Gene Expression assays for <it>Dicer </it>and <it>GAPDH</it>. RT-PCR and qPCR were used to detect miRNA expression in liver metastases by utilizing TaqMan^®MicroRNA Reverse Transcription Kit and TaqMan^®miRNA Assays. Statistical analyses were performed with STATISTICA.</p> <p>Results</p> <p>Dicer expression in rectal cancer (3.146 ± 0.953) was higher than in colon cancer (2.703 ± 1.204, P = 0.018). Furthermore the Dicer expression was increased in primary tumours (3.146 ± 0.952) in comparison to that in normal mucosa from rectal cancer patients (2.816 ± 1.009, P = 0.034) but this is not evident in colon cancer patients. Dicer expression in liver metastases was decreased in comparison to that of either normal mucosa or primary tumour in both colon and rectal cancers (P < 0.05). Patients with a high Dicer expression in normal mucosa had a worse prognosis compared to those with a low Dicer expression, independently of gender, age, tumour site, stage and differentiation (P < 0.001, RR 3.682, 95% CI 1.749 - 7.750). In liver metastases, Dicer was positively related to miR-141 (R = 0.419, P = 0.015).</p> <p>Conclusion</p> <p>Dicer is up-regulated in the early development of rectal cancers. An increased expression of Dicer mRNA in normal mucosa from CRC patients is significantly related to poor survival independently of gender, age, tumour site, stage and differentiation.</p