Compositionality in the language of emotion

Emotions are signaled by complex arrays of face and body actions. The main point of contention in contemporary treatments is whether these arrays are discrete, holistic constellations reflecting emotion categories, or whether they are compositional-comprised of smaller components, each of which contributes some aspect of emotion to the complex whole. We address this question by investigating spontaneous face and body displays of athletes and place it in the wider context of human communicative signals and, in particular, of language. A defining property of human language is compositionality-the ability to combine and recombine a relatively small number of elements to create a vast number of complex meaningful expressions, and to interpret them. We ask whether this property of language can be discerned in a more ancient communicative system: intense emotional displays. In an experiment, participants interpreted a range of emotions and their strengths in pictures of athletes who had just won or lost a competition. By matching participants' judgements with minutely coded features of face and body, we find evidence for compositionality. The distribution of participants' responses indicates that most of the athletes' face and body features contribute to displays of dominance or submission. More particular emotional components related, for example, to positive valence (e.g. happy) or goal obstruction (e.g. frustrated), were also found to significantly correlate with certain face and body features. We propose that the combination of features linked to broader components (i.e, dominant or submissive) and to more particular emotions (e.g, happy or frustrated) reflects more complex emotional states. In sum, we find that the corporeal expression of intense, unfiltered emotion has compositional properties, potentially providing an ancient scaffolding upon which, millions of years later, the abstract and constrained compositional system of human language could build

How do Typically Developing Deaf Children and Deaf Children with Autism Spectrum Disorder Use the Face When Comprehending Emotional Facial Expressions in British Sign Language?

Facial expressions in sign language carry a variety of communicative features. While emotion can modulate a spoken utterance through changes in intonation, duration and intensity, in sign language specific facial expressions presented concurrently with a manual sign perform this function. When deaf adult signers cannot see facial features, their ability to judge emotion in a signed utterance is impaired (Reilly et al. in Sign Lang Stud 75:113-118, 1992). We examined the role of the face in the comprehension of emotion in sign language in a group of typically developing (TD) deaf children and in a group of deaf children with autism spectrum disorder (ASD). We replicated Reilly et al.'s (Sign Lang Stud 75:113-118, 1992) adult results in the TD deaf signing children, confirming the importance of the face in understanding emotion in sign language. The ASD group performed more poorly on the emotion recognition task than the TD children. The deaf children with ASD showed a deficit in emotion recognition during sign language processing analogous to the deficit in vocal emotion recognition that has been observed in hearing children with ASD