Creative approaches to emotional expression animation

In facial expression research, it is well established that certain emotional expressions are universally recognized. Studies into observer perception of expressions have built upon this research by highlighting the importance of particular facial regions, actions, and movements to the recognition of emotions. In many studies, the stimuli for such studies have been generated through posing by non-experts or performances by trained actors. However, character animators are required to craft recognizable, believable emotional facial expressions as a part of their profession. In this poster, the authors discuss some of the creative processes employed in their research into emotional expressions, and how practice-led research into expression animation might offer a new perspective on the generation of believable emotional expressions

Attention modulates the processing of emotional expression triggered by foveal faces

To investigate whether the processing of emotional expression for faces presented within foveal vision is modulated by spatial attention, event-related potentials (ERPs) were recorded in response to stimulus arrays containing one fearful or neutral face at fixation, which was flanked by a pair of peripheral bilateral lines. When attention was focused on the central face, an enhanced positivity was elicited by fearful as compared to neutral faces. This effect started at 160 ms post-stimulus, and remained present for the remainder of the 700 ms analysis interval. When attention was directed away from the face towards the line pair, the initial phase of this emotional positivity remained present, but emotional expression effects beyond 220 ms post-stimulus were completely eliminated. These results demonstrate that when faces are presented foveally, the initial rapid stage of emotional expression processing is unaffected by attention. In contrast, attentional task instructions are effective in inhibiting later, more controlled stages of expression analysis

Pattern recognition in narrative: Tracking emotional expression in context

Using geometric data analysis, our objective is the analysis of narrative, with narrative of emotion being the focus in this work. The following two principles for analysis of emotion inform our work. Firstly, emotion is revealed not as a quality in its own right but rather through interaction. We study the 2-way relationship of Ilsa and Rick in the movie Casablanca, and the 3-way relationship of Emma, Charles and Rodolphe in the novel {\em Madame Bovary}. Secondly, emotion, that is expression of states of mind of subjects, is formed and evolves within the narrative that expresses external events and (personal, social, physical) context. In addition to the analysis methodology with key aspects that are innovative, the input data used is crucial. We use, firstly, dialogue, and secondly, broad and general description that incorporates dialogue. In a follow-on study, we apply our unsupervised narrative mapping to data streams with very low emotional expression. We map the narrative of Twitter streams. Thus we demonstrate map analysis of general narratives

Processing of emotional expression in subliminal and low-visibility images

This thesis investigated the processing of emotional stimuli by the visual system, and how the processing of emotions interacts with visual awareness. Emotions have been given ‘special’ status by some previous research, with evidence that the processing of emotions may be relatively independent of striate cortex, and less affected by disruption to awareness than processing of emotionally neutral images. Yet the extent to which emotions are ‘special’ remains questionable. This thesis focused on the processing of emotional stimuli when activity in V1 was disrupted using transcranial magnetic stimulation (TMS), and whether emotional properties of stimuli can be reliably discriminated, or affect subsequent responses, when visibility is low. Two of the experiments reported in this thesis disrupted activity in V1 using TMS, Experiment 1 with single pulses in an online design, and Experiment 2 with theta burst stimulation in an offline design. Experiment 1 found that a single pulse of TMS 70-130 ms following a presentation of a body posture image disrupted processing of neutral but not emotional postures in an area of the visual field that corresponded to the disruption. Experiment 2 did not find any convincing evidence of disruption to processing of neutral or emotional faces. From Experiment 1 it would appear that emotional body posture images were relatively unaffected by TMS, and appeared to be robust to disruption to V1. Experiment 2 did not add to this as there was no evidence of disruption in any condition. Experiments 3 and 4 used visual masking to disrupt awareness of emotional and neutral faces. Both experiments used a varying interval between the face and the mask stimuli to systematically vary the visibility of the faces. Overall, the shortest SOA produced the lowest level of visibility, and this level of visibility was arguably outside awareness. In Experiment 3, participants’ ability to discriminate properties of emotional faces under low visibility conditions was greater than their ability to discriminate the orientation of the face. This was despite the orientation discrimination being much easier at higher levels of visibility. Experiment 4 used a gender discrimination task, with emotion providing a redundant cue to the decision (present half of the time). Despite showing a strong linear masking function for the neutral faces, there was no evidence of any emotion advantage. Overall, Experiment 3 gave some evidence of an emotion advantage under low visibility conditions, but this effect was fairly small and not replicated in Experiment 4. Finally, Experiments 5-8 used low visibility emotional faces to prime responses to subsequent emotional faces (Experiments 5 and 6) or words (Experiments 7 and 8). In Experiments 5, 7 and 8 there was some evidence of emotional priming effects, although these effects varied considerably across the different designs used. There was evidence for meaningful processing of the emotional prime faces, but this processing only led to small and variable effects on subsequent responses. In summary, this thesis found some evidence that the processing of emotional stimuli was relatively robust to disruption in V1 with TMS. Attempts to find evidence for robust processing of emotional stimuli when disrupted with backwards masking was less successful, with at best mixed results from discrimination tasks and priming experiments. Whether emotional stimuli are processed by a separate route(s) in the brain is still very much open to debate, but the findings of this thesis offers small and inconsistent evidence for a brain network for processing emotions that is relatively independent of V1 and visual awareness. The network and nature of brain structures involved in the processing of subliminal and low visibility processing of emotions remains somewhat elusive.ESR

Schizophrenia and the progression of emotional expression in relation to others

Gaining an improved understanding of people diagnosed with schizophrenia has the potential to influence priorities for therapy. Psychosis is commonly understood through the perspective of the medical model. However, the experience of social context surrounding psychosis is not well understood. In this research project we used a phenomenological methodology with a longitudinal design to interview 7 participants across a 12-month period to understand the social experiences surrounding psychosis. Eleven themes were explicated and divided into two phases of the illness experience: (a) transition into emotional shutdown included the experiences of not being acknowledged, relational confusion, not being expressive, detachment, reliving the past, and having no sense of direction; and (b) recovery from emotional shutdown included the experiences of being acknowledged, expression, resolution, independence, and a sense of direction. The experiential themes provide clinicians with new insights to better assess vulnerability, and have the potential to inform goals for therapy