Modulation of affective face processing deficits in schizophrenia by congruent emotional sounds

Schizophrenia is a psychiatric disorder resulting in prominent impairments in social functioning. Thus, clinical research has focused on underlying deficits of emotion processing and their linkage to specific symptoms and neurobiological dysfunctions. Although there is substantial research investigating impairments in unimodal affect recognition, studies in schizophrenia exploring crossmodal emotion processing are rare. Therefore, event-related potentials were measured in 15 patients with schizophrenia and 15 healthy controls while rating the expression of happy, fearful and neutral faces and concurrently being distracted by emotional or neutral sounds. Compared with controls, patients with schizophrenia revealed significantly decreased P1 and increased P2 amplitudes in response to all faces, independent of emotion or concurrent sound. Analyzing these effects with regard to audiovisual (in)congruence revealed that P1 amplitudes in patients were only reduced in response to emotionally incongruent stimulus pairs, whereas similar amplitudes between groups could be observed for congruent conditions. Correlation analyses revealed a significant negative correlation between general symptom severity (Brief Psychiatric Rating Scale-V4) and P1 amplitudes in response to congruent audiovisual stimulus pairs. These results indicate that early visual processing deficits in schizophrenia are apparent during emotion processing but, depending on symptom severity, these deficits can be restored by presenting concurrent emotionally congruent sounds

Crossmodal interactions in audiovisual emotion processing

Emotion in daily life is often expressed in a multimodal fashion. Consequently emotional information from one modality can influence processing in another. In a previous fMRI study we assessed the neural correlates of audio-visual integration and found that activity in the left amygdala is significantly attenuated when a neutral stimulus is paired with an emotional one compared to conditions where emotional stimuli were present in both channels. Here we used dynamic causal modelling to investigate the effective connectivity in the neuronal network underlying this emotion presence congruence effect. Our results provided strong evidence in favor of a model family, differing only in the interhemispheric interactions. All winning models share a connection from the bilateral fusiform gyrus (FFG) into the left amygdala and a non-linear modulatory influence of bilateral posterior superior temporal sulcus (pSTS) on these connections. This result indicates that the pSTS not only integrates multi-modal information from visual and auditory regions (as reflected in our model by significant feed-forward connections) but also gates the influence of the sensory information on the left amygdala, leading to attenuation of amygdala activity when a neutral stimulus is integrated. Moreover, we found a significant lateralization of the FFG due to stronger driving input by the stimuli (faces) into the right hemisphere, whereas such lateralization was not present for sound-driven input into the superior temporal gyrus. In summary, our data provides further evidence for a rightward lateralization of the FFG and in particular for a key role of the pSTS in the integration and gating of audio-visual emotional information

Modulation of affective face processing deficits in schizophrenia by congruent emotional sounds

Schizophrenia is a psychiatric disorder resulting in prominent impairments in social functioning. Thus, clinical research has focused on underlying deficits of emotion processing and their linkage to specific symptoms and neurobiological dysfunctions. Although there is substantial research investigating impairments in unimodal affect recognition, studies in schizophrenia exploring crossmodal emotion processing are rare. Therefore, event-related potentials were measured in 15 patients with schizophrenia and 15 healthy controls while rating the expression of happy, fearful and neutral faces and concurrently being distracted by emotional or neutral sounds. Compared with controls, patients with schizophrenia revealed significantly decreased P1 and increased P2 amplitudes in response to all faces, independent of emotion or concurrent sound. Analyzing these effects with regard to audiovisual (in)congruence revealed that P1 amplitudes in patients were only reduced in response to emotionally incongruent stimulus pairs, whereas similar amplitudes between groups could be observed for congruent conditions. Correlation analyses revealed a significant negative correlation between general symptom severity (Brief Psychiatric Rating Scale-V4) and P1 amplitudes in response to congruent audiovisual stimulus pairs. These results indicate that early visual processing deficits in schizophrenia are apparent during emotion processing but, depending on symptom severity, these deficits can be restored by presenting concurrent emotionally congruent sounds

The Modular Neuroarchitecture of Social Judgments on Faces

Face-derived information on trustworthiness and attractiveness crucially influences social interaction. It is, however, unclear to what degree the functional neuroanatomy of these complex social judgments on faces reflects genuine social versus basic emotional and cognitive processing. To disentangle social from nonsocial contributions, we assessed commonalities and differences between the functional networks activated by judging social (trustworthiness, attractiveness), emotional (happiness), and cognitive (age) facial traits. Relative to happiness and age evaluations, both trustworthiness and attractiveness judgments selectively activated the dorsomedial prefrontal cortex and inferior frontal gyrus, forming a core social cognition network. Moreover, they also elicited a higher amygdalar response than even the emotional control condition. Both social judgments differed, however, in their top-down modulation of face-sensitive regions: trustworthiness judgments recruited the posterior superior temporal sulcus, whereas attractiveness judgments recruited the fusiform gyrus. Social and emotional judgments converged and, therefore, likely interact in the ventromedial prefrontal cortex. Social and age judgments, on the other hand, commonly engaged the anterior insula, inferior parietal cortex, and dorsolateral prefrontal cortex, which appear to subserve more cognitive aspects in social evaluation. These findings demonstrate the modularity of social judgments on human faces by separating the neural correlates of social, face-specific, emotional, and cognitive processing facets

Modulating the processing of emotional stimuli by cognitive demand

Emotional processing is influenced by cognitive processes and vice versa, indicating a profound interaction of these domains. The investigation of the neural mechanisms underlying this interaction is not only highly relevant for understanding the organization of human brain function. Rather, it may also help in understanding dysregulated emotions in affective disorders and in elucidating the neurobiology of cognitive behavioural therapy (e.g. in borderline personality disorder), which aims at modulating dysfunctional emotion processes by cognitive techniques, such as restructuring. In the majority of earlier studies investigating the interaction of emotions and cognition, the main focus has been on the investigation of the effects of emotional stimuli or, more general, emotional processing, e.g. instituted by emotional material that needed to be processed, on cognitive performance and neural activation patterns. Here we pursued the opposite approach and investigated the modulation of implicit processing of emotional stimuli by cognitive demands using an event-related functional magnetic resonance imaging--study on a motor short-term memory paradigm with emotional interferences. Subjects were visually presented a finger-sequence consisting either of four (easy condition) or six (difficult condition) items, which they had to memorize. After a short pause positive, negative or neutral International affective picture system pictures or a green dot (as control condition) were presented. Subjects were instructed to reproduce the memorized sequence manually as soon as the picture disappeared. Analysis showed that with increasing cognitive demand (long relative to short sequences), neural responses to emotional pictures were significantly reduced in amygdala and orbitofrontal cortex. In contrast, the more difficult task evoked stronger activation in a widespread frontoparietal network. As stimuli were task-relevant go-cues and hence had to be processed perceptually, we would interpret this as a specific attenuation of affective responses by concurrent cognitive processing--potentially reflecting a relocation of resources mediated by the frontoparietal network