Event-related potentials to task-irrelevant changes in facial expressions

Abstract Background Numerous previous experiments have used oddball paradigm to study change detection. This paradigm is applied here to study change detection of facial expressions in a context which demands abstraction of the emotional expression-related facial features among other changing facial features. Methods Event-related potentials (ERPs) were recorded in adult humans engaged in a demanding auditory task. In an oddball paradigm, repeated pictures of faces with a neutral expression ('standard', p = .9) were rarely replaced by pictures with a fearful ('fearful deviant', p = .05) or happy ('happy deviant', p = .05) expression. Importantly, facial identities changed from picture to picture. Thus, change detection required abstraction of facial expression from changes in several low-level visual features. Results ERPs to both types of deviants differed from those to standards. At occipital electrode sites, ERPs to deviants were more negative than ERPs to standards at 150–180 ms and 280–320 ms post-stimulus. A positive shift to deviants at fronto-central electrode sites in the analysis window of 130–170 ms post-stimulus was also found. Waveform analysis computed as point-wise comparisons between the amplitudes elicited by standards and deviants revealed that the occipital negativity emerged earlier to happy deviants than to fearful deviants (after 140 ms versus 160 ms post-stimulus, respectively). In turn, the anterior positivity was earlier to fearful deviants than to happy deviants (110 ms versus 120 ms post-stimulus, respectively). Conclusion ERP amplitude differences between emotional and neutral expressions indicated pre-attentive change detection of facial expressions among neutral faces. The posterior negative difference at 150–180 ms latency resembled visual mismatch negativity (vMMN) – an index of pre-attentive change detection previously studied only to changes in low-level features in vision. The positive anterior difference in ERPs at 130–170 ms post-stimulus probably indexed pre-attentive attention orienting towards emotionally significant changes. The results show that the human brain can abstract emotion related features of faces while engaged to a demanding task in another sensory modality.peerReviewe

Eye contact with neutral and smiling faces: effects on autonomic responses and frontal EEG asymmetry

In our previous studies we have shown that seeing another person “live” with a direct vs. averted gaze results in enhanced skin conductance responses (SCRs) indicating autonomic arousal and in greater relative left-sided frontal activity in the electroencephalography (asymmetry in the alpha-band power), associated with approach motivation. In our studies, however, the stimulus persons had a neutral expression. In real-life social interaction, eye contact is often associated with a smile, which is another signal of the sender's approach-related motivation. A smile could, therefore, enhance the affective-motivational responses to eye contact. In the present study, we investigated whether the facial expression (neutral vs. social smile) would modulate autonomic arousal and frontal EEG alpha-band asymmetry to seeing a direct vs. an averted gaze in faces presented “live” through a liquid crystal (LC) shutter. The results showed that the SCRs were greater for the direct than the averted gaze and that the effect of gaze direction was more pronounced for a smiling than a neutral face. However, in this study, gaze direction and facial expression did not affect the frontal EEG asymmetry, although, for gaze direction, we found a marginally significant correlation between the degree of an overall bias for asymmetric frontal activity and the degree to which direct gaze elicited stronger left-sided frontal activity than did averted gaze

Visual processing in a primate temporal association cortex: insensitivity to self-induced motion

An animal's own behaviour can give rise to sensory stimulation that is very similar to stimulation of completely external origin. Much of this self-induced stimulation has little informative value to the animal and may even interfere with the processing of externally-induced stimulation. A high-level association area in the temporal cortex of macaque (superior temporal polysensory area, STP) which has been shown to participate in the analysis of visual motion was targeted in a series of experiments in order to investigate whether this brain area discriminates externally- and self-induced stimulation in its visual motion processing. Earlier results in somatosensory processing within this same brain area provided grounds for this presumption The cells studied in here were sensitive to the presence of motion but showed no selectivity for the form of the stimulus. 25% of all visually responsive cells in area STP were classified as belonging to this class of cells. This group of cells was further categorized into unidirectional (39%), bidirectional (4%) and pandirectional (57%) cells. Tuning to direction varied in sharpness. For most cells the angular change in direction required to reduce response to half maximal was between 45 and 70 degrees. The optimal directions of cells appeared clustered around cartesian axes, (up/down, left/right and towards/away). The response latency varied between 35.0-126.4 ms (mean 90.9 ms). On average cell responses showed a transient burst of activity followed by a tonic discharge maintained for the duration of stimulation. 83% of the motion sensitive cells lacking form selectivity responded to any stimuli moved by the experimenter, but gave no response to the sight of the animal's own limb movements. The cells remained, however, responsive to external stimulation while the monkey's own hand was moving in view. Responses to self-induced movements were recovered if the monkey introduced a novel object in its hand into view. That the response discrimination between externally- and self-induced stimulation was not caused by differences in the visual appearance of the stimuli was confirmed in the second experiment where the monkey was trained to rotate a handle connected to a patterned cylinder in order to generate visual motion stimulation over a fixation point. 61% of the tested cells discriminated between pattern motion generated by the monkey and by the experimenter. It was shown that the monkey's motor activity as such (turning a handle without visible cylinder rotation) did not affect the cells' spontaneous activity. Some indication was received to suggest that the discriminative mechanism is using not only (motor) corollary discharges but also proprioceptive input. These results also gave evidence of the plasticity of discriminative processing in STP for the animal's life-time experiences. Finally, the cells were studied for their responsiveness for image motion resulting from movements of external objects and movements of the animal's body (self-motion). 84% of the cells responded only to visual object-motion and failed to respond to visual motion resulting from animal's self-motion. The experiments also revealed that area STP processes visual motion mostly in observer- relative terms, i.e. in reference to the perceiver itself. The results provide one explanation for the functional significance of the convergence of several modalities of sensory (and motor) input in the STP. It is suggested that area STP works as a "neural filter" to separate expected sensory consequences resulting from one's own actions from those that originate from the actions of other animals or environmental events

Considering victims’ minds in the evaluation of harmful agents’ moral standing

acceptedVersionPeer reviewe

Perception of eye contact, self-referential thinking and age

Increased thinking about one's self has been proposed to widen the gaze cone, that is, the range of gaze deviations that an observer judges as looking directly at them (eye contact). This study investigated the effects of a self-referential thinking manipulation and demographic factors on the gaze cone. In a preregistered experiment (N = 200), the self-referential thinking manipulation, as compared to a control manipulation, did not influence the gaze cone, or the use of first-person pronouns in a manipulation check measuring self-referential processing. This may indicate a failure of the manipulation and participants’ lack of effort. However, participants’ age was significantly correlated with both measures: older people had wider gaze cones and used more self-referring pronouns. A second experiment (N = 300) further examined the effect of the manipulation and demographic factors on self-referential processing, and the results were replicated. These findings may reflect age-related self-reference and positivity effects.publishedVersionPeer reviewe

Effects of conversation content on viewing dyadic conversations

People typically follow conversations closely with their gaze. We asked whether this viewing is influenced by what is actually said in the conversation and by the viewer’s psychological condition. We recorded the eye movements of healthy (N = 16) and depressed (N = 25) participants while they were viewing video clips. Each video showed two people, each speaking one line of dialogue about socio-emotionally important (i.e., personal) or unimportant topics (matter-of-fact). Between the spoken lines, the viewers made more saccadic shifts between the discussants, and looked more at the second speaker, in personal vs. matter-of-fact conversations. Higher depression scores were correlated with less looking at the currently speaking discussant. We conclude that subtle social attention dynamics can be detected from eye movements and that these dynamics are sensitive to the observer’s psychological condition, such as depression

Watching Eyes effects: When others meet the self

International audienc

Effects of fear on donations to climate change mitigation

Despite 70 years of research, there is no consensus about the effects of threat messages on behavior, partly because of publication bias. The lack of consensus concerns situations such as climate change where people tend to believe that they cannot easily make a major difference. Using a 2 × 2, (threat, neutral) × (efficacy, no efficacy) between-subjects design, we tested four hypotheses: the effect of threat stimuli on (1) mitigation of climate change and (2) experienced fear depends on efficacy information, (3) threat stimuli increase monetary donations to mitigation regardless of efficacy information, and (4) the effect of the threat stimuli depends on political identity. The threat stimuli were climate change related pictures and a prompt to write either about one’s knowledge of or about the threat of climate change. The efficacy stimuli were an efficacy related picture and written information about the efficacy of a climate change mitigating organization. We collected a representative online sample of 1517 U.S. citizens. The manipulations affected experienced fear and self-efficacy, but there was no statistically significant main effect of threat on donations nor a statistically significant interaction between threat and efficacy or between threat and political identity. It is concluded that threat appeals do not increase climate change mitigation behavior by more than a very small amount compared to making people think about the subject.publishedVersionPeer reviewe

The influence of role awareness, empathy induction and trait empathy on dictator game giving

We ask how state empathy, trait empathy, and role awareness influence dictator game giving in a monetarily incentivized experiment. We manipulated two factors: role awareness (role certainty vs. role uncertainty) and state empathy induction (no empathy induction vs. empathy induction). Under role uncertainty, participants did not know their role as a dictator or a recipient when making their choices. State empathy was induced by asking the dictators to consider what the recipient would feel when learning about the decision. Each participant was randomly assigned into one of the four conditions, and in each condition, participants were randomly assigned into dictator and receiver roles. The role assignment took place before or after decisions were made, depending on the condition. We also studied the direct influence of trait empathy on dictator game giving as well as its interaction with the experimental manipulations. Trait empathy was measured by the Interpersonal Reactivity Index (IRI) and the Questionnaire of Cognitive and Affective Empathy (QCAE) before the experiment. Of our experimental manipulations, role awareness had an effect on dictator game giving; participants donated more under role uncertainty than under role certainty. Instead, we did not observe an effect of state empathy induction. Of trait empathy subscales, only affective empathy was positively associated with dictator game giving. Finally, role awareness did not influence all participants similarly but had a larger impact on those with low scores on trait empathic concern or trait affective empathy. Our results indicate that specific measures to induce altruistic sharing can be effective but their effect may vary depending on certain personal characteristics. </p