Eye contact modulates facial mimicry in 4-month-old infants: an EMG and fNIRS study

Mimicry, the tendency to spontaneously and unconsciously copy others' behaviour, plays an important role in social interactions. It facilitates rapport between strangers, and is flexibly modulated by social signals, such as eye contact. However, little is known about the development of this phenomenon in infancy, and it is unknown whether mimicry is modulated by social signals from early in life. Here we addressed this question by presenting 4-month-old infants with videos of models performing facial actions (e.g., mouth opening, eyebrow raising) and hand actions (e.g., hand opening and closing, finger actions) accompanied by direct or averted gaze, while we measured their facial and hand muscle responses using electromyography to obtain an index of mimicry (Experiment 1). In Experiment 2 the infants observed the same stimuli while we used functional near-infrared spectroscopy to investigate the brain regions involved in modulating mimicry by eye contact. We found that 4-month-olds only showed evidence of mimicry when they observed facial actions accompanied by direct gaze. Experiment 2 suggests that this selective facial mimicry may have been associated with activation over posterior superior temporal sulcus. These findings provide the first demonstration of modulation of mimicry by social signals in young human infants, and suggest that mimicry plays an important role in social interactions from early in life. [Abstract copyright: Copyright © 2018 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Nonverbal communication in virtual reality: Nodding as a social signal in virtual interactions

Nonverbal communication is an important part of human communication, including head nodding, eye gaze, proximity and body orientation. Recent research has identified specific patterns of head nodding linked to conversation, namely mimicry of head movements at 600 ms delay and fast nodding when listening. In this paper, we implemented these head nodding behaviour rules in virtual humans, and we tested the impact of these behaviours, and whether they lead to increases in trust and liking towards the virtual humans. We use Virtual Reality technology to simulate a face-to-face conversation, as VR provides a high level of immersiveness and social presence, very similar to face-to-face interaction. We then conducted a study with human-subject participants, where the participants took part in conversations with two virtual humans and then rated the virtual character social characteristics, and completed an evaluation of their implicit trust in the virtual human. Results showed more liking for and more trust in the virtual human whose nodding behaviour was driven by realistic behaviour rules. This supports the psychological models of nodding and advances our ability to build realistic virtual humans