A database of whole-body action videos for the study of action, emotion, and untrustworthiness

We present a database of high-definition (HD) videos for the study of traits inferred from whole-body actions. Twenty-nine actors (19 female) were filmed performing different actions—walking, picking up a box, putting down a box, jumping, sitting down, and standing and acting—while conveying different traits, including four emotions (anger, fear, happiness, sadness), untrustworthiness, and neutral, where no specific trait was conveyed. For the actions conveying the four emotions and untrustworthiness, the actions were filmed multiple times, with the actor conveying the traits with different levels of intensity. In total, we made 2,783 action videos (in both two-dimensional and three-dimensional format), each lasting 7 s with a frame rate of 50 fps. All videos were filmed in a green-screen studio in order to isolate the action information from all contextual detail and to provide a flexible stimulus set for future use. In order to validate the traits conveyed by each action, we asked participants to rate each of the actions corresponding to the trait that the actor portrayed in the two-dimensional videos. To provide a useful database of stimuli of multiple actions conveying multiple traits, each video name contains information on the gender of the actor, the action executed, the trait conveyed, and the rating of its perceived intensity. All videos can be downloaded free at the following address: http://www-users.york.ac.uk/~neb506/databases.html. We discuss potential uses for the database in the analysis of the perception of whole-body actions

Recognizing Speech in a Novel Accent: The Motor Theory of Speech Perception Reframed

The motor theory of speech perception holds that we perceive the speech of another in terms of a motor representation of that speech. However, when we have learned to recognize a foreign accent, it seems plausible that recognition of a word rarely involves reconstruction of the speech gestures of the speaker rather than the listener. To better assess the motor theory and this observation, we proceed in three stages. Part 1 places the motor theory of speech perception in a larger framework based on our earlier models of the adaptive formation of mirror neurons for grasping, and for viewing extensions of that mirror system as part of a larger system for neuro-linguistic processing, augmented by the present consideration of recognizing speech in a novel accent. Part 2 then offers a novel computational model of how a listener comes to understand the speech of someone speaking the listener's native language with a foreign accent. The core tenet of the model is that the listener uses hypotheses about the word the speaker is currently uttering to update probabilities linking the sound produced by the speaker to phonemes in the native language repertoire of the listener. This, on average, improves the recognition of later words. This model is neutral regarding the nature of the representations it uses (motor vs. auditory). It serve as a reference point for the discussion in Part 3, which proposes a dual-stream neuro-linguistic architecture to revisits claims for and against the motor theory of speech perception and the relevance of mirror neurons, and extracts some implications for the reframing of the motor theory

Sensitivity to differences in the motor origin of drawings:from human to robot

This study explores the idea that an observer is sensitive to differences in the static traces of drawings that are due to differences in motor origin. In particular, our aim was to test if an observer is able to discriminate between drawings made by a robot and by a human in the case where the drawings contain salient kinematic cues for discrimination and in the case where the drawings only contain more subtle kinematic cues. We hypothesized that participants would be able to correctly attribute the drawing to a human or a robot origin when salient kinematic cues are present. In addition, our study shows that observers are also able to detect the producer behind the drawings in the absence of these salient kinematic cues. The design was such that in the absence of salient kinematic cues, the drawings are visually very similar, i.e. only differing in subtle kinematic differences. Observers thus had to rely on these subtle kinematic differences in the line trajectories between drawings. However, not only motor origin (human versus robot) but also motor style (natural versus mechanic) plays a role in attributing a drawing to the correct producer, because participants scored less high when the human hand draws in a relatively mechanical way. Overall, this study suggests that observers are sensitive to subtle kinematic differences between visually similar marks in drawings that have a different motor origin. We offer some possible interpretations inspired by the idea of "motor resonance''

Endogenous orienting modulates the Simon effect: critical factors in experimental design

Responses are faster when the side of stimulus and response correspond than when they do not correspond, even if stimulus location is irrelevant to the task at hand: the correspondence, spatial compatibility effect, or Simon effect. Generally, it is assumed that an automatically generated spatial code is responsible for this effect, but the precise mechanism underlying the formation of this code is still under dispute. Two major alternatives have been proposed: the referential-coding account, which can be subdivided into a static version and an attention-centered version, and the attention-shift account. These accounts hold clear-cut predictions for attentional cuing experiments. The former would assume a Simon effect irrespective of attentional cuing in its static version, whereas the attention-centered version of the referential-coding account and the attention-shift account would predict a decreased Simon effect on validly as opposed to invalidly cued trials. However, results from previous studies are equivocal to the effects of attentional cuing on the Simon effect. We argue here that attentional cueing reliably modulates the Simon effect if some crucial experimental conditions, mostly relevant for optimizing attentional allocation, are met. Furthermore, we propose that the Simon effect may be better understood within the perspective of supra-modal spatial attention, thereby providing an explanation for observed discrepancies in the literature

Priming of reach trajectory when observing actions: Hand-centred effects

When another person's actions are observed it appears that these actions are simulated, such that similar motor processes are triggered in the observer. Much evidence suggests that such simulation concerns the achievement of behavioural goals, such as grasping a particular object, and is less concerned with the specific nature of the action, such as the path the hand takes to reach the goal object. We demonstrate that when observing another person reach around an obstacle, an observer's subsequent reach has an increased curved trajectory, reflecting motor priming of reach path. This priming of reach trajectory via action observation can take place under a variety of circumstances: with or without a shared goal, and when the action is seen from a variety of perspectives. However, of most importance, the reach path priming effect is only evoked if the obstacle avoided by another person is within the action (peripersonal) space of the observer

Early maternal mirroring predicts infant motor system activation during facial expression observation.

Processing facial expressions is an essential component of social interaction, especially for preverbal infants. In human adults and monkeys, this process involves the motor system, with a neural matching mechanism believed to couple self- and other-generated facial gestures. Here, we used electroencephalography to demonstrate recruitment of the human motor system during observation and execution of facial expressions in nine-month-old infants, implicating this system in facial expression processing from a very young age. Notably, examination of early video-recorded mother-infant interactions supported the common, but as yet untested, hypothesis that maternal mirroring of infant facial gestures is central to the development of a neural matching mechanism for these gestures. Specifically, the extent to which mothers mirrored infant facial expressions at two months postpartum predicted infant motor system activity during observation of the same expressions at nine months. This suggests that maternal mirroring strengthens mappings between visual and motor representations of facial gestures, which increases infant neural sensitivity to particularly relevant cues in the early social environment