Grasping the Agent’s Perspective: A Kinematics Investigation of Linguistic Perspective in Italian and German

Every day, we primarily experience actions as agents, by having a concrete perspective on our actions, their means and goals. This peculiar perspective is what allows us to successfully plan and execute our actions in a dense social environment. Nevertheless, in this environment actions are also perceived from an observer’s perspective. Adopting such a perspective helps us to understand and respond to other’s people actions and their outcomes. Importantly, similar experiences of being agent and observer occur also when actions are not physically acted/perceived but are merely linguistically shared. In this paper we present two exploratory studies, one in Italian and one in German, in which we applied a direct comparison of three singular perspectives in combination with different verb categories. First, second and third person pronouns were combined with action and interaction verbs, i.e., verbs implying an interaction with an object – e.g., grasp – or an interaction with an object and another person – e.g., give. By means of kinematics recording, we analyzed participants’ reaching-grasping responses to a mouse while they were presented with the different combinations of linguistic stimuli (pronouns and verb type). Results of Experiment 1 on reaching show that, when they are preceded by YOU, interaction verbs reached the velocity peak earlier than action verbs, since a further motor act will follow. Thus pronouns influence perspective taking and while comprehending language we are sensitive to the motor chain organization of verbs. The absence of the same effects in Experiment 2 is likely due to the fact that, being the pronoun in German mandatory, it is perceived as less salient than in Italian. Overall our result supports the idea that language is grounded in the motor system in a flexible way, and highlights the need for cross-linguistic studies in the field of embodied language processing

Sentence Comprehension: Effectors and Goals, Self and Others. An Overview of Experiments and Implications for Robotics

According to theories referring to embodied and grounded cognition (Barsalou, 2008), language comprehension encompasses an embodied simulation of actions. The neural underpinnings of this simulation could be found in wide neural circuits that involve canonical and mirror neurons (Rizzolatti et al., 1996). In keeping with this view, we review behavioral and kinematic studies conducted in our lab which help characterize the relationship existing between language and the motor system. Overall, our results reveal that the simulation evoked during sentence comprehension is fine-grained, primarily in its sensitivity to the different effectors we employ to perform actions. In addition, they suggest that linguistic comprehension also relies on the representation of actions in terms of goals and of the chains of motor acts necessary to accomplish them. Finally, they indicate that these goals are modulated by both the object features the sentence refers to as well as by social aspects such as the characteristics of the agents implied by sentences. We will discuss the implications of these studies for embodied robotics

Is Embodied Cognition Bilingual? Current Evidence and Perspectives of the Embodied Cognition Approach to Bilingual Language Processing

Accumulating behavioral and neurophysiological evidence supports the idea of language being grounded in sensorimotor processes, with indications of a functional role of motor, sensory and emotional systems in processing both concrete and abstract linguistic concepts. However, most of the available studies focused on native language speakers (L1), with only a limited number of investigations testing embodied language processing in the case of a second language (L2). In this paper we review the available evidence on embodied effects in L2 and discuss their possible integration into existing models of linguistic processing in L1 and L2. Finally, we discuss possible avenues for future research towards an integrated model of L1 and L2 sensorimotor and emotional grounding

Editorial: Reaching to Grasp Cognition: Analyzing Motor Behavior to Investigate Social Interactions

How humans plan and execute their actions has always been a fascinating topic for neuroscience and psychology. In particular, kinematics studies have contributed to shed light on how very basic actions (e.g. reaching-grasping) are affected by manipulating target properties, visually or linguistically presented stimuli, absence or presence of contextual information. Interestingly, recent studies have also shown how the social context in which actions take place and their relevance for human interactions can also affect the execution of very simple actions. This research topic aims to bring together researchers from psychology and neuroscience with a special focus on the use of kinematics analysis for the study of socially relevant aspects of cognition (e.g. action observation, competition/cooperation, complementary actions, coordination, shared emotions and so on)

Developing the Ability to Manipulate Objects: A Comparative Study with Humans and Artificial Agents

No abstract availabl

The Agent is Right: When Motor Embodied Cognition is Space-Dependent

The role of embodied mechanisms in processing sentences endowed with a first person perspective is now widely accepted. However, whether embodied sentence processing within a third person perspective would also have motor behavioral significance remains unknown. Here, we developed a novel version of the Action-sentence Compatibility Effect (ACE) in which participants were asked to perform a movement compatible or not with the direction embedded in a sentence having a first person (Experiment 1: You gave a pizza to Louis) or third person perspective (Experiment 2: Lea gave a pizza to Louis). Results indicate that shifting perspective from first to third person was sufficient to prevent motor embodied mechanisms, abolishing the ACE. Critically, ACE was restored in Experiment 3 by adding a virtual “body” that allowed participants to know “where” to put themselves in space when taking the third person perspective, thus demonstrating that motor embodied processes are space-dependent. A fourth, control experiment, by dissociating motor response from the transfer verb's direction, supported the conclusion that perspective-taking may induce significant ACE only when coupled with the adequate sentence-response mapping

Social Requests and Social Affordances: How They Affect the Kinematics of Motor Sequences during Interactions between Conspecifics

The present study aimed at determining whether and what factors affect the control of motor sequences related to interactions between conspecifics. Experiment 1 demonstrated that during interactions between conspecifics guided by the social intention of feeding, a social affordance was activated, which modified the kinematics of sequences constituted by reaching-grasping and placing. This was relative to the same sequence directed to an inanimate target. Experiments 2 and 4 suggested that the related-to-feeding social request emitted by the receiver (i.e. the request gesture of mouth opening) is prerequisite in order to activate a social affordance. Specifically, the two experiments showed that the social request to be fed activated a social affordance even when the sequences directed towards a conspecific were not finalized to feed. Experiment 3 showed that moving inside the peripersonal space of a conspecific, who did not produce any social request, marginally affected the sequence. Finally, experiments 5 and 6 indicated that the gaze of a conspecific is necessary to make a social request effective at activating a social affordance. Summing up, the results of the present study suggest that the control of motor sequences can be changed by the interaction between giver and receiver: the interaction is characterized by a social affordance that the giver activates on the basis of social requests produced by the receiver. The gaze of the receiver is a prerequisite to make a social request effective

EEGManyPipelines: A Large-scale, Grassroots Multi-analyst Study of Electroencephalography Analysis Practices in the Wild

The ongoing reproducibility crisis in psychology and cognitive neuroscience has sparked increasing calls to re-evaluate and reshape scientific culture and practices. Heeding those calls, we have recently launched the EEGManyPipelines project as a means to assess the robustness of EEG research in naturalistic conditions and experiment with an alternative model of conducting scientific research. One hundred sixty-eight analyst teams, encompassing 396 individual researchers from 37 countries, independently analyzed the same unpublished, representative EEG data set to test the same set of predefined hypotheses and then provided their analysis pipelines and reported outcomes. Here, we lay out how large-scale scientific projects can be set up in a grassroots, community-driven manner without a central organizing laboratory. We explain our recruitment strategy, our guidance for analysts, the eventual outputs of this project, and how it might have a lasting impact on the field