Differential neural dynamics underling pragmatic and semantic affordance processing in macaque ventral premotor cortex

Premotor neurons play a fundamental role in transforming physical properties of observed objects, such as size and shape, into motor plans for grasping them, hence contributing to "pragmatic" affordance processing. Premotor neurons can also contribute to "semantic" affordance processing, as they can discharge differently even to pragmatically identical objects depending on their behavioural relevance for the observer (i.e. edible or inedible objects). Here, we compared the response of monkey ventral premotor area F5 neurons tested during pragmatic (PT) or semantic (ST) visuomotor tasks. Object presentation responses in ST showed shorter latency and lower object selectivity than in PT. Furthermore, we found a difference between a transient representation of semantic affordances and a sustained representation of pragmatic affordances at both the single neuron and population level. Indeed, responses in ST returned to baseline within 0.5 s whereas in PT they showed the typical sustained visual-to-motor activity during Go trials. In contrast, during No-go trials, the time course of pragmatic and semantic information processing was similar. These findings suggest that premotor cortex generates different dynamics depending on pragmatic and semantic information provided by the context in which the to-be-grasped object is presented

fMRI evidence of ‘mirror’ responses to geometric shapes

Mirror neurons may be a genetic adaptation for social interaction [1]. Alternatively, the associative hypothesis [2], [3] proposes that the development of mirror neurons is driven by sensorimotor learning, and that, given suitable experience, mirror neurons will respond to any stimulus. This hypothesis was tested using fMRI adaptation to index populations of cells with mirror properties. After sensorimotor training, where geometric shapes were paired with hand actions, BOLD response was measured while human participants experienced runs of events in which shape observation alternated with action execution or observation. Adaptation from shapes to action execution, and critically, observation, occurred in ventral premotor cortex (PMv) and inferior parietal lobule (IPL). Adaptation from shapes to execution indicates that neuronal populations responding to the shapes had motor properties, while adaptation to observation demonstrates that these populations had mirror properties. These results indicate that sensorimotor training induced populations of cells with mirror properties in PMv and IPL to respond to the observation of arbitrary shapes. They suggest that the mirror system has not been shaped by evolution to respond in a mirror fashion to biological actions; instead, its development is mediated by stimulus-general processes of learning within a system adapted for visuomotor control

Premotor cortex encoding of dynamic hand force and motor output observation underlying hand-object interaction

We studied encoding of hand force and its relations with observation-related activity in macaques trained in an isometric hand-force application and recalibration task, that required to move a visual cursor on a screen toward eight peripheral targets by exerting a force on an isometric joystick, in absence or presence of an opposing force field. Monkeys also observed the result of their action in play-back, as motion of a visual cursor on the screen. This approach combined in a single experiment isometric action performance and force adjustment with observation of its consequences in the external world, also allowing to determine whether PMd neuronal populations reflected an inverse model that specified the force necessary to move in different directions a visual object, or a forward computation encoding its desired trajectory in visual space. We found that a population of PMd cells encoded the direction of dynamic force and its recalibration when the force condition changed but did not retain memory of such change, probably reflecting an adaptation rather than a learning process. Cells with observation-related activity also modulated by change in hand force were not modulated when the force conditions changed, suggesting that their activity reflected the motion of the visual cursor on the screen, therefore the consequences of force application in the visual space. These results also allow a direct comparison of the relative contribute of different populations of PMd cells with that of cells with similar activity profile in the encoding of hand force and its consequences in the parieto-frontal system

Two brains in action: joint-action coding in the primate frontal cortex

Daily life often requires the coordination of our actions with those of another partner. After sixty years (1968-2018) of behavioral neurophysiology of motor control, the neural mechanisms which allow such coordination in primates are unknown. We studied this issue by recording cell activity simultaneously from dorsal premotor cortex (PMd) of two male interacting monkeys trained to coordinate their hand forces to achieve a common goal. We found a population of 'joint-action cells' that discharged preferentially when monkeys cooperated in the task. This modulation was predictive in nature, since in most cells neural activity led in time the changes of the "own" and of the "other" behavior. These neurons encoded the joint-performance more accurately than 'canonical action-related cells', activated by the action per se, regardless of the individual vs. interactive context. A decoding of joint-action was obtained by combining the two brains activities, using cells with directional properties distinguished from those associated to the 'solo' behaviors. Action observation-related activity studied when one monkey observed the consequences of the partner's behavior, i.e. the cursor's motion on the screen, did not sharpen the accuracy of 'joint-action cells' representation, suggesting that it plays no major role in encoding joint-action. When monkeys performed with a non-interactive partner, such as a computer, 'joint-action cells' representation of the "other" (non-cooperative) behavior was significantly degraded. These findings provide evidence of how premotor neurons integrate the time-varying representation of the self-action with that of a co-actor, thus offering a neural substrate for successful visuo-motor coordination between individuals.SIGNIFICANT STATEMENTThe neural bases of inter-subject motor coordination were studied by recording cell activity simultaneously from the frontal cortex of two interacting monkeys, trained to coordinate their hand forces to achieve a common goal. We found a new class of cells, preferentially active when the monkeys cooperated, rather than when the same action was performed individually. These 'joint-action neurons' offered a neural representation of joint-behaviors by far more accurate than that provided by the canonical action-related cells, modulated by the action per se regardless of the individual/interactive context. A neural representation of joint-performance was obtained by combining the activity recorded from the two brains. Our findings offer the first evidence concerning neural mechanisms subtending interactive visuo-motor coordination between co-acting agents

Exploring manual asymmetries during grasping: a dynamic causal modeling approach

Recording of neural activity during grasping actions in macaques showed that grasp-related sensorimotor transformations are accomplished in a circuit constituted by the anterior part of the intraparietal sulcus (AIP), the ventral (F5) and the dorsal (F2) region of the premotor area. In humans, neuroimaging studies have revealed the existence of a similar circuit, involving the putative homolog of macaque areas AIP, F5 and F2. These studies have mainly considered grasping movements performed with the right dominant hand and only a few studies have measured brain activity associated with a movement performed with the left non-dominant hand. As a consequence of this gap, how the brain controls for grasping movement performed with the dominant and the non-dominant hand still represents an open question. A functional resonance imaging experiment (fMRI) has been conducted, and effective connectivity (Dynamic Causal Modelling, DCM) was used to assess how connectivity among grasping-related areas is modulated by hand (i.e., left and right) during the execution of grasping movements towards a small object requiring precision grasping. Results underlined boosted inter-hemispheric couplings between dorsal premotor cortices during the execution of movements performed with the left rather than the right dominant hand. More specifically, they suggest that the dorsal premotor cortices may play a fundamental role in monitoring the configuration of fingers when grasping movements are performed by either the right and the left hand. This role becomes particularly evident when the hand less-skilled (i.e., the left hand) to perform such action is utilized. The results are discussed in light of recent theories put forward to explain how parieto-frontal connectivity is modulated by the execution of prehensile movements

Motor Preparatory Activity in Posterior Parietal Cortex is Modulated by Subjective Absolute Value

For optimal response selection, the consequences associated with behavioral success or failure must be appraised. To determine how monetary consequences influence the neural representations of motor preparation, human brain activity was scanned with fMRI while subjects performed a complex spatial visuomotor task. At the beginning of each trial, reward context cues indicated the potential gain and loss imposed for correct or incorrect trial completion. FMRI-activity in canonical reward structures reflected the expected value related to the context. In contrast, motor preparatory activity in posterior parietal and premotor cortex peaked in high “absolute value” (high gain or loss) conditions: being highest for large gains in subjects who believed they performed well while being highest for large losses in those who believed they performed poorly. These results suggest that the neural activity preceding goal-directed actions incorporates the absolute value of that action, predicated upon subjective, rather than objective, estimates of one's performance

Sensing with the Motor Cortex

The primary motor cortex is a critical node in the network of brain regions responsible for voluntary motor behavior. It has been less appreciated, however, that the motor cortex exhibits sensory responses in a variety of modalities including vision and somatosensation. We review current work that emphasizes the heterogeneity in sensorimotor responses in the motor cortex and focus on its implications for cortical control of movement as well as for brain-machine interface development