Evaluating Graph Signal Processing for Neuroimaging Through Classification and Dimensionality Reduction

Graph Signal Processing (GSP) is a promising framework to analyze multi-dimensional neuroimaging datasets, while taking into account both the spatial and functional dependencies between brain signals. In the present work, we apply dimensionality reduction techniques based on graph representations of the brain to decode brain activity from real and simulated fMRI datasets. We introduce seven graphs obtained from a) geometric structure and/or b) functional connectivity between brain areas at rest, and compare them when performing dimension reduction for classification. We show that mixed graphs using both a) and b) offer the best performance. We also show that graph sampling methods perform better than classical dimension reduction including Principal Component Analysis (PCA) and Independent Component Analysis (ICA).Comment: 5 pages, GlobalSIP 201

Modulation of Rolandic Beta-Band Oscillations during Motor Simulation of Joint Actions

Successful joint actions require precise temporal and spatial coordination between individuals who aim to achieve a common goal. A growing number of behavioral data suggest that to efficiently couple and coordinate a joint task, the actors have to represent both own and the partner’s actions. However it is unclear how the motor system is specifically recruited for joint actions. To find out how the goal and the presence of the partner’s hand can impact the motor activity during joint action, we assessed the functional state of 16 participants’ motor cortex during observation and associated motor imagery of joint actions, individual actions, and non-goal-directed actions performed with either 1 or 2 hands. As an indicator of the functional state of the motor cortex, we used the reactivity of the rolandic magnetoencephalographic (MEG) beta rhythm following median-nerve stimulation. Motor imagery combined with action observation was associated with activation of the observer’s motor cortex, mainly in the hemisphere contralateral to the viewed (and at the same time imagined) hand actions. The motor-cortex involvement was enhanced when the goal of the actions was visible but also, in the ipsilateral hemisphere, when the partner’s hand was visible in the display. During joint action, the partner’s action, in addition to the participant’s own action, thus seems to be represented in the motor cortex so that it can be triggered by the mere presence of an acting hand in the peripersonal space.Peer reviewe

Bases neuronales des interactions sociales non-verbales : implication du système moteur & hyperscanning

This research investigated the impact of social interaction on motor activity, both ona behavioural and cerebral level. More precisely, the aim of the thesis was to characterise this modulation during simultaneous actions, when two participants interact, jointly or not, and to determine its functions. First , we studied the effect of action observation on motor execution. Coupling kinematics analysis and EEG recording, we gave evidence that the temporal time course of motor system activation was crucial for motor interference. We found that motor performances were facilitated by the observation of an action, only when execution and observation events were temporally coordinated. Second, we sought to characterise the influence of an interactive context on brain activity of two interacting participants through the coupling of dual-EEG and kinematic recordings. Thanks to the comparison of intra- and inter-individual brain activity of two participants that observed or performed individual or joint actions, we were able to highlight modulations of cerebral motor activity common in both participants as well as modulations of brain activity specific to the social context (human vs robot) and the role in the interaction (actor vs observer). Moreover, the inter-individual analysis revealed a coupling between the two participants' visual and motor brain areas during the joint action condition. Taken toghther, these results suggest that the motor system allows a tight coupling between interacting participants, mediated by temporal coupling that could facilitate the interaction and through an action-perception loop forming a common motor representation of the joint action.Cette thèse s'est intéressée à l'impact des interactions sociales sur l'acitivité motrice, à la fois au niveau comportempentale et cérébral et de caractériser cette modulation au cours d'actions simultanées et d'actions conjointes. Dans un premier temps, nous avons étudié les effets de l'observation d'une activation sur l'exécution motrice. En couplant analyse cinématique et enregistrement EEG, nous avons mis en évidence que l'activation du système des neurones miroirs facilitait l'action seulement lorsque les événements d'exécution et d'observation étaient temporellement coordonnées. Dans un deuxième temps, nous avons cherché à meiux caractériser l'influence du contexte interactif sur l'activité cérébrale de deux participants d'une interaction grâce à une étude en double-EEG et cinématique. Grâce à la comparaison des activités cérébrales motrices intra- et inter-individuelles chez deux participants qui effectuaient ou observaient des actions isolées ou des actions conjointes, nous avons pu mettre en évidence des modulations de l'activité motrice similaires chez les deux particiapnts ainsi que certaines modulations spécifiques à la fois du contexte social (humain vs robot) et du rôle dans l'interaction. L'analyse inter-individuelle a par ailleurs mis en évidence un couplage entre les aires visuelles et motrices des deux particiapnts pendant la condition d'action conjointe. L'ensemble des résultats suggère que le système moteur permet un couplage fin entre les participants d'une interaction, à la fois au travers d'un couplage temporel qui pourrait faciliter l'interaction et également au travers d'une boucle d'action-perception formant une représentation commune de l'action conjointe

Grasp It Loudly! Supporting Actions with Semantically Congruent Spoken Action Words

Evidence for cross-talk between motor and language brain structures has accumulated over the past several years. However, while a significant amount of research has focused on the interaction between language perception and action, little attention has been paid to the potential impact of language production on overt motor behaviour

Neural basis of non-verbal social interactions : implications of the motor system and hyperscanning

Cette thèse s'est intéressée à l'impact des interactions sociales sur l'acitivité motrice, à la fois au niveau comportempentale et cérébral et de caractériser cette modulation au cours d'actions simultanées et d'actions conjointes. Dans un premier temps, nous avons étudié les effets de l'observation d'une activation sur l'exécution motrice. En couplant analyse cinématique et enregistrement EEG, nous avons mis en évidence que l'activation du système des neurones miroirs facilitait l'action seulement lorsque les événements d'exécution et d'observation étaient temporellement coordonnées. Dans un deuxième temps, nous avons cherché à meiux caractériser l'influence du contexte interactif sur l'activité cérébrale de deux participants d'une interaction grâce à une étude en double-EEG et cinématique. Grâce à la comparaison des activités cérébrales motrices intra- et inter-individuelles chez deux participants qui effectuaient ou observaient des actions isolées ou des actions conjointes, nous avons pu mettre en évidence des modulations de l'activité motrice similaires chez les deux particiapnts ainsi que certaines modulations spécifiques à la fois du contexte social (humain vs robot) et du rôle dans l'interaction. L'analyse inter-individuelle a par ailleurs mis en évidence un couplage entre les aires visuelles et motrices des deux particiapnts pendant la condition d'action conjointe. L'ensemble des résultats suggère que le système moteur permet un couplage fin entre les participants d'une interaction, à la fois au travers d'un couplage temporel qui pourrait faciliter l'interaction et également au travers d'une boucle d'action-perception formant une représentation commune de l'action conjointe.This research investigated the impact of social interaction on motor activity, both ona behavioural and cerebral level. More precisely, the aim of the thesis was to characterise this modulation during simultaneous actions, when two participants interact, jointly or not, and to determine its functions. First , we studied the effect of action observation on motor execution. Coupling kinematics analysis and EEG recording, we gave evidence that the temporal time course of motor system activation was crucial for motor interference. We found that motor performances were facilitated by the observation of an action, only when execution and observation events were temporally coordinated. Second, we sought to characterise the influence of an interactive context on brain activity of two interacting participants through the coupling of dual-EEG and kinematic recordings. Thanks to the comparison of intra- and inter-individual brain activity of two participants that observed or performed individual or joint actions, we were able to highlight modulations of cerebral motor activity common in both participants as well as modulations of brain activity specific to the social context (human vs robot) and the role in the interaction (actor vs observer). Moreover, the inter-individual analysis revealed a coupling between the two participants' visual and motor brain areas during the joint action condition. Taken toghther, these results suggest that the motor system allows a tight coupling between interacting participants, mediated by temporal coupling that could facilitate the interaction and through an action-perception loop forming a common motor representation of the joint action

Left hemisphere sources for the 20-Hz activity in one subject.

<p>The dots represent 50 equivalent current dipoles, computed for different cycles of 20-Hz oscillations, superimposed on the subject’s magnetic resonance images. The dipoles cluster around the hand knob, which corresponds to the anatomically defined hand motor area.</p

Group-level MEG power changes induced by median-nerve stimulation.

<p>Resting-state time–frequency maps averaged across a pre-selection of 9 sensors covering the SM1 cortex contralateral to the stimulation side, normalized by their baseline value evaluated from –400 to –100 ms, and averaged across subjects. The strong wide-band power enhancement peaking right after the stimulation reflects somatosensory evoked responses to median-nerve stimulation.</p

Mean ± SD displacement rates [pixels/s] of the ring and of the experimenter’s right thumb.

<p>Mean ± SD displacement rates [pixels/s] of the ring and of the experimenter’s right thumb.</p

Experimental conditions.

<p>Selected frames extracted from the video clips representing the four motor-imagery conditions.</p

MEG power changes induced by median-nerve stimulation.

<p>Example taken from one subject who shows the evolution of the beta activity following the median-nerve stimulation (15–25-Hz frequency band in this subject) (a) Time–frequency representation in rest condition, time-locked to the onset of the median-nerve stimulation, for the left rolandic sensor showing the highest power modulation. For visualization purposes, the power is expressed in percentage of the baseline period chosen from –400 ms to –100 ms. (b) Power evolution for all the conditions in the most reactive ~20-Hz frequency band, at the most reactive sensor. (c) Spatial distribution of the power evolution in the most reactive ~20-Hz frequency band for the rest condition (black) and the action condition (green).</p