Brain Representations of Dexterous Hand Control: Investigating the Functional Organization of Individuated Finger Movements and Somatosensory Integration

Using our hands to manipulate objects in our daily life requires both dexterous movements and the integration of somatosensory information across fingers. Although the primary motor (M1) and somatosensory cortices (S1) are critical for these two complementary roles, it is unclear how neural populations in these regions functionally represent these processes. This thesis examined the functional organization of brain representations (the representational geometry) in M1 and S1 for dexterous hand control and somatosensory processing. To that end, representational geometries were estimated from fine-grained brain activity patterns measured with functional MRI (fMRI). Since fMRI measures a blood-based proxy of neural activity, any non-linearities in the coupling between neural activity and the fMRI signal could distort the representational geometries. Chapter 2 therefore evaluated the stability of representational geometries. Human participants made individuated finger presses at varying pressing speeds, such that overall activity was modulated across a broad range. Representational geometries were relatively stable across pressing speeds in M1 and S1, validating the use of this analysis framework with fMRI data. Chapter 3 then explored how M1 is organized for dexterous hand control. In agreement with previous research, representations of each finger were quite distinct. However, representations of the same finger moving in different directions were very similar. Insight into this observation was gained by comparing the fMRI results to neural spiking data recorded in monkeys trained to perform an identical task. By leveraging the complementary perspectives offered by fMRI and spiking, a new organization of M1 for finger control was proposed. Chapter 4 then examined how somatosensory inputs from multiple fingers are integrated in S1. The full nature of this integration is unknown. Here, human participants experienced simulation of all possible single- and multi-finger combinations. Representational model analyses revealed that unique non-linear interactions between finger sensory inputs occur throughout S1, with stronger (and more spatially distant) interactions occurring in posterior S1. Altogether, these results provide new insight into how M1 and S1 are functionally organized to serve the motoric and sensory processes of the hand, and more broadly demonstrate how fMRI can be used to make inferences about the underlying functional organization of brain representations

Multivoxel codes for representing and integrating acoustic features in human cortex

Using fMRI and multivariate pattern analysis, we determined whether acoustic features are represented by independent or integrated neural codes in human cortex. Male and female listeners heard band-pass noise varying simultaneously in spectral (frequency) and temporal (amplitude-modulation [AM] rate) features. In the superior temporal plane, changes in multivoxel activity due to frequency were largely invariant with respect to AM rate (and vice versa), consistent with an independent representation. In contrast, in posterior parietal cortex, neural representation was exclusively integrated and tuned to specific conjunctions of frequency and AM features. Direct between-region comparisons show that whereas independent coding of frequency and AM weakened with increasing levels of the hierarchy, integrated coding strengthened at the transition between non-core and parietal cortex. Our findings support the notion that primary auditory cortex can represent component acoustic features in an independent fashion and suggest a role for parietal cortex in feature integration and the structuring of acoustic input. Significance statement A major goal for neuroscience is discovering the sensory features to which the brain is tuned and how those features are integrated into cohesive perception. We used whole-brain human fMRI and a statistical modeling approach to quantify the extent to which sound features are represented separately or in an integrated fashion in cortical activity patterns. We show that frequency and AM rate, two acoustic features that are fundamental to characterizing biological important sounds such as speech, are represented separately in primary auditory cortex but in an integrated fashion in parietal cortex. These findings suggest that representations in primary auditory cortex can be simpler than previously thought and also implicate a role for parietal cortex in integrating features for coherent perception

Spectral pattern similarity analysis: Tutorial and application in developmental cognitive neuroscience

The human brain encodes information in neural activation patterns. While standard approaches to analyzing neural data focus on brain (de-)activation (e.g., regarding the location, timing, or magnitude of neural responses), multivariate neural pattern similarity analyses target the informational content represented by neural activity. In adults, a number of representational properties have been identified that are linked to cognitive performance, in particular the stability, distinctiveness, and specificity of neural patterns. However, although growing cognitive abilities across childhood suggest advancements in representational quality, developmental studies still rarely utilize information-based pattern similarity approaches, especially in electroencephalography (EEG) research. Here, we provide a comprehensive methodological introduction and step-by-step tutorial for pattern similarity analysis of spectral (frequency-resolved) EEG data including a publicly available pipeline and sample dataset with data from children and adults. We discuss computation of single-subject pattern similarities and their statistical comparison at the within-person to the between-group level as well as the illustration and interpretation of the results. This tutorial targets both novice and more experienced EEG researchers and aims to facilitate the usage of spectral pattern similarity analyses, making these methodologies more readily accessible for (developmental) cognitive neuroscientists

A synergy-based hand control is encoded in human motor cortical areas

How the human brain controls hand movements to carry out different tasks is still debated. The concept of synergy has been proposed to indicate functional modules that may simplify the control of hand postures by simultaneously recruiting sets of muscles and joints. However, whether and to what extent synergic hand postures are encoded as such at a cortical level remains unknown. Here, we combined kinematic, electromyography, and brain activity measures obtained by functional magnetic resonance imaging while subjects performed a variety of movements towards virtual objects. Hand postural information, encoded through kinematic synergies, were represented in cortical areas devoted to hand motor control and successfully discriminated individual grasping movements, significantly outperforming alternative somatotopic or muscle-based models. Importantly, hand postural synergies were predicted by neural activation patterns within primary motor cortex. These findings support a novel cortical organization for hand movement control and open potential applications for brain-computer interfaces and neuroprostheses

A synergy-based hand control is encoded in human motor cortical areas

abstract: How the human brain controls hand movements to carry out different tasks is still debated. The concept of synergy has been proposed to indicate functional modules that may simplify the control of hand postures by simultaneously recruiting sets of muscles and joints. However, whether and to what extent synergic hand postures are encoded as such at a cortical level remains unknown. Here, we combined kinematic, electromyography, and brain activity measures obtained by functional magnetic resonance imaging while subjects performed a variety of movements towards virtual objects. Hand postural information, encoded through kinematic synergies, were represented in cortical areas devoted to hand motor control and successfully discriminated individual grasping movements, significantly outperforming alternative somatotopic or muscle-based models. Importantly, hand postural synergies were predicted by neural activation patterns within primary motor cortex. These findings support a novel cortical organization for hand movement control and open potential applications for brain-computer interfaces and neuroprostheses

Visual features as stepping stones toward semantics: Explaining object similarity in IT and perception with non-negative least squares.

Object similarity, in brain representations and conscious perception, must reflect a combination of the visual appearance of the objects on the one hand and the categories the objects belong to on the other. Indeed, visual object features and category membership have each been shown to contribute to the object representation in human inferior temporal (IT) cortex, as well as to object-similarity judgments. However, the explanatory power of features and categories has not been directly compared. Here, we investigate whether the IT object representation and similarity judgments are best explained by a categorical or a feature-based model. We use rich models (>100 dimensions) generated by human observers for a set of 96 real-world object images. The categorical model consists of a hierarchically nested set of category labels (such as "human", "mammal", and "animal"). The feature-based model includes both object parts (such as "eye", "tail", and "handle") and other descriptive features (such as "circular", "green", and "stubbly"). We used non-negative least squares to fit the models to the brain representations (estimated from functional magnetic resonance imaging data) and to similarity judgments. Model performance was estimated on held-out images not used in fitting. Both models explained significant variance in IT and the amounts explained were not significantly different. The combined model did not explain significant additional IT variance, suggesting that it is the shared model variance (features correlated with categories, categories correlated with features) that best explains IT. The similarity judgments were almost fully explained by the categorical model, which explained significantly more variance than the feature-based model. The combined model did not explain significant additional variance in the similarity judgments. Our findings suggest that IT uses features that help to distinguish categories as stepping stones toward a semantic representation. Similarity judgments contain additional categorical variance that is not explained by visual features, reflecting a higher-level more purely semantic representation

Structure of population activity in primary motor cortex for single finger flexion and extension

Copyright © 2020 the authors How is the primary motor cortex (M1) organized to control fine finger movements? We investigated the population activity in M1 for single finger flexion and extension, using 7T functional magnetic resonance imaging (fMRI) in female and male human participants and compared these results to the neural spiking patterns recorded in two male monkeys performing the identical task. fMRI activity patterns were distinct for movements of different fingers, but were quite similar for flexion and extension of the same finger. In contrast, spiking patterns in monkeys were quite distinct for both fingers and directions, which is similar to what was found for muscular activity patterns. The discrepancy between fMRI and electrophysiological measurements can be explained by two (non-mutually exclusive) characteristics of the organization of finger flexion and extension movements. Given that fMRI reflects predominantly input and recurrent activity, the results can be explained by an architecture in which neural populations that control flexion or extension of the same finger produce distinct outputs, but interact tightly with each other and receive similar inputs. Additionally, neurons tuned to different movement directions for the same finger (or combination of fingers) may cluster closely together, while neurons that control different finger combinations may be more spatially separated. When measuring this organization with fMRI at a coarse spatial scale, the activity patterns for flexion and extension of the same finger would appear very similar. Overall, we suggest that the discrepancy between fMRI and electrophysiological measurements provides new insights into the general organization of fine finger movements in M1

Reconstructing neural representations of tactile space

Psychophysical experiments have demonstrated large and highly systematic perceptual distortions of tactile space. Such a space can be referred to our experience of the spatial organisation of objects, at representational level, through touch, in analogy with the familiar concept of visual space. We investigated the neural basis of tactile space by analysing activity patterns induced by tactile stimulation of nine points on a 3 × 3 square grid on the hand dorsum using functional magnetic resonance imaging. We used a searchlight approach within pre-defined regions of interests to compute the pairwise Euclidean distances between the activity patterns elicited by tactile stimulation. Then, we used multidimensional scaling to reconstruct tactile space at the neural level and compare it with skin space at the perceptual level. Our reconstructions of the shape of skin space in contralateral primary somatosensory and motor cortices reveal that it is distorted in a way that matches the perceptual shape of skin space. This suggests that early sensorimotor areas critically contribute to the distorted internal representation of tactile space on the hand dorsum

Motor planning brings human primary somatosensory cortex into action-specific preparatory states

Motor planning plays a critical role in producing fast and accurate movement. Yet, the neural processes that occur in human primary motor and somatosensory cortex during planning, and how they relate to those during movement execution, remain poorly understood. Here, we used 7T functional magnetic resonance imaging and a delayed movement paradigm to study single finger movement planning and execution. The inclusion of no-go trials and variable delays allowed us to separate what are typically overlapping planning and execution brain responses. Although our univariate results show widespread deactivation during finger planning, multivariate pattern analysis revealed finger-specific activity patterns in contralateral primary somatosensory cortex (S1), which predicted the planned finger action. Surprisingly, these activity patterns were as informative as those found in contralateral primary motor cortex (M1). Control analyses ruled out the possibility that the detected information was an artifact of subthreshold movements during the preparatory delay. Furthermore, we observed that finger-specific activity patterns during planning were highly correlated to those during execution. These findings reveal that motor planning activates the specific S1 and M1 circuits that are engaged during the execution of a finger press, while activity in both regions is overall suppressed. We propose that preparatory states in S1 may improve movement control through changes in sensory processing or via direct influence of spinal motor neurons