A resting state network in the motor control circuit of the basal ganglia

<p>Abstract</p> <p>Background</p> <p>In the absence of overt stimuli, the brain shows correlated fluctuations in functionally related brain regions. Approximately ten largely independent resting state networks (RSNs) showing this behaviour have been documented to date. Recent studies have reported the existence of an RSN in the basal ganglia - albeit inconsistently and without the means to interpret its function. Using two large study groups with different resting state conditions and MR protocols, the reproducibility of the network across subjects, behavioural conditions and acquisition parameters is assessed. Independent Component Analysis (ICA), combined with novel analyses of temporal features, is applied to establish the basis of signal fluctuations in the network and its relation to other RSNs. Reference to prior probabilistic diffusion tractography work is used to identify the basal ganglia circuit to which these fluctuations correspond.</p> <p>Results</p> <p>An RSN is identified in the basal ganglia and thalamus, comprising the pallidum, putamen, subthalamic nucleus and substantia nigra, with a projection also to the supplementary motor area. Participating nuclei and thalamo-cortical connection probabilities allow this network to be identified as the motor control circuit of the basal ganglia. The network was reproducibly identified across subjects, behavioural conditions (fixation, eyes closed), field strength and echo-planar imaging parameters. It shows a frequency peak at 0.025 ± 0.007 Hz and is most similar in spectral composition to the Default Mode (DM), a network of regions that is more active at rest than during task processing. Frequency features allow the network to be classified as an RSN rather than a physiological artefact. Fluctuations in this RSN are correlated with those in the task-positive fronto-parietal network and anticorrelated with those in the DM, whose hemodynamic response it anticipates.</p> <p>Conclusion</p> <p>Although the basal ganglia RSN has not been reported in most ICA-based studies using a similar methodology, we demonstrate that it is reproducible across subjects, common resting state conditions and imaging parameters, and show that it corresponds with the motor control circuit. This characterisation of the basal ganglia network opens a potential means to investigate the motor-related neuropathologies in which the basal ganglia are involved.</p

Computational models of reinforcement learning: the role of dopamine as a reward signal

Reinforcement learning is ubiquitous. Unlike other forms of learning, it involves the processing of fast yet content-poor feedback information to correct assumptions about the nature of a task or of a set of stimuli. This feedback information is often delivered as generic rewards or punishments, and has little to do with the stimulus features to be learned. How can such low-content feedback lead to such an efficient learning paradigm? Through a review of existing neuro-computational models of reinforcement learning, we suggest that the efficiency of this type of learning resides in the dynamic and synergistic cooperation of brain systems that use different levels of computations. The implementation of reward signals at the synaptic, cellular, network and system levels give the organism the necessary robustness, adaptability and processing speed required for evolutionary and behavioral success