Synchronicity:The Role of Midbrain Dopamine in Whole-Brain Coordination

Midbrain dopamine seems to play an outsized role in motivated behavior and learning. Widely associated with mediating reward-related behavior, decision making, and learning, dopamine continues to generate controversies in the field. While many studies and theories focus on what dopamine cells encode, the question of how the midbrain derives the information it encodes is poorly understood and comparatively less addressed. Recent anatomical studies suggest greater diversity and complexity of afferent inputs than previously appreciated, requiring rethinking of prior models. Here, we elaborate a hypothesis that construes midbrain dopamine as implementing a Bayesian selector in which individual dopamine cells sample afferent activity across distributed brain substrates, comprising evidence to be evaluated on the extent to which stimuli in the on-going sensorimotor stream organizes distributed, parallel processing, reflecting implicit value. To effectively generate a temporally resolved phasic signal, a population of dopamine cells must exhibit synchronous activity. We argue that synchronous activity across a population of dopamine cells signals consensus across distributed afferent substrates, invigorating responding to recognized opportunities and facilitating further learning. In framing our hypothesis, we shift from the question of how value is computed to the broader question of how the brain achieves coordination across distributed, parallel processing. We posit the midbrain is part of an “axis of agency” in which the prefrontal cortex (PFC), basal ganglia (BGS), and midbrain form an axis mediating control, coordination, and consensus, respectively

High Fructose Corn Syrup Induces Metabolic Dysregulation and Altered Dopamine Signaling in the Absence of Obesity

The contribution of high fructose corn syrup (HFCS) to metabolic disorder and obesity, independent of high fat, energy-rich diets, is controversial. While high-fat diets are widely accepted as a rodent model of diet-induced obesity (DIO) and metabolic disorder, the value of HFCS alone as a rodent model of DIO is unclear. Impaired dopamine function is associated with obesity and high fat diet, but the effect of HFCS on the dopamine system has not been investigated. The objective of this study was to test the effect of HFCS on weight gain, glucose regulation, and evoked dopamine release using fast-scan cyclic voltammetry. Mice (C57BL/6) received either water or 10% HFCS solution in combination with ad libitum chow for 15 weeks. HFCS consumption with chow diet did not induce weight gain compared to water, chow-only controls but did induce glucose dysregulation and reduced evoked dopamine release in the dorsolateral striatum. These data show that HFCS can contribute to metabolic disorder and altered dopamine function independent of weight gain and high-fat diets

To Do or Not to Do: Dopamine, Affordability and the Economics of Opportunity

Five years ago, we introduced the thrift hypothesis of dopamine (DA), suggesting that the primary role of DA in adaptive behavior is regulating behavioral energy expenditure to match the prevailing economic conditions of the environment. Here we elaborate that hypothesis with several new ideas. First, we introduce the concept of affordability, suggesting that costs must necessarily be evaluated with respect to the availability of resources to the organism, which computes a value not only for the potential reward opportunity, but also the value of resources expended. Placing both costs and benefits within the context of the larger economy in which the animal is functioning requires consideration of the different timescales against which to compute resource availability, or average reward rate. Appropriate windows of computation for tracking resources requires corresponding neural substrates that operate on these different timescales. In discussing temporal patterns of DA signaling, we focus on a neglected form of DA plasticity and adaptation, changes in the physical substrate of the DA system itself, such as up- and down-regulation of receptors or release probability. We argue that changes in the DA substrate itself fundamentally alter its computational function, which we propose mediates adaptations to longer temporal horizons and economic conditions. In developing our hypothesis, we focus on DA D2 receptors (D2R), arguing that D2R implements a form of “cost control” in response to the environmental economy, serving as the “brain’s comptroller”. We propose that the balance between the direct and indirect pathway, regulated by relative expression of D1 and D2 DA receptors, implements affordability. Finally, as we review data, we discuss limitations in current approaches that impede fully investigating the proposed hypothesis and highlight alternative, more semi-naturalistic strategies more conducive to neuroeconomic investigations on the role of DA in adaptive behavior

The Rise and Fall of Dopamine: A Two-Stage Model of the Development and Entrenchment of Anorexia Nervosa

Dopamine has long been implicated as a critical neural substrate mediating anorexia nervosa (AN). Despite nearly 50 years of research, the putative direction of change in dopamine function remains unclear and no consensus on the mechanistic role of dopamine in AN has been achieved. We hypothesize two stages i n AN– corresponding to initial development and entrenchment– characterized by opposite changes in dopamine. First, caloric restriction, particularly when combined with exercise, triggers an escalating spiral of increasing dopamine that facilitates the behavioral plasticity necessary to establish and reinforce weight-loss behaviors. Second, chronic self-starvation reverses this escalation to reduce or impair dopamine which, in turn, confers behavioral inflexibility and entrenchment of now established AN behaviors. This pattern of enhanced, followed by impaired dopamine might be a common path to many behavioral disorders characterized by reinforcement learning and subsequent behavioral inflexibility. If correct, our hypothesis has significant clinical and research implications for AN and other disorders, such as addiction and obesity

Tonic Dopamine Modulates Exploitation of Reward Learning

The impact of dopamine on adaptive behavior in a naturalistic environment is largely unexamined. Experimental work suggests that phasic dopamine is central to reinforcement learning whereas tonic dopamine may modulate performance without altering learning per se; however, this idea has not been developed formally or integrated with computational models of dopamine function. We quantitatively evaluate the role of tonic dopamine in these functions by studying the behavior of hyperdopaminergic DAT knockdown mice in an instrumental task in a semi-naturalistic homecage environment. In this “closed economy” paradigm, subjects earn all of their food by pressing either of two levers, but the relative cost for food on each lever shifts frequently. Compared to wild-type mice, hyperdopaminergic mice allocate more lever presses on high-cost levers, thus working harder to earn a given amount of food and maintain their body weight. However, both groups show a similarly quick reaction to shifts in lever cost, suggesting that the hyperdominergic mice are not slower at detecting changes, as with a learning deficit. We fit the lever choice data using reinforcement learning models to assess the distinction between acquisition and expression the models formalize. In these analyses, hyperdopaminergic mice displayed normal learning from recent reward history but diminished capacity to exploit this learning: a reduced coupling between choice and reward history. These data suggest that dopamine modulates the degree to which prior learning biases action selection and consequently alters the expression of learned, motivated behavior

A Soluble C1b Protein and Its Regulation of Soluble Type 7 Adenylyl Cyclase†

Adenylyl cyclase (AC) is a prototypical cell-signaling molecule expressed in virtually all organisms from bacteria to man. While C1b, a poorly conserved region within mammalian AC, has been implicated in numerous isoform-specific regulatory properties, no one has purified the C1b region as a functional protein to homogeneity in order to study its role in enzyme function. We hypothesize that C1b is an internal regulatory subunit. To pursue this hypothesis, we constructed several soluble C1b proteins from type VII AC, arriving at one, 7C1b-S, which can be expressed and purified from Escherichia coli. 7C1b-S is relatively stable, as demonstrated by limited proteolytic analysis, circular dichroism, and UV Raman spectroscopy. Using size-exclusion chromatography and co-immunoprecipitation we demonstrate that 7C1b-S interacts with a cardinal activator of AC (Gsα) and with the conserved first catalytic domain (C1a) of type VII AC. We show that 7C1b-S inhibits Gsα-stimulated and Gsα-forskolin stimulated activity in our soluble ACVII model system. On the basis of these results, we suggest that 7C1b-S meets basic criteria to serve as a model protein for the C1b region and may be used as a prototype to develop other isoform C1b soluble model proteins to further investigate the role of this domain in isoform-specific regulation of adenylyl cyclase

Stimulation of Midbrain Dopaminergic Structures Modifies Firing Rates of Rat Lateral Habenula Neurons

Ventral tegmental area (VTA) and substantia nigra pars compacta (SNpc) are midbrain structures known to be involved in mediating reward in rodents. Lateral habenula (LHb) is considered as a negative reward source and it is reported that stimulation of the LHb rapidly induces inhibition of firing in midbrain dopamine neurons. Interestingly, the phasic fall in LHb neuronal activity may follow the excitation of dopamine neurons in response to reward-predicting stimuli. The VTA and SNpc give rise to dopaminergic projections that innervate the LHb, which is also known to be involved in processing painful stimuli. But it's unclear what physiological effects these inputs have on habenular function. In this study we distinguished the LHb pain-activated neurons of the Wistar rats and assessed their electrophysiological responsiveness to the stimulation of the VTA and SNpc with either single-pulse stimulation (300 µA, 0.5 Hz) or tetanic stimulation (80 µA, 25 Hz). Single-pulse stimulation that was delivered to either midbrain structure triggered transient inhibition of firing of ∼90% of the LHb pain-activated neurons. However, tetanic stimulation of the VTA tended to evoke an elevation in neuronal firing rate. We conclude that LHb pain-activated neurons can receive diverse reward-related signals originating from midbrain dopaminergic structures, and thus participate in the regulation of the brain reward system via both positive and negative feedback mechanisms

Perineuronal Nets Play a Role in Regulating Striatal Function in the Mouse

The striatum is the primary input nucleus of the basal ganglia, a collection of nuclei that play important roles in motor control and associative learning. We have previously reported that perineuronal nets (PNNs), aggregations of chondroitin-sulfate proteoglycans (CSPGs), form in the matrix compartment of the mouse striatum during the second postnatal week. This period overlaps with important developmental changes, including the attainment of an adult-like gait. Here, we investigate the identity of the cells encapsulated by PNNs, characterize their topographical distribution and determine their function by assessing the impact of enzymatic digestion of PNNs on two striatum-dependent behaviors: ambulation and goal-directed spatial learning. We show PNNs are more numerous caudally, and that a substantial fraction (41%) of these structures surrounds parvalbumin positive (PV+) interneurons, while approximately 51% of PV+ cells are ensheathed by PNNs. The colocalization of these structures is greatest in dorsal, lateral and caudal regions of the striatum. Bilateral digestion of striatal PNNs led to an increase in both the width and variability of hind limb gait. Intriguingly, this also resulted in an improvement in the acquisition rate of the Morris water maze. Together, these data show that PNNs are associated with specific elements of striatal circuits and play a key role in regulating the function of this important structure in the mouse

Altered Perceptual Sensitivity to Kinematic Invariants in Parkinson's Disease

Ample evidence exists for coupling between action and perception in neurologically healthy individuals, yet the precise nature of the internal representations shared between these domains remains unclear. One experimentally derived view is that the invariant properties and constraints characterizing movement generation are also manifested during motion perception. One prominent motor invariant is the “two-third power law,” describing the strong relation between the kinematics of motion and the geometrical features of the path followed by the hand during planar drawing movements. The two-thirds power law not only characterizes various movement generation tasks but also seems to constrain visual perception of motion. The present study aimed to assess whether motor invariants, such as the two thirds power law also constrain motion perception in patients with Parkinson's disease (PD). Patients with PD and age-matched controls were asked to observe the movement of a light spot rotating on an elliptical path and to modify its velocity until it appeared to move most uniformly. As in previous reports controls tended to choose those movements close to obeying the two-thirds power law as most uniform. Patients with PD displayed a more variable behavior, choosing on average, movements closer but not equal to a constant velocity. Our results thus demonstrate impairments in how the two-thirds power law constrains motion perception in patients with PD, where this relationship between velocity and curvature appears to be preserved but scaled down. Recent hypotheses on the role of the basal ganglia in motor timing may explain these irregularities. Alternatively, these impairments in perception of movement may reflect similar deficits in motor production

To Do or Not to Do: Dopamine, Affordability and the Economics of Opportunity

Five years ago, we introduced the thrift hypothesis of dopamine (DA), suggesting that the primary role of DA in adaptive behavior is regulating behavioral energy expenditure to match the prevailing economic conditions of the environment. Here we elaborate that hypothesis with several new ideas. First, we introduce the concept of affordability, suggesting that costs must necessarily be evaluated with respect to the availability of resources to the organism, which computes a value not only for the potential reward opportunity, but also the value of resources expended. Placing both costs and benefits within the context of the larger economy in which the animal is functioning requires consideration of the different timescales against which to compute resource availability, or average reward rate. Appropriate windows of computation for tracking resources requires corresponding neural substrates that operate on these different timescales. In discussing temporal patterns of DA signaling, we focus on a neglected form of DA plasticity and adaptation, changes in the physical substrate of the DA system itself, such as up- and down-regulation of receptors or release probability. We argue that changes in the DA substrate itself fundamentally alter its computational function, which we propose mediates adaptations to longer temporal horizons and economic conditions. In developing our hypothesis, we focus on DA D2 receptors (D2R), arguing that D2R implements a form of “cost control” in response to the environmental economy, serving as the “brain’s comptroller”. We propose that the balance between the direct and indirect pathway, regulated by relative expression of D1 and D2 DA receptors, implements affordability. Finally, as we review data, we discuss limitations in current approaches that impede fully investigating the proposed hypothesis and highlight alternative, more semi-naturalistic strategies more conducive to neuroeconomic investigations on the role of DA in adaptive behavior