Impact of Size and Delay on Neural Activity in the Rat Limbic Corticostriatal System

A number of factors influence an animal’s economic decisions. Two most commonly studied are the magnitude of and delay to reward. To investigate how these factors are represented in the firing rates of single neurons, we devised a behavioral task that independently manipulated the expected delay to and size of reward. Rats perceived the differently delayed and sized rewards as having different values and were more motivated under short delay and big-reward conditions than under long delay and small reward conditions as measured by percent choice, accuracy, and reaction time. Since the creation of this task, we have recorded from several different brain areas including, orbitofrontal cortex, striatum, amygdala, substantia nigra pars reticulata, and midbrain dopamine neurons. Here, we review and compare those data with a substantial focus on those areas that have been shown to be critical for performance on classic time discounting procedures and provide a potential mechanism by which they might interact when animals are deciding between differently delayed rewards. We found that most brain areas in the cortico-limbic circuit encode both the magnitude and delay to reward delivery in one form or another, but only a few encode them together at the single neuron level

Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation

SummaryWe monitored single-neuron activity in the orbitofrontal cortex of rats performing a time-discounting task in which the spatial location of the reward predicted whether the delay preceding reward delivery would be short or long. We found that rewards delivered after a short delay elicited a stronger neuronal response than those delivered after a long delay in most neurons. Activity in these neurons was not influenced by reward size when delays were held constant. This was also true for a minority of neurons that exhibited sustained increases in firing in anticipation of delayed reward. Thus, encoding of time-discounted rewards in orbitofrontal cortex is independent of the encoding of absolute reward value. These results are contrary to the proposal that orbitofrontal neurons signal the value of delayed rewards in a common currency and instead suggest alternative proposals for the role this region plays in guiding responses for delayed versus immediate rewards

Impacts of inter-trial interval duration on a computational model of sign-tracking vs. goal-tracking behaviour

International audienceIn the context of Pavlovian conditioning, two types of behaviour may emerge within the population (Flagel et al. Nature, 469(7328): 53-57, 2011). Animals may choose to engage either with the conditioned stimulus (CS), a behaviour known as sign-tracking (ST) which is sensitive to dopamine inhibition for its acquisition, or with the food cup in which the reward or unconditioned stimulus (US) will eventually be delivered, a behaviour known as goal-tracking (GT) which is dependent on dopamine for its expression only. Previous work by Lesaint et al. (PLoS Comput Biol, 10(2), 2014) offered a computational explanation for these phenomena and led to the prediction that varying the duration of the inter-trial interval (ITI) would change the relative ST-GT proportion in the population as well as phasic dopamine responses. A recent study verified this prediction, but also found a rich variance of ST and GT behaviours within the trial which goes beyond the original computational model. In this paper, we provide a computational perspective on these novel results

Cocaine Exposure Shifts the Balance of Associative Encoding from Ventral to Dorsolateral Striatum

Both dorsal and ventral striatum are implicated in the “habitization” of behavior that occurs in addiction. Here we examined the effect of cocaine exposure on associative encoding in these two regions. Neural activity was recorded during go/no-go discrimination learning and reversal. Activity in ventral striatum developed and reversed rapidly, tracking the valence of the predicted outcome, whereas activity in dorsolateral striatum developed and reversed more slowly, tracking discriminative responding. This difference is consistent with the putative roles of these two areas in promoting habit-like behavior. Dorsolateral striatum has been directly implicated in habit or stimulus–response learning, whereas ventral striatum appears to be involved indirectly by allowing cues associated with reward to exert a general motivational influence on responding. Interestingly cocaine exposure did not uniformly enhance processing across both regions. Instead cocaine reduced the degree and flexibility of cue-evoked firing in ventral striatum while marginally enhanced cue-selective firing in dorsolateral striatum. Thus cocaine exposure causes regionally specific effects on neural processing in striatum; these effects may promote the habitization of behavior by shifting control from ventral to dorsolateral regions

Abstract platforms of computation

Computational formalisms have been pushing the boundaries of the field of computing for the last 80 years and much debate has surrounded what computing entails; what it is, and what it is not. This paper seeks to explore the boundaries of the ideas of computation and provide a framework for enabling a constructive discussion of computational ideas. First, a review of computing is given, ranging from Turing Machines to interactive computing. Then, a variety of natural physical systems are considered for their computational qualities. From this exploration, a framework is presented under which all dynamical systems can be considered as instances of the class of abstract computational platforms. An abstract computational platform is defined by both its intrinsic dynamics and how it allows computation that is meaningful to an external agent through the configuration of constraints upon those dynamics. It is asserted that a platform’s computational expressiveness is directly related to the freedom with which constraints can be placed. Finally, the requirements for a formal constraint description language are considered and it is proposed that Abstract State Machines may provide a reasonable basis for such a language

Neural Correlates of Stimulus–Response and Response–Outcome Associations in Dorsolateral Versus Dorsomedial Striatum

Considerable evidence suggests that there is functional heterogeneity in the control of behavior by the dorsal striatum. Dorsomedial striatum may support goal-directed behavior by representing associations between responses and outcomes (R–O associations). The dorsolateral striatum, in contrast, may support motor habits by encoding associations between stimuli and responses (S–R associations). To test whether neural correlates in striatum in fact conform to this pattern, we recorded single-units in dorsomedial and dorsolateral striatum of rats performing a task in which R–O contingencies were manipulated independently of S–R contingencies. Among response-selective neurons in both regions, activity was significantly modulated by the initial stimulus, providing evidence of S–R encoding. Similarly, response selectivity was significantly modulated by the associated outcome in both regions, providing evidence of R–O encoding. In both regions, this outcome-modulation did not seem to reflect the relative value of the expected outcome, but rather its specific identity. Finally, in both regions we found correlates of the available action–outcome contingencies reflected in the baseline activity of many neurons. These results suggest that differences in information content in these two regions may not determine the differential roles they play in controlling behavior, demonstrated in previous studies

SISALv2: A comprehensive speleothem isotope database with multiple age-depth models

Characterizing the temporal uncertainty in palaeoclimate records is crucial for analysing past climate change, correlating climate events between records, assessing climate periodicities, identifying potential triggers and evaluating climate model simulations. The first global compilation of speleothem isotope records by the SISAL (Speleothem Isotope Synthesis and Analysis) working group showed that age model uncertainties are not systematically reported in the published literature, and these are only available for a limited number of records (ca. 15 %, n = 107=691). To improve the usefulness of the SISAL database, we have (i) improved the database's spatiooral coverage and (ii) created new chronologies using seven different approaches for age depth modelling. We have applied these alternative chronologies to the records from the first version of the SISAL database (SISALv1) and to new records compiled since the release of SISALv1. This paper documents the necessary changes in the structure of the SISAL database to accommodate the inclusion of the new age models and their uncertainties as well as the expansion of the database to include new records and the qualitycontrol measures applied. This paper also documents the age depth model approaches used to calculate the new chronologies. The updated version of the SISAL database (SISALv2) contains isotopic data from 691 speleothem records from 294 cave sites and new age depth models, including age depth temporal uncertainties for 512 speleothems. SISALv2 is available at https://doi.org/10.17864/1947.256 (Comas-Bru et al., 2020a). © 2020 Author(s)