Neuronal evidence for good-based economic decisions under variable action costs

Choices between goods often depend on the action costs, but the mechanisms underlying economic decisions under variable action cost are poorly understood. Here, the authors record from neurons in the monkey orbitofrontal cortex and show that decisions under variable action cost were made in a non-spatial representation

Neuronal encoding of subjective value in dorsal and ventral anterior cingulate cortex

We examined the activity of individual cells in the primate anterior cingulate cortex during an economic choice task. In the experiments, monkeys chose between different juices offered in variables amounts and subjective values were inferred from the animals\u27 choices. We analyzed neuronal firing rates in relation to a large number of behaviorally relevant variables. We report three main results. First, there were robust differences between the dorsal bank (ACCd) and the ventral bank (ACCv) of the cingulate sulcus. Specifically, neurons in ACCd but not in ACCv were modulated by the movement direction. Furthermore, neurons in ACCd were most active before movement initiation, whereas neurons in ACCv were most active after juice delivery. Second, neurons in both areas encoded the identity and the subjective value of the juice chosen by the animal. In contrast, neither region encoded the value of individual offers. Third, the population of value-encoding neurons in both ACCd and ACCv underwent range adaptation. With respect to economic choice, it is interesting to compare these areas with the orbitofrontal cortex (OFC), previously examined. While neurons in OFC encoded both pre-decision and post-decision variables, neurons in ACCd and ACCv only encoded post-decision variables. Moreover, the encoding of the choice outcome (chosen value and chosen juice) in ACCd and ACCv trailed that found in OFC. These observations indicate that economic decisions (i.e., value comparisons) take place upstream of ACCd and ACCv. The coexistence of choice outcome and movement signals in ACCd suggests that this area constitutes a gateway through which the choice system informs motor systems

Neuronal activity in dorsal anterior cingulate cortex during economic choices under variable action costs

The role of the dorsal anterior cingulate cortex (ACCd) in decision making has often been discussed but remains somewhat unclear. On the one hand, numerous studies implicated this area in decisions driven by effort or action cost. On the other hand, work on economic choices between goods (under fixed action costs) found that neurons in ACCd encoded only post-decision variables. To advance our understanding of the role played by this area in decision making, we trained monkeys to choose between different goods (juice types) offered in variable amounts and with different action costs. Importantly, the task design dissociated computation of the action cost from planning of any particular action. Neurons in ACCd encoded the chosen value and the binary choice outcome in several reference frames (chosen juice, chosen cost, chosen action). Thus, this area provided a rich representation of post-decision variables. In contrast to the OFC, neurons in ACCd did not represent pre-decision variables such as individual offer values in any reference frame. Hence, ongoing decisions are unlikely guided by ACCd. Conversely, neuronal activity in this area might inform subsequent actions

Integration of multiple determinants in the neuronal computation of economic values

Economic goods may vary on multiple dimensions (determinants). A central conjecture in decision neuroscience is that choices between goods are made by comparing subjective values computed through the integration of all relevant determinants. Previous work identified three groups of neurons in the orbitofrontal cortex (OFC) of monkeys engaged in economic choices: (1) offer value cells, which encode the value of individual offers; (2) chosen value cells, which encode the value of the chosen good; and (3) chosen juice cells, which encode the identity of the chosen good. In principle, these populations could be sufficient to generate a decision. Critically, previous work did not assess whether offer value cells (the putative input to the decision) indeed encode subjective values as opposed to physical properties of the goods, and/or whether offer value cells integrate multiple determinants. To address these issues, we recorded from the OFC while monkeys chose between risky outcomes. Confirming previous observations, three populations of neurons encoded the value of individual offers, the value of the chosen option, and the value-independent choice outcome. The activity of both offer value cells and chosen value cells encoded values defined by the integration of juice quantity and probability. Furthermore, both populations reflected the subjective risk attitude of the animals. We also found additional groups of neurons encoding the risk associated with a particular option, the risky nature of the chosen option, and whether the trial outcome was positive or negative. These results provide substantial support for the conjecture described above and for the involvement of OFC in good-based decisions.</jats:p

Neuronal origins of reduced accuracy and biases in economic choices under sequential offers

Economic choices are characterized by a variety of biases. Understanding their origins is a long-term goal for neuroeconomics, but progress on this front has been limited. Here, we examined choice biases observed when two goods are offered sequentially. In the experiments, rhesus monkeys chose between different juices offered simultaneously or in sequence. Choices under sequential offers were less accurate (higher variability). They were also biased in favor of the second offer (order bias) and in favor of the preferred juice (preference bias). Analysis of neuronal activity recorded in the orbitofrontal cortex revealed that these phenomena emerged at different computational stages. Lower choice accuracy reflected weaker offer value signals (valuation stage), the order bias emerged during value comparison (decision stage), and the preference bias emerged late in the trial (post-comparison). By neuronal measures, each phenomenon reduced the value obtained on average in each trial and was thus costly to the monkey

Orbitofrontal cortex contributes to the comparison of values underlying economic choices

Economic choices between goods entail the computation and comparison of subjective values. Previous studies examined neuronal activity in the orbitofrontal cortex (OFC) of monkeys choosing between different types of juices. Three groups of neurons were identified: offer value cells encoding the value of individual offers, chosen juice cells encoding the identity of the chosen juice, and chosen value cells encoding the value of the chosen offer. The encoded variables capture both the input (offer value) and the output (chosen juice, chosen value) of the decision process, suggesting that values are compared within OFC. Recent work demonstrates that choices are causally linked to the activity of offer value cells. Conversely, the hypothesis that OFC contributes to value comparison has not been confirmed. Here we show that weak electrical stimulation of OFC specifically disrupts value comparison without altering offer values. This result implies that neuronal populations in OFC participate in value comparison

Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field

AbstractThe primary motor cortex (M1) is known to control motor performance. Recent findings have also implicated M1 in motor learning, as neurons in this area show learning-related plasticity. In the present study, we analyzed the neuronal activity recorded in M1 in a force field adaptation task. Our goal was to investigate the neuronal reorganization across behavioral epochs (before, during, and after adaptation). Here we report two main findings. First, memory cells were present in two classes. With respect to the changes of preferred direction (Pd), these two classes complemented each other after readaptation. Second, for the entire neuronal population, the shift of Pd matched the shift observed for muscles. These results provide a framework whereby the activity of distinct neuronal subpopulations combines to subserve both functions of motor performance and motor learning

Preference Transitivity and Symbolic Representation in Capuchin Monkeys (Cebus apella)

BACKGROUND: Can non-human animals comprehend and employ symbols? The most convincing empirical evidence comes from language-trained apes, but little is known about this ability in monkeys. Tokens can be regarded as symbols since they are inherently non-valuable objects that acquire an arbitrarily assigned value upon exchange with an experimenter. Recent evidence suggested that capuchin monkeys, which diverged from the human lineage 35 million years ago, can estimate, represent and combine token quantities. A fundamental and open question is whether monkeys can reason about symbols in ways similar to how they reason about real objects. METHODOLOGY/PRINCIPAL FINDINGS: Here we examined this broad question in the context of economic choice behavior. Specifically, we assessed whether, in a symbolic context, capuchins' preferences satisfy transitivity--a fundamental trait of rational decision-making. Given three options A, B and C, transitivity holds true if A > or = B, B > or = C and A > or = C (where > or = indicates preference). In this study, we trained monkeys to exchange three types of tokens for three different foods. We then compared choices monkeys made between different types of tokens with choices monkeys made between the foods. Qualitatively, capuchins' preferences revealed by the way of tokens were similar to those measured with the actual foods. In particular, when choosing between tokens, monkeys displayed strict economic preferences and their choices satisfied transitivity. Quantitatively, however, values measured by the way of tokens differed systematically from those measured with the actual foods. In particular, for any pair of foods, the relative value of the preferred food increased when monkeys chose between the corresponding tokens. CONCLUSIONS/SIGNIFICANCE: These results indicate that indeed capuchins are capable of treating tokens as symbols. However, as they do so, capuchins experience the cognitive burdens imposed by symbolic representation