Speed/Accuracy Trade-Off between the Habitual and the Goal-Directed Processes

Instrumental responses are hypothesized to be of two kinds: habitual and goal-directed, mediated by the sensorimotor and the associative cortico-basal ganglia circuits, respectively. The existence of the two heterogeneous associative learning mechanisms can be hypothesized to arise from the comparative advantages that they have at different stages of learning. In this paper, we assume that the goal-directed system is behaviourally flexible, but slow in choice selection. The habitual system, in contrast, is fast in responding, but inflexible in adapting its behavioural strategy to new conditions. Based on these assumptions and using the computational theory of reinforcement learning, we propose a normative model for arbitration between the two processes that makes an approximately optimal balance between search-time and accuracy in decision making. Behaviourally, the model can explain experimental evidence on behavioural sensitivity to outcome at the early stages of learning, but insensitivity at the later stages. It also explains that when two choices with equal incentive values are available concurrently, the behaviour remains outcome-sensitive, even after extensive training. Moreover, the model can explain choice reaction time variations during the course of learning, as well as the experimental observation that as the number of choices increases, the reaction time also increases. Neurobiologically, by assuming that phasic and tonic activities of midbrain dopamine neurons carry the reward prediction error and the average reward signals used by the model, respectively, the model predicts that whereas phasic dopamine indirectly affects behaviour through reinforcing stimulus-response associations, tonic dopamine can directly affect behaviour through manipulating the competition between the habitual and the goal-directed systems and thus, affect reaction time

ZENK activation in the nidopallium of black-capped chickadees in response to both conspecific and heterospecific calls

Neuronal populations in the songbird nidopallium increase in activity the most to conspecific vocalizations relative to heterospecific songbird vocalizations or artificial stimuli such as tones. Here, we tested whether the difference in neural activity between conspecific and heterospecific vocalizations is due to acoustic differences or to the degree of phylogenetic relatedness of the species producing the vocalizations. To compare differences in neural responses of black-capped chickadees, Poecile atricapillus, to playback conditions we used a known marker for neural activity, ZENK, in the caudal medial nidopallium and caudomedial mesopallium. We used the acoustically complex ‘dee’ notes from chick-a-dee calls, and vocalizations from other heterospecific species similar in duration and spectral features. We tested the vocalizations from three heterospecific species (chestnut-backed chickadees, tufted titmice, and zebra finches), the vocalizations from conspecific individuals (black-capped chickadees), and reversed versions of the latter. There were no significant differences in the amount of expression between any of the groups except in the control condition, which resulted in significantly less neuronal activation. Our results suggest that, in certain cases, neuronal activity is not higher in response to conspecific than in response to heterospecific vocalizations for songbirds, but rather is sensitive to the acoustic features of the signal. Both acoustic features of the calls and the phylogenetic relationship between of the signaler and the receiver interact in the response of the nidopallium.Publisher PDFPeer reviewe