The role of the lateral prefrontal cortex and anterior cingulate in stimulus–response association reversals

Many complex tasks require us to flexibly switch between behavioral rules, associations, and strategies. The prefrontal cerebral cortex is thought to be critical to the performance of such behaviors, although the relative contribution of different components of this structure and associated subcortical regions are not fully understood. We used functional magnetic resonance imaging to measure brain activity during a simple task which required repeated reversals of a rule linking a colored cue and a left/right motor response. Each trial comprised three discrete events separated by variable delay periods. A colored cue instructed which response was to be executed, followed by a go signal which told the subject to execute the response and a feedback instruction which indicated whether to ‘‘hold’’ or ‘‘f lip’’ the rule linking the colored cue and response. The design allowed us to determine which brain regions were recruited by the specific demands of preparing a rule contingent motor response, executing such a response, evaluating the significance of the feedback, and reconfiguring stimulus–response (SR) associations. The results indicate that an increase in neural activity occurs within the anterior cingulate gyrus under conditions in which SR associations are labile. In contrast, lateral frontal regions are activated by unlikely/unexpected perceptual events regardless of their significance for behavior. A network of subcortical structures, including the mediodorsal nucleus of the thalamus and striatum were the only regions showing activity that was exclusively correlated with the neurocognitive demands of reversing SR associations. We conclude that lateral frontal regions act to evaluate the behavioral significance of perceptual events, whereas medial frontal–thalamic circuits are involved in monitoring and reconfiguring SR associations when necessary

Chronic Stress Effects on Prefrontal Cortical Structure and Function

Stressful life events have been implicated clinically in the pathogenesis of major depression, but the neural substrates that may account for this observation remain poorly understood. Attentional impairments symptomatic of depression are associated with structural and functional abnormalities in the prefrontal cortex. In three parallel rodent and human neuroimaging studies, this project assessed the effects of chronic stress on prefrontal cortical structure and function and the behavioral correlates of these changes. The first study used fMRI to elucidate the precise computational contributions of frontoparietal circuitry to attentional control in human subjects, using a task that could be adapted for rats. The results confirmed that the contributions of dorsolateral frontoparietal areas to visual attentional shifts could be dissociated from the regulatory influences of more ventrolateral areas on stimulus/response mappings, in a manner consistent with studies in animal models. They also indicated that anterior cingulate and posterior parietal cortex may act in concert to detect dissociable forms of information processing conflicts and signal to dorsolateral prefrontal cortex the need for increased attentional control. Stress-induced alterations in these regions and in the connections between them may therefore contribute to attentional impairments. The second study tested this hypothesis in rats by examining whether chronic stress effects on medial prefrontal (mPFC) and orbitofrontal (OFC) dendritic morphology underlie impairments in the behaviors that they subserve. Chronic stress induced a selective impairment in attentional control and a corresponding retraction of apical dendritic arbors in mPFC. By contrast, stress did not adversely affect reversal learning or OFC dendritic arborization. These results suggest that prefrontal dendritic remodeling may underlie the attentional deficits that are symptomatic of stress-related mental illness. The third study was designed to extend these findings to human subjects, using the techniques developed in Study 1. Accordingly, chronic stress predicted selective attentional impairments and alterations in prefrontal functional coupling that were reversible after four weeks. Together, these studies outline in broad strokes a mechanistic model by which chronic stress may predispose susceptible persons to the attentional impairments that are characteristic of major depression. Future studies will assess the roles of serotonin and neurotrophins in mediating these changes

Determining a Role for Ventromedial Prefrontal Cortex in Encoding Action-Based Value Signals During Reward-Related Decision Making

Considerable evidence has emerged to implicate ventromedial prefrontal cortex in encoding expectations of future reward during value-based decision making. However, the nature of the learned associations upon which such representations depend is much less clear. Here, we aimed to determine whether expected reward representations in this region could be driven by action–outcome associations, rather than being dependent on the associative value assigned to particular discriminative stimuli. Subjects were scanned with functional magnetic resonance imaging while performing 2 variants of a simple reward-related decision task. In one version, subjects made choices between 2 different physical motor responses in the absence of discriminative stimuli, whereas in the other version, subjects chose between 2 different stimuli that were randomly assigned to different responses on a trial-by-trial basis. Using an extension of a reinforcement learning algorithm, we found activity in ventromedial prefrontal cortex tracked expected future reward during the action-based task as well as during the stimulus-based task, indicating that value representations in this region can be driven by action–outcome associations. These findings suggest that ventromedial prefrontal cortex may play a role in encoding the value of chosen actions irrespective of whether those actions denote physical motor responses or more abstract decision options

Do the rat anterior thalamic nuclei contribute to behavioural flexibility?

The rodent anterior thalamic nuclei (ATN) are vital for spatial memory. A consideration of their extensive frontal connections suggests that these nuclei may also subserve non-spatial functions. The current experiments explored the importance of the ATN for different aspects of behavioural flexibility, including their contribution to tasks typically associated with frontal cortex. In Experiment 1, rats with ATN lesions were tested on a series of response and visual discriminations in an operant box and, subsequently, in a water tank. The tasks included assessments of reversal learning as well switches between each discrimination dimension. Results revealed a mild and transient deficit on the operant task that was not specific to any stage of the procedure. In the water tank, the lesion animals were impaired on the reversal of a spatial discrimination but did not differ from controls on any other measure. Experiment 2 examined the impact of ATN damage on a rodent analogue of the ‘Stroop’, which assesses response choice during stimulus conflict. The lesion animals successfully acquired this task and were able to use contextual information to disambiguate conflicting cue information. However, responding during the initial presentation of conflicting cue information was affected by the lesion. Taken together, these results suggest that the ATN are not required for aspects of behavioural flexibility (discrimination learning, reversals or high-order switches) typically associated with the rat medial prefrontal cortex. The results from Experiment 2 suggest that the non-spatial functions of the ATN may be more aligned with those of the anterior cingulate cortex

Differential brain activity during emotional versus nonemotional reversal learning

The ability to change an established stimulus–behavior association based on feedback is critical for adaptive social behaviors. This ability has been examined in reversal learning tasks, where participants first learn a stimulus–response association (e.g., select a particular object to get a reward) and then need to alter their response when reinforcement contingencies change. Although substantial evidence demonstrates that the OFC is a critical region for reversal learning, previous studies have not distinguished reversal learning for emotional associations from neutral associations. The current study examined whether OFC plays similar roles in emotional versus neutral reversal learning. The OFC showed greater activity during reversals of stimulus–outcome associations for negative outcomes than for neutral outcomes. Similar OFC activity was also observed during reversals involving positive outcomes. Furthermore, OFC activity is more inversely correlated with amygdala activity during negative reversals than during neutral reversals. Overall, our results indicate that the OFC is more activated by emotional than neutral reversal learning and that OFC's interactions with the amygdala are greater for negative than neutral reversal learning

Neuronal Distortions of Reward Probability without Choice

Reward probability crucially determines the value of outcomes. A basic phenomenon, defying explanation by traditional decision theories, is that people often overweigh small and underweigh large probabilities in choices under uncertainty. However, the neuronal basis of such reward probability distortions and their position in the decision process are largely unknown. We assessed individual probability distortions with behavioral pleasantness ratings and brain imaging in the absence of choice. Dorsolateral frontal cortex regions showed experience dependent overweighting of small, and underweighting of large, probabilities whereas ventral frontal regions showed the opposite pattern. These results demonstrate distorted neuronal coding of reward probabilities in the absence of choice, stress the importance of experience with probabilistic outcomes and contrast with linear probability coding in the striatum. Input of the distorted probability estimations to decision-making mechanisms are likely to contribute to well known inconsistencies in preferences formalized in theories of behavioral economics

Triple dissociation of anterior cingulate, posterior cingulate, and medial frontal cortices on visual discrimination tasks using a touchscreen testing procedure for the rat.

Four experiments examined effects of quinolinic acid-induced lesions of the anterior cingulate, posterior cingulate, and medial frontal cortices on tests of visual discrimination learning, using a new touchscreen testing method for rats. Anterior cingulate cortex lesions impaired acquisition of an 8-pair concurrent discrimination task, whereas posterior cingulate cortex lesions facilitated learning but selectively impaired the late stages of acquisition of a visuospatial conditional discrimination. Medial frontal cortex lesions selectively impaired reversal learning when stimuli were difficult to discriminate; lesions of anterior and posterior cingulate cortex had no effect. These results suggest roles for the anterior cingulate, posterior cingulate, and medial frontal cortex in stimulus-reward learning, stimulus-response learning or response generation, and attention during learning, respectively

Examining Theories of Ventromedial Prefrontal Cortex Function

The ventromedial prefrontal cortex (VMPFC) is an intriguing brain region which sends output to and receives input from memory, emotion and reward related structures such as the amygdala, hippocampus, and caudate nucleus. Humans with lesions to the VMPFC on the surface seem to function normally and most have normal intelligence. However, in high-level tasks blending affect and decision-making, they are often highly impaired. This thesis concerns three behavioral experiments of patients with VMPFC damage which contrast and examine hypotheses of VMPFC function. In Experiment 1, the hypothesis that the VMPFC is involved in representing social knowledge was tested with more rigorous methods and a non social control task. Results did not support a specific role of the VMPFC in social knowledge. In Experiments 2 & 3, the hypothesis that VMPFC is involved in rapid reversal of stimulus-reinforcer associations was examined in detail. A gambling task and a probabilistic learning task helped discriminate punishment versus reward processing. Experiment 2 revealed normal performance of VMPFC patients in a rewards-only reversal task, in contrast to performance on previous gambling tasks with both reversal and punishment. Experiment 3 added to this evidence for a special function in punishment processing by examining learning from punishment versus learning from reward. Results revealed deficits in punishment learning, but not reward learning, after damage to the VMPFC. In conclusion, these experiments suggest a special role for the VMPFC in punishment processing, especially when a change in stimulus choice is indicated

Executive control in the anterior cingulate cortex

Converging evidence supports the hypothesis that the prefrontal cortex is critical for executive control. One prefrontal subregion, the anterior cingulate cortex has previously been shown to be active in situations involving high conflict, presentation of salient, distracting stimuli, and error processing, i.e. situations that occur when learning new response contingencies, when previously learned response strategies fail, or when a shift in attention or responding is required. These situations all involve goal-oriented monitoring of performance in order to effectively adjust cognitive processes. Several neuropsychological disorders, for instance schizophrenia, attention deficit hyperactivity disorder, and obsessive compulsive disorder, are correlated with morphological changes in the anterior cingulate cortex. Individuals with these disorders show impairments on tasks that require goal-oriented monitoring. The current studies used multiple behavioral paradigms to assess the effects of anterior cingulate cortex excitotoxic lesions in rats on executive control. Animals with anterior cingulate cortex lesions showed greater decline in cognitive capacity as tasks progressed, longer response latencies to conflicting stimuli, impaired reversal learning, impaired error processing, and impaired performance in the presence of previously relevant distractors. These results are consistent with the hypothesis that the anterior cingulate cortex is involved in executive control, specifically monitoring impairments in performance that signal the need to adjust cognitive control

Basolateral Amygdala Lesions Abolish Orbitofrontal-Dependent Reversal Impairments

SummaryDamage to orbitofrontal cortex (OFC) has long been associated with deficits in reversal learning. OFC damage also causes inflexible associative encoding in basolateral amygdala (ABL) during reversal learning. Here we provide a critical test of the hypothesis that the reversal deficit in OFC-lesioned rats is caused by this inflexible encoding in ABL. Rats with bilateral neurotoxic lesions of OFC, ABL, or both areas were tested on a series of two-odor go/no-go discrimination problems, followed by two serial reversals of the final problem. As expected, all groups acquired the initial problems at the same rate, and rats with OFC lesions were slower to acquire the reversals than sham controls. This impairment was abolished by accompanying ABL lesions, while ABL lesions alone had no effect on reversal learning. These results are consistent with the hypothesis that OFC facilitates cognitive flexibility by promoting updating of associative encoding in downstream brain areas