A general role for medial prefrontal cortex in event prediction

A recent computational neural model of medial prefrontal cortex (mPFC), namely the predicted response-outcome (PRO) model (Alexander and Brown, 2011), suggests that mPFC learns to predict the outcomes of actions. The model accounted for a wide range of data on the mPFC. Nevertheless, numerous recent findings suggest that mPFC may signal predictions and prediction errors even when the predicted outcomes are not contingent on prior actions. Here we show that the existing PRO model can learn to predict outcomes in a general sense, and not only when the outcomes are contingent on actions. A series of simulations show how this generalized PRO model can account for an even broader range of findings in the mPFC, including human ERP, fMRI, and macaque single-unit data. The results suggest that the mPFC learns to predict salient events in general and provides a theoretical framework that links mPFC function to model-based reinforcement learning, Bayesian learning, and theories of cognitive control

Determining a Role for Ventromedial Prefrontal Cortex in Encoding Action-Based Value Signals During Reward-Related Decision Making

Considerable evidence has emerged to implicate ventromedial prefrontal cortex in encoding expectations of future reward during value-based decision making. However, the nature of the learned associations upon which such representations depend is much less clear. Here, we aimed to determine whether expected reward representations in this region could be driven by action–outcome associations, rather than being dependent on the associative value assigned to particular discriminative stimuli. Subjects were scanned with functional magnetic resonance imaging while performing 2 variants of a simple reward-related decision task. In one version, subjects made choices between 2 different physical motor responses in the absence of discriminative stimuli, whereas in the other version, subjects chose between 2 different stimuli that were randomly assigned to different responses on a trial-by-trial basis. Using an extension of a reinforcement learning algorithm, we found activity in ventromedial prefrontal cortex tracked expected future reward during the action-based task as well as during the stimulus-based task, indicating that value representations in this region can be driven by action–outcome associations. These findings suggest that ventromedial prefrontal cortex may play a role in encoding the value of chosen actions irrespective of whether those actions denote physical motor responses or more abstract decision options

Event-related functional magnetic resonance imaging of reward-related brain circuitry in children and adolescents

BACKGROUND: Functional disturbances in reward-related brain systems are thought to play a role in the development of mood, impulse, and substance abuse disorders. Studies in non-human primates have identified brain regions, including the dorsal / ventral striatum and orbital-frontal cortex (OFC), in which neural activity is modulated by reward. Recent studies in adults have concurred with these findings by observing reward-contingent blood oxygen level dependant (BOLD) responses in these regions during functional magnetic resonance imaging (FMRI) paradigms. However no previous studies indicate whether comparable modulations of neural activity exist in the brain reward systems of children and adolescents. METHODS: We used event-related FMRI and a behavioral paradigm modeled on previous work in adults to study brain responses to monetary gains and losses in non-psychiatric children and adolescents as part of a program examining the neural substrates of anxiety and depression in youth. RESULTS: Regions and time-courses of reward-related activity were similar to those observed in adults with condition-dependent BOLD changes in the ventral striatum, lateral and medial OFC; specifically, these regions showed larger responses to positive than to negative feedback. CONCLUSIONS: These results provide further evidence for the value of event-related FMRI in examining reward systems of the brain, demonstrate the feasibility of this approach in children and adolescents, and establish a baseline from which to understand the pathophysiology of reward-related psychiatric disorders in youth

The role of the lateral prefrontal cortex and anterior cingulate in stimulus–response association reversals

Many complex tasks require us to flexibly switch between behavioral rules, associations, and strategies. The prefrontal cerebral cortex is thought to be critical to the performance of such behaviors, although the relative contribution of different components of this structure and associated subcortical regions are not fully understood. We used functional magnetic resonance imaging to measure brain activity during a simple task which required repeated reversals of a rule linking a colored cue and a left/right motor response. Each trial comprised three discrete events separated by variable delay periods. A colored cue instructed which response was to be executed, followed by a go signal which told the subject to execute the response and a feedback instruction which indicated whether to ‘‘hold’’ or ‘‘f lip’’ the rule linking the colored cue and response. The design allowed us to determine which brain regions were recruited by the specific demands of preparing a rule contingent motor response, executing such a response, evaluating the significance of the feedback, and reconfiguring stimulus–response (SR) associations. The results indicate that an increase in neural activity occurs within the anterior cingulate gyrus under conditions in which SR associations are labile. In contrast, lateral frontal regions are activated by unlikely/unexpected perceptual events regardless of their significance for behavior. A network of subcortical structures, including the mediodorsal nucleus of the thalamus and striatum were the only regions showing activity that was exclusively correlated with the neurocognitive demands of reversing SR associations. We conclude that lateral frontal regions act to evaluate the behavioral significance of perceptual events, whereas medial frontal–thalamic circuits are involved in monitoring and reconfiguring SR associations when necessary

The eye contact effect: mechanisms and development

The ‘eye contact effect’ is the phenomenon that perceived eye contact with another human face modulates certain aspects of the concurrent and/or immediately following cognitive processing. In addition, functional imaging studies in adults have revealed that eye contact can modulate activity in structures in the social brain network, and developmental studies show evidence for preferential orienting towards, and processing of, faces with direct gaze from early in life. We review different theories of the eye contact effect and advance a ‘fast-track modulator’ model. Specifically, we hypothesize that perceived eye contact is initially detected by a subcortical route, which then modulates the activation of the social brain as it processes the accompanying detailed sensory information

Low-frequency oscillatory correlates of auditory predictive processing in cortical-subcortical networks: a MEG-study

Emerging evidence supports the role of neural oscillations as a mechanism for predictive information processing across large-scale networks. However, the oscillatory signatures underlying auditory mismatch detection and information flow between brain regions remain unclear. To address this issue, we examined the contribution of oscillatory activity at theta/alpha-bands (4–8/8–13 Hz) and assessed directed connectivity in magnetoencephalographic data while 17 human participants were presented with sound sequences containing predictable repetitions and order manipulations that elicited prediction-error responses. We characterized the spectro-temporal properties of neural generators using a minimum-norm approach and assessed directed connectivity using Granger Causality analysis. Mismatching sequences elicited increased theta power and phase-locking in auditory, hippocampal and prefrontal cortices, suggesting that theta-band oscillations underlie prediction-error generation in cortical-subcortical networks. Furthermore, enhanced feedforward theta/alpha-band connectivity was observed in auditory-prefrontal networks during mismatching sequences, while increased feedback connectivity in the alpha-band was observed between hippocampus and auditory regions during predictable sounds. Our findings highlight the involvement of hippocampal theta/alpha-band oscillations towards auditory prediction-error generation and suggest a spectral dissociation between inter-areal feedforward vs. feedback signalling, thus providing novel insights into the oscillatory mechanisms underlying auditory predictive processing

Neural computations underlying action-based decision making in the human brain

Action-based decision making involves choices between different physical actions to obtain rewards. To make such decisions the brain needs to assign a value to each action and then compare them to make a choice. Using fMRI in human subjects, we found evidence for action-value signals in supplementary motor cortex. Separate brain regions, most prominently ventromedial prefrontal cortex, were involved in encoding the expected value of the action that was ultimately taken. These findings differentiate two main forms of value signals in the human brain: those relating to the value of each available action, likely reflecting signals that are a precursor of choice, and those corresponding to the expected value of the action that is subsequently chosen, and therefore reflecting the consequence of the decision process. Furthermore, we also found signals in the dorsomedial frontal cortex that resemble the output of a decision comparator, which implicates this region in the computation of the decision itself

Which way do I go? Neural activation in response to feedback and spatial processing in a virtual T-maze

In 2 human event-related brain potential (ERP) experiments, we examined the feedback error-related negativity (fERN), an ERP component associated with reward processing by the midbrain dopamine system, and the N170, an ERP component thought to be generated by the medial temporal lobe (MTL), to investigate the contributions of these neural systems toward learning to find rewards in a "virtual T-maze" environment. We found that feedback indicating the absence versus presence of a reward differentially modulated fERN amplitude, but only when the outcome was not predicted by an earlier stimulus. By contrast, when a cue predicted the reward outcome, then the predictive cue (and not the feedback) differentially modulated fERN amplitude. We further found that the spatial location of the feedback stimuli elicited a large N170 at electrode sites sensitive to right MTL activation and that the latency of this component was sensitive to the spatial location of the reward, occurring slightly earlier for rewards following a right versus left turn in the maze. Taken together, these results confirm a fundamental prediction of a dopamine theory of the fERN and suggest that the dopamine and MTL systems may interact in navigational learning tasks