Contextual novelty changes reward representations in the striatum

Reward representation in ventral striatum is boosted by perceptual novelty, although the mechanism of this effect remains elusive. Animal studies indicate a functional loop (Lisman and Grace, 2005) that includes hippocampus, ventral striatum, and midbrain as being important in regulating salience attribution within the context of novel stimuli. According to this model, reward responses in ventral striatum or midbrain should be enhanced in the context of novelty even if reward and novelty constitute unrelated, independent events. Using fMRI, we show that trials with reward-predictive cues and subsequent outcomes elicit higher responses in the striatum if preceded by an unrelated novel picture, indicating that reward representation is enhanced in the context of novelty. Notably, this effect was observed solely when reward occurrence, and hence reward-related salience, was low. These findings support a view that contextual novelty enhances neural responses underlying reward representation in the striatum and concur with the effects of novelty processing as predicted by the model of Lisman and Grace (2005)

Age-related iron accumulation and demyelination in the basal ganglia are closely related to verbal memory and executive functioning

Age-related cognitive decline has been linked to alterations of the dopaminergic system and its subcortical trajectories. Recent work suggests a critical role of iron accumulation within the basal ganglia (BG) in verbal memory performance, and increased iron levels have been related to demyelination. However, the specificity of age-related iron increases with respect to cognitive functions remains unclear. Therefore, we investigated the interplay of age, cognitive performance, and structural integrity of the BG. In total, 79 healthy older participants underwent a broad cognitive assessment (fluid and crystallized intelligence, verbal and numeric memory, processing speed, executive functions) and structural MRI. As expected, performance in most cognitive tests had a negative relationship with age. Moreover, BG grey matter volume and magnetization transfer (MT, indicative of myelin) decreased, and R2* (indicative of iron) increased with age. Importantly, R2* and demyelination negatively correlated with verbal memory and executive functions. Within the SN/VTA, age correlated negatively with MT, but there was no clear evidence in favor of a relationship between behavior and R2* or MT. Our results suggest that age-related increases in iron and demyelination within the BG, which are part of a fronto-striatal network, not only impact on verbal memory but also executive functions

A Common Mechanism for Adaptive Scaling of Reward and Novelty

Declarative memory is remarkably adaptive in the way it maintains sensitivity to relative novelty in both unknown and highly familiar environments. However, the neural mechanisms underlying this contextual adaptation are poorly understood. On the basis of emerging links between novelty processing and reinforcement learning mechanisms, we hypothesized that responses to novelty will be adaptively scaled according to expected contextual probabilities of new and familiar events, in the same way that responses to prediction errors for rewards are scaled according to their expected range. Using functional magnetic resonance imaging in humans, we show that the influence of novelty and reward on memory formation in an incidental memory task is adaptively scaled and furthermore that the BOLD signal in orbital prefrontal and medial temporal cortices exhibits concomitant scaled adaptive coding. These findings demonstrate a new mechanism for adjusting gain and sensitivity in declarative memory in accordance with contextual probabilities and expectancies of future events. Hum Brain Mapp, 2010. © 2010 Wiley-Liss, Inc

The dopaminergic midbrain participates in human episodic memory formation: Evidence from genetic imaging

Recent data from animal studies raise the possibility that dopaminergic neuromodulation promotes the encoding of novel stimuli. We investigated a possible role for the dopaminergic midbrain in human episodic memory by measuring how polymorphisms in dopamine clearance pathways affect encoding-related brain activity (functional magnetic resonance imaging) in an episodic memory task. In 51 young, healthy adults, successful episodic encoding was associated with activation of the substantia nigra. This midbrain activation was modulated by a functional variable number of tandem repeat (VNTR) polymorphism in the dopamine transporter (DAT1) gene. Despite no differences in memory performance between genotype groups, carriers of the (low expressing) 9-repeat allele of the DAT1 VNTR showed relatively higher midbrain activation when compared with subjects homozygous for the 10-repeat allele, who express DAT1 at higher levels. The catechol-O-methyl transferase (COMT) Val108/158Met polymorphism, which is known to modulate enzyme activity, affected encoding-related activity in the right prefrontal cortex (PFC) and in occipital brain regions but not in the midbrain. Moreover, subjects homozygous for the (low activity) Met allele showed stronger functional coupling between the PFC and the hippocampus during encoding. Our finding that genetic variations in the dopamine clearance pathways affect encoding-related activation patterns in midbrain and PFC provides strong support for a role of dopaminergic neuromodulation in human episodic memory formation. It also supports the hypothesis of anatomically and functionally distinct roles for DAT1 and COMT in dopamine metabolism, with DAT1 modulating rapid, phasic midbrain activity and COMT being particularly involved in prefrontal dopamine clearance

Contextual novelty modulates the neural dynamics of reward anticipation

We investigated how rapidly the reward-predicting properties of visual cues are signaled in the human brain and the extent these reward prediction signals are contextually modifiable. In a magnetoencephalography study, we presented participants with fractal visual cues that predicted monetary rewards with different probabilities. These cues were presented in the temporal context of a preceding novel or familiar image of a natural scene. Starting at similar to 100 ms after cue onset, reward probability was signaled in the event-related fields (ERFs) over temporo-occipital sensors and in the power of theta (5-8 Hz) and beta (20-30 Hz) band oscillations over frontal sensors. While theta decreased with reward probability beta power showed the opposite effect. Thus, in humans anticipatory reward responses are generated rapidly, within 100 ms after the onset of reward-predicting cues, which is similar to the timing established in non-human primates. Contextual novelty enhanced the reward anticipation responses in both ERFs and in beta oscillations starting at similar to 100 ms after cue onset. This very early context effect is compatible with a physiological model that invokes the mediation of a hippocampal-VTA loop according to which novelty modulates neural response properties within the reward circuitry. We conclude that the neural processing of cues that predict future rewards is temporally highly efficient and contextually modifiable

Neural oscillations and event-related potentials reveal how semantic congruence drives long-term memory in both young and older humans

Long-term memory can improve when incoming information is congruent with known semantic information. This so-called congruence effect has widely been shown in younger adults, but age-related changes and neural mechanisms remain unclear. Here, congruence improved recognition memory in younger and older adults (i.e. congruence effect), with only weak evidence for age-related decline in one behavioral study. In an EEG study, however, no significant behavioral differences in the congruence effect could be observed between age-groups. In line with this observation, electroencephalography data show that, in both groups, congruence led to widespread differences in Event-Related Potentials (ERPs), starting at around 400ms after stimulus onset, and theta, alpha and beta oscillations (4-20Hz). Importantly, these congruence-related ERPs were associated to increases in memory performance for congruent items, in both age groups. Finally, the described ERPs and neural oscillations in the theta-alpha range (5-13Hz) were less pronounced in the elderly despite a preserved congruence effect. Together, semantic congruence increases long-term memory across the lifespan, and, at the neural level, this could be linked to neural oscillations in the theta, alpha and beta range, as well as ERPs that were previously associated with semantic processing

Substantia nigra activity level predicts trial-to-trial adjustments in cognitive control

Effective adaptation to the demands of a changing environment requires flexible cognitive control. The medial and the lateral frontal cortices are involved in such control processes, putatively in close interplay with the BG. In particular, dopaminergic projections from the midbrain (i.e., from the substantia nigra [SN] and the ventral tegmental area) have been proposed to play a pivotal role in modulating the activity in these areas for cognitive control purposes. In that dopaminergic involvement has been strongly implicated in reinforcement learning, these ideas suggest functional links between reinforcement learning, where the outcome of actions shapes behavior over time, and cognitive control in a more general context, where no direct reward is involved. Here, we provide evidence from functional MRI in humans that activity in the SN predicts systematic subsequent trial-to-trial RT prolongations that are thought to reflect cognitive control in a stop-signal paradigm. In particular, variations in the activity level of the SN in one trial predicted the degree of RT prolongation on the subsequent trial, consistent with a modulating output signal from the SN being involved in enhancing cognitive control. This link between SN activity and subsequent behavioral adjustments lends support to theoretical accounts that propose dopaminergic control signals that shape behavior both in the presence and in the absence of direct reward. This SN-based modulatory mechanism is presumably mediated via a wider network that determines response speed in this task, including frontal and parietal control regions, along with the BG and the associated subthalamic nucleus

Functional coupling between CA3 and laterobasal amygdala supports schema dependent memory formation

The medial temporal lobe drives semantic congruence dependent memory formation. However, the exact roles of hippocampal subfields and surrounding brain regions remain unclear. Here, we used an established paradigm and high-resolution functional magnetic resonance imaging of the medial temporal lobe together with cytoarchitectonic probability estimates in healthy humans. Behaviorally, robust congruence effects emerged in young and older adults, indicating that schema dependent learning is unimpaired during healthy aging. Within the medial temporal lobe, semantic congruence was associated with hemodynamic activity in the subiculum, CA1, CA3 and dentate gyrus, as well as the entorhinal cortex and laterobasal amygdala. Importantly, a subsequent memory analysis showed increased activity for later remembered vs. later forgotten congruent items specifically within CA3, and this subfield showed enhanced functional connectivity to the laterobasal amygdala. As such, our findings extend current models on schema dependent learning by pinpointing the functional properties of subregions within the medial temporal lobe

Semantic Congruence Drives Long-Term Memory and Similarly Affects Neural Retrieval Dynamics in Young and Older Adults

Learning novel information can be promoted if it is congruent with already stored knowledge. This so-called semantic congruence effect has been broadly studied in healthy young adults with a focus on neural encoding mechanisms. However, the impacts on retrieval, and possible impairments during healthy aging, which is typically associated with changes in declarative long-term memory, remain unclear. To investigate these issues, we used a previously established paradigm in healthy young and older humans with a focus on the neural activity at a final retrieval stage as measured with electroencephalography (EEG). In both age groups, semantic congruence at encoding enhanced subsequent long-term recognition memory of words. Compatible with this observation, semantic congruence led to differences in event-related potentials (ERPs) at retrieval, and this effect was not modulated by age. Specifically, congruence modulated old/new ERPs at a fronto-central (Fz) and left parietal (P3) electrode in a late (400-600 ms) time window, which has previously been associated with recognition memory processes. Importantly, ERPs to old items also correlated with the positive effect of semantic congruence on long-term memory independent of age. Together, our findings suggest that semantic congruence drives subsequent recognition memory across the lifespan through changes in neural retrieval processes

Theta-alpha oscillations bind the hippocampus, prefrontal cortex, and striatum during recollection: Evidence from simultaneous EEG-fMRI

Recollection of contextual information represents the core of human recognition memory. It has been associated with theta (4-8 Hz) power in electrophysiological recordings and, independently, with BOLD effects in a network including the hippocampus and frontal cortex. Although the notion of the hippocampus coordinating neocortical activity by synchronization in the theta range is common among theoretical models of recollection, direct evidence supporting this hypothesis is scarce. To address this apparent gap in our understanding of memory processes, we combined EEG and fMRI during a remember/know recognition task. We can show that recollection-specific theta-alpha (4-13Hz) effects are correlated with increases in hippocampal connectivity with the prefrontal cortex and, importantly, the striatum, areas that have repeatedly been linked to retrieval success. Taken together, our results provide compelling evidence that low frequency oscillations in the theta and alpha range provide a mechanism to functionally bind the hippocampus, prefrontal cortex and striatum during successful recollection