Brain mechanisms of successful recognition through retrieval of semantic context

Episodic memory is associated with the encoding and retrieval of context information and with a subjective sense of reexperiencing past events. The neural correlates of episodic retrieval have been extensively studied using fMRI, leading to the identification of a "general recollection network" including medial temporal, parietal, and prefrontal regions. However, in these studies, it is difficult to disentangle the effects of context retrieval from recollection. In this study, we used fMRI to determine the extent to which the recruitment of regions in the recollection network is contingent on context reinstatement. Participants were scanned during a cued recognition test for target words from encoded sentences. Studied target words were preceded by either a cue word studied in the same sentence (thus congruent with encoding context) or a cue word studied in a different sentence (thus incongruent with encoding context). Converging fMRI results from independently defined ROIs and whole-brain analysis showed regional specificity in the recollection network. Activity in hippocampus and parahippocampal cortex was specifically increased during successful retrieval following congruent context cues, whereas parietal and prefrontal components of the general recollection network were associated with confident retrieval irrespective of contextual congruency. Our findings implicate medial temporal regions in the retrieval of semantic context, contributing to, but dissociable from, recollective experience

Refresh my memory: Episodic memory reinstatements intrude on working memory maintenance

A fundamental question in memory research is how different forms of memory interact. Previous research has shown that people rely on working memory (WM) in short-term recognition tasks; a common view is that episodic memory (EM) only influences performance on these tasks when WM maintenance is disrupted. However, retrieval of memories from EM has been widely observed during brief periods of quiescence, raising the possibility that EM retrievals during maintenance-critically, before a response can be prepared-might affect short-term recognition memory performance even in the absence of distraction. We hypothesized that this influence would be mediated by the lingering presence of reactivated EM content in WM. We obtained support for this hypothesis in three experiments, showing that delay-period EM reactivation introduces incidentally-associated information ( context ) into WM, and that these retrieved associations negatively impact subsequent recognition, leading to substitution errors (Experiment 1) and slowing of accurate responses (Experiment 2). fMRI pattern analysis showed that slowing is mediated by the content of EM reinstatement (Experiment 3). These results expose a previously hidden influence of EM on WM, raising new questions about the adaptive nature of their interaction

Recollection, Familiarity, and Cortical Reinstatement: A Multivoxel Pattern Analysis

SummaryEpisodic memory retrieval is thought to involve reinstatement of the neurocognitive processes engaged when an episode was encoded. Prior fMRI studies and computational models have suggested that reinstatement is limited to instances in which specific episodic details are recollected. We used multivoxel pattern-classification analyses of fMRI data to investigate how reinstatement is associated with different memory judgments, particularly those accompanied by recollection versus a feeling of familiarity (when recollection is absent). Classifiers were trained to distinguish between brain activity patterns associated with different encoding tasks and were subsequently applied to recognition-related fMRI data to determine the degree to which patterns were reinstated. Reinstatement was evident during both recollection- and familiarity-based judgments, providing clear evidence that reinstatement is not sufficient for eliciting a recollective experience. The findings are interpreted as support for a continuous, recollection-related neural signal that has been central to recent debate over the nature of recognition memory processes

Content reinstatement and source confidence during episodic memory retrieval

Abstract from public.pdf.Episodic retrieval is the process of bringing information about a past experience from memory into conscious awareness. Variation in the retrieval process, in regard to content and quality of the information retrieved, is believed to rely on the reactivation of neural patterns of activity elicited during the original experience -- a process called neural reinstatement. Research in support of this idea has relied on participant reports of retrieval quality, but not content, to assess variation in retrieval. Without measuring the content of retrieval, it is unclear whether reinstatement underlies retrieval per se, or merely the evaluation of retrieval quality. The current study addressed this issue by examining the relationship between the magnitude of neural reinstatement during retrieval, and a direct behavioral measure of both retrieval content and quality. Participants viewed a series of words in the context of three encoding tasks, and then completed a memory test on a series of words in which they first identified the encoding task completed for a given word, and next rated their confidence in that decision. Pattern classification analyses were performed on fMRI data acquired during encoding and retrieval phases to index reinstatement, and reinstatement effects were examined according to the behavioral and neural correlates of source confidence. The findings support a relationship between reinstatement and variation in the content and quality of retrieval, and also suggest a role for regions such as left posterior parietal cortex in monitoring reinstated activity to guide decisions about retrieval quality

Hippocampal and cortical mechanisms at retrieval explain variability in episodic remembering in older adults

Age-related episodic memory decline is characterized by striking heterogeneity across individuals. Hippocampal pattern completion is a fundamental process supporting episodic memory. Yet, the degree to which this mechanism is impaired with age, and contributes to variability in episodic memory, remains unclear. We combine univariate and multivariate analyses of fMRI data from a large cohort of cognitively normal older adults (N=100) to measure hippocampal activity and cortical reinstatement during retrieval of trial-unique associations. Trial-wise analyses revealed that (a) hippocampal activity scaled with reinstatement strength, (b) cortical reinstatement partially mediated the relationship between hippocampal activity and associative retrieval, (c) older age weakened cortical reinstatement and its relationship to memory behaviour. Moreover, individual differences in the strength of hippocampal activity and cortical reinstatement explained unique variance in performance across multiple assays of episodic memory. These results indicate that fMRI indices of hippocampal pattern completion explain within-and across-individual memory variability in older adults

Content representation in the human medial temporal lobe

The transformation of sensory inputs into complex memory representations is fundamental to human experience; yet, little is known about how this crucial process is achieved. When you meet your friend at the new cafe in town, what part of the brain encodes this novel scene into long term memory? What part encoded your friend’s favorite t-shirt, so that the sight of it gives you a feeling of familiarity rather than surprise? It is well-established that the medial temporal lobe (MTL) is crucial to both processes, but the MTL is not a single homogeneous region. In fact, it is composed of several anatomically distinct subregions including hippocampus, perirhinal cortex (PRC) and parahippocampal cortex (PHC). However, the computations performed by each subregion to encode individual events is still unclear. The present research tests the central hypothesis that different forms of event content are transformed into memory by distinct subregions within the MTL. A critical barrier in the study of content representation thus far has been its focus on comparing univariate peak activations in a region to different stimulus materials. To go beyond this limited approach, we employed multivariate statistical analyses that takes into account how event content is represented by distributed activity in MTL subregions. First, we examine the content-specific contributions of MTL subregions to episodic encoding and retrieval. Then, we demonstrate how these distributed representations support memory-based prediction to resolve ambiguities in our environment.Neuroscienc

When the brain, but not the person, remembers: Cortical reinstatement is modulated by retrieval goal in developmental amnesia

Developmental amnesia (DA) is associated with early hippocampal damage and subsequent episodic amnesia emerging in childhood alongside age-appropriate development of semantic knowledge. We employed fMRI to assess whether patients with DA show evidence of 'cortical reinstatement', a neural correlate of episodic memory, despite their amnesia. At study, 23 participants (5 patients) were presented with words overlaid on a scene or a scrambled image for later recognition. Scene reinstatement was indexed by scene memory effects (greater activity for previously presented words paired with a scene rather than scrambled images) that overlapped with scene perception effects. Patients with DA demonstrated scene reinstatement effects in the parahippocampal and retrosplenial cortex that were equivalent to those shown by healthy controls. Behaviourally, however, patients with DA showed markedly impaired scene memory. The data indicate that reinstatement can occur despite hippocampal damage, but that cortical reinstatement is insufficient to support accurate memory performance. Furthermore, scene reinstatement effects were diminished during a retrieval task in which scene information was not relevant for accurate responding, indicating that strategic mnemonic processes operate normally in DA. The data suggest that cortical reinstatement of trial-specific contextual information is decoupled from the experience of recollection in the presence of severe hippocampal atrophy

Content dependence of the neural correlates of recollection: ERP old/new effects for faces, objects and words

As previous research on content-specificity of the neural correlates of recollection is inconclusive, event-related potentials were used to assess old/new effects for faces, objects and words. The data demonstrate temporal differences in ERP old/new effects as a function of item type, supporting the notion that material-dependent processes underlie recollection-related neural activity. The results are discussed in terms of how nameable and non-nameable material elicit different neural representations of mnemonic information, as a consequence of how different item types are encoded and retrieved according to perceptual and contextual content

Mapping Specific Mental Content during Musical Imagery

Humans can mentally represent auditory information without an external stimulus, but the specificity of these internal representations remains unclear. Here, we asked how similar the temporally unfolding neural representations of imagined music are compared to those during the original perceived experience. We also tested whether rhythmic motion can influence the neural representation of music during imagery as during perception. Participants first memorized six 1-min-long instrumental musical pieces with high accuracy. Functional MRI data were collected during: 1) silent imagery of melodies to the beat of a visual metronome; 2) same but while tapping to the beat; and 3) passive listening. During imagery, inter-subject correlation analysis showed that melody-specific temporal response patterns were reinstated in right associative auditory cortices. When tapping accompanied imagery, the melody-specific neural patterns were reinstated in more extensive temporal-lobe regions bilaterally. These results indicate that the specific contents of conscious experience are encoded similarly during imagery and perception in the dynamic activity of auditory cortices. Furthermore, rhythmic motion can enhance the reinstatement of neural patterns associated with the experience of complex sounds, in keeping with models of motor to sensory influences in auditory processing