Recoding between two types of STM representation revealed by the dynamics of memory search

Visual STM (VSTM) is thought to be related to visual attention in several ways. Attention controls access to VSTM during memory encoding and plays a role in the maintenance of stored information by strengthening memorized content. We investigated the involvement of visual attention in recall from VSTM. In two experiments, we measured electrophysiological markers of attention in a memory search task with varying intervals between VSTM encoding and recall, and so we were able to track recoding of representations in memory. Results confirmed the involvement of attention in VSTM recall. However, the amplitude of the N2pc and N3rs components, which mark orienting of attention and search within VSTM, decreased as a function of delay. Conversely, the amplitude of the P3 and sustained posterior contralateral negativity components increased as a function of delay, effectively the opposite of the N2pc and N3rs modulations. These effects were only observed when verbal memory was not taxed. Thus, the results suggested that gradual recoding from visuospatial orienting of attention into verbal recall mechanisms takes place from short to long retention intervals. Interestingly, recall at longer delays was faster than at short delays, indicating that verbal representation is coupled with faster responses. These results extend the orienting-of-attention hypothesis by including an account of representational recoding during short-term consolidation and its consequences for recall from VSTM

Neural evidence for a distinction between short-term memory and the focus of attention

It is widely assumed that the short-term retention of information is accomplished via maintenance of an active neural trace. However, we demonstrate that memory can be preserved across a brief delay despite the apparent loss of sustained representations. Delay period activity may, in fact, reflect the focus of attention, rather than STM. We unconfounded attention and memory by causing external and internal shifts of attention away from items that were being actively retained. Multivariate pattern analysis of fMRI indicated that only items within the focus of attention elicited an active neural trace. Activity corresponding to representations of items outside the focus quickly dropped to baseline. Nevertheless, this information was remembered after a brief delay. Our data also show that refocusing attention toward a previously unattended memory item can reactivate its neural signature. The loss of sustained activity has long been thought to indicate a disruption of STM, but our results suggest that, even for small memory loads not exceeding the capacity limits of STM, the active maintenance of a stimulus representation may not be necessary for its short-term retention

Étude électrophysiologique du balayage de la mémoire à court terme acoustique : décours temporel et effet de force de la trace mnésique

Notre but était de mieux comprendre les mécanismes associés à la récupération en mémoire à court terme acoustique à l’aide de mesures électrophysiologiques. La tâche utilisée était une version modifiée de la tâche de Sternberg dans laquelle les participants devaient retenir deux, quatre ou six sons purs hors de la gamme musical bien tempérée, ne pouvant pas être facilement recodés verbalement. Après un intervalle de rétention silencieux, ils entendaient un son et devaient indiquer si celui-ci était présent ou absent dans l’ensemble mémoire. En utilisant plusieurs conditions de charge et en contrôlant pour les durées de stimulation, nous avons comparé les effets de position sérielle, ainsi que les effets de charge, sur les données comportementales et sur les données électrophysiologiques mesurées lors du balayage mnésique. Notamment, nous avons trouvé un effet de récence important peu importe le nombre d’items mémorisés, se traduisant par des temps de réponses courts et des taux de bonne réponse presque parfaits, ainsi que par l’augmentation de l’amplitude de la P3, une composante de potentiels reliés aux évènements (PRE). Les données liées aux autres positions sérielles étaient similaires, indépendamment de la charge mnésique, et montraient des performances moins bonnes et une P3 moins ample. Une méthode de décomposition du signal, l’analyse en composantes indépendantes (ACI) nous a permis d’observer et de décrire les différences électrophysiologiques, dans le temps, entre la récupération d’un son parfaitement retenu (le dernier) et celle d’un son peu retenu. Nos résultats suggèrent l’existence de deux sous-types de mémoire sensorielle.We aimed to understand better the processes involved in acoustic short-term memory retrieval using electrophysiology. We used a modified Sternberg task in which participants had to encode two, four, or six pure non-musical tones (out of the well-tempered musical scale) that cannot be readily recoded verbally. After a silent retention interval, we presented them with a probe tone and they had to report its presence or absence in the memory set. By using multiple load conditions, and by controlling for stimulation duration, we compared the serial position effects, as well as the load effects, on behavioral and electrophysiological data during memory scanning. In particular, we found a recency effect, similar across loads, where shorter response times, near perfect accuracy, and an increased P3 amplitude in the event-related potential (ERP) data were observed. Serial position data for all other positions were similar regardless of the memory load and showed lower performances (response times and accuracy), as well as smaller P3 components. We also performed a signal decomposition analysis, the independent component analysis (ICA), which allowed us to observe and describe better the time courses of the electrophysiological data for the retrieval of a perfectly memorised tone (the last one), and a lesser memorised one (any other serial position). Our results suggest the existence of two subtypes of sensory memory

rTMS evidence for a dissociation in short-term memory for spoken words and nonwords

Differing patterns of verbal short-term memory (STM) impairment have provided unique insights into the relationship between STM and broader language function. Lexicality effects (i.e., better recall for words than nonwords) are larger in patients with phonological deficits following left temporoparietal lesions, and smaller in patients with semantic impairment and anterior temporal damage, supporting linguistic accounts of STM. However, interpretation of these patient dissociations are complicated by (i) non-focal damage and (ii) confounding factors and secondary impairments. This study addressed these issues by examining the impact of inhibitory transcranial magnetic stimulation (TMS) on auditory-verbal STM performance in healthy individuals. We compared the effects of TMS to left anterior supramarginal gyrus (SMG) and left anterior middle temporal gyrus (ATL) on STM for lists of nonwords and random words. SMG stimulation disrupted nonword recall, in a pattern analogous to that observed in patients, compatible with a role for this site in processing speech sounds without support from long-term lexical-semantic representations. Stimulation of ATL, a semantic site, disrupted the recall of words but not nonwords. A visual pattern memory task indicated that these effects of TMS were restricted to the verbal domain. These data provide convergent evidence for the conclusions of neuropsychological studies that support linguistic accounts of verbal STM

Verbal short-term memory and vocabulary learning

This thesis addressed two key issues. The first was the extent to which verbal short-term memory (STM) for item and order information can be differentiated in terms of their underlying neural mechanisms. The second was to analyze the relative contributions of item and order STM to vocabulary learning in bilingual (BL) and monolingual (ML) children and ML adults. The first issue was addressed with four studies. Three used electroencephalography (EEG) with ML adults, BL adults and ML children. The aim was to determine whether there is any evidence that the two types of verbal STM have different neural signatures. The fourth study used transcranial magnetic stimulation (TMS) in ML adults to test the hypothesis that the right intraparietal sulcus (IPS) is involved in order STM but not item STM. The second issue was addressed by two behavioural studies. The first was a large-scale longitudinal study testing item and order STM in relation to natural vocabulary acquisition in 7 to 10 year old BL and ML children. The children were tested once in the beginning and once in the end of the school year. In addition, ML children learning a second language were examined in the end of the school year. The second behavioural study explored therelationship of item and order STM with new-word-learning in ML adults using artificially-created nonwords. Some evidence was found to support the view that the distinction of item and order STM is a useful one. Results of the EEG data suggested differences in patterns of neuro-electrical activity for ML and BL adults and ML children when they are performing item STM and order STM tasks. The results suggest that order STM is important for new word learning in one´s native language learning, where there has already been some exposure to this language, but not in complete novice language learners

Assessing and supporting working memory in children: the role of attention and the environment

Working memory (WM) – the ability to store information over short periods of time in support of complex cognition – is implicated in a range of cognitive processes and developmental milestones. Given the importance of WM, it is vital that tools exist to rapidly but effectively assess this set of abilities. In Chapter 2 the development of computerised set of measures is described that we designed to facilitate rapid group testing in a school setting. These aims were defined by links with the Born in Bradford longitudinal cohort study. The rest of the thesis investigates how WM might be supported in children, a critical line of research considering the developmental implications of WM difficulties. In Chapter 3 the first investigation of the ability of children to prioritise serial positions within a visual sequence is presented. Children were instructed to try especially hard to remember either the first or third item in three-item sequences of shapes. Adults are consistently able to do this, resulting in superior performance for the prioritised item, at a cost to other items. Unlike adults, children did not show an ability to prioritise a particular position, when instructed to do so. Chapter 3 also includes a novel individual difference analysis that further clarifies the automaticity of recency effects in visual WM. Following the absence of prioritisation effects in Chapter 3, an alternative approach informed by embodied theories of cognition was taken in Chapter 4. Participants were presented with a WM task where the task environment was either structured pseudorandomly or in a task-relevant manner. This task-relevant organisation was consistently beneficial for children with low WM, such that they performed better than when the environment was structured. Children’s metacognitive understanding of the experimental manipulation was also investigated, highlighting the important of metacognitive factors to supporting WM in children

A Behavioural and Electrophysiological exploration of the Working Memory impairment in Developmental Dyslexia

The current thesis provides a behavioural and electrophysiological exploration of Working Memory (WM) processing in developmental dyslexia. This thesis identifies a debate in the literature regarding the extent to which individuals with dyslexia have a specific phonological WM impairment, or a domain general Central Executive (CE) impairment. Predictions from the latter account suggest that dyslexics should show an impairment in visual, and verbal domains of WM. However, findings in the visual domain have been inconsistent, and research has predominantly focused on children. The experimental work in this thesis examines CE processing in dyslexic adults by assessing the behavioural and ERP responses associated with WM, across 8 experiments. Experiments 1-5 present stimuli in the visual domain, while Experiments 6-8 are conducted in the auditory domain. The results indicate that dyslexics are impaired for verbal information specifically, however subtle RT differences emerge during visual-spatial WM, when participants are required to manipulate information. In order to assess why effects are more robust in the phonological domain, Experiment 8 examines the contribution of auditory perceptual problems and phonological WM processing in dyslexia. The Temporal Sampling Theory of Developmental dyslexia (TSTDD; Goswami, 2011) specifies that dyslexics have a difficulty processing tones with long rise-times. In Experiment 8, dyslexic participants show a WM impairment that is specific to tones with long rise-times. The theoretical implications of these findings are discussed, and a new hypothesis regarding the phonological WM impairment in dyslexia is proposed. The original contribution to knowledge of this thesis are threefold. 1) The ERP responses associated with WM processing in developmental dyslexia are examined across modality, using a range of stimuli. 2) A novel task is used to directly investigate CE processing in dyslexia (Experiment 5). 3) The TSTDD is applied in order to investigate phonological WM in dyslexia

The Nature of Working Memory in Aphasia

Thesis (PhD) - Indiana University, Speech and Hearing, 2007It is well known that many adults with aphasia demonstrate concomitant deficits in higher-level cognitive functions, including attention, executive function, and short-term and working memory. This has led to two premises: (a) the domain-specific hypothesis, in which aphasia is associated with additional cognitive deficits only to the extent that these are dependent upon language; and (b) the domain-general hypothesis, in which aphasia is associated with nonlinguistic cognitive impairments as a consequence of either overlapping anatomy or widespread cortical changes post-insult. The purpose of this research was to disentangle these competing hypotheses with regards to working memory (WM) in adults with aphasia. Like other categories of cognitive impairment in this patient group, past research has identified but failed to elucidate WM impairments in aphasic language processing. Toward this end, 15 adults with left-hemisphere damage and aphasia (LHD) and 12 non-brain-damaged controls (NBD) completed a parametric WM task with systematic variation of psycholinguistic complexity (high-frequency, low-frequency, or non-nameable stimuli) and WM load (0-, 1-, and 2-back). Data were analyzed with respect to the differential impact of these variables within and across subjects and groups. Whereas expected effects of word frequency were elicited in stimulus confrontation naming, LHD subjects were affected only minimally by frequency manipulations during the n-back task. Instead, these subjects demonstrated a significant performance decrement relative to controls with increasing WM load. Moreover, aphasia severity was moderately correlated with WM for non-nameable (i.e., more difficult) but not nameable stimuli. At the theoretical level, these results support a resource-based processing model in aphasia; at the neurobiological level, these findings are consistent with the proposition of widespread cortical connectivity changes irrespective of type or location of brain damage. A secondary purpose of this study was to investigate the reliability of LHD performance on the n-back task, given the known performance variability associated with aphasia and the general dearth of reliability data for higher-level tasks. Results demonstrated that the n-back task is a reliable WM indicator over time for this population