Modeling the Temporal Dynamics of Visual Working Memory

Abstract Visual working memory (VWM) is one of the most crucial parts of the human cognitive system. Research focuses on the apparent limits in the capacity of this system and the reasons for them. So far only a few formal models exist that can account for the temporal dynamics of the amount of information stored in VWM. We propose a combination of the well established theory of visual attention (TVA) with a dynamic memory model, resulting in an iterative, probabilistic framework for VWM. The model includes a consolidation as well as a decay mechanism and employs the strength concept to quantify the availability of a certain memory trace. We evaluate the model on available change detection data

The temporal dynamics of visual working memory guidance of selective attention

The biased competition model proposes that there is top-down directing of attention to a stimulus matching the contents of working memory (WM), even when the maintenance of a WM representation is detrimental to target relevant performance. Despite many studies elucidating that spatial WM guidance can be present early in the visual processing system, whether visual WM guidance also influences perceptual selection remains poorly understood. Here, we investigated the electrophysiological correlates of early guidance of attention by WM in humans. Participants were required to perform a visual search task while concurrently maintaining object representations in their visual working memory. Behavioral results showed that response times (RTs) were longer when the distractor in the visual search task was held in WM. The earliest WM guidance effect was observed in the P1 component (90-130 ms), with match trials eliciting larger P1 amplitude than mismatch trials. A similar result was also found in the N1 component (160-200 ms). These P1 and N1 effects could not be attributed to bottom-up perceptual priming from the presentation of a memory cue, because there was no significant difference in early ERP component when the cue was merely perceptually identified but not actively held in working memory. Standardized Low Resolution Electrical Tomography Analysis (sLORETA) showed that the early WM guidance occurred in the occipital lobe and the N1-related activation occurred in the parietal gyrus. Time-frequency data suggested that alpha-band event-related spectral perturbation (ERSP) magnitudes increased under the match condition compared with the mismatch condition. In conclusion, the present study suggests that the reappearance of a stimulus held in WM enhanced activity in the occipital area. Subsequently, this initial capture of attention by WM could be inhibited by competing visual inputs through attention re-orientation, reflecting by the alpha-band rhythm

Working memory replay prioritizes weakly attended events

One view of working memory posits that maintaining a series of events requires their sequential and equal mnemonic replay. Another view is that the content of working memory maintenance is prioritized by attention. We decoded the dynamics for retaining a sequence of items using magnetoencephalography, wherein participants encoded sequences of three stimuli depicting a face, a manufactured object, or a natural item and maintained them in working memory for 5000 ms. Memory for sequence position and stimulus details were probed at the end of the maintenance period. Decoding of brain activity revealed that one of the three stimuli dominated maintenance independent of its sequence position or category; and memory was enhanced for the selectively replayed stimulus. Analysis of event-related responses during the encoding of the sequence showed that the selectively replayed stimuli were determined by the degree of attention at encoding. The selectively replayed stimuli had the weakest initial encoding indexed by weaker visual attention signals at encoding. These findings do not rule out sequential mnemonic replay but reveal that attention influences the content of working memory maintenance by prioritizing replay of weakly encoded events. We propose that the prioritization of weakly encoded stimuli protects them from interference during the maintenance period, whereas the more strongly encoded stimuli can be retrieved from long-term memory at the end of the delay period

Videopanorama Frame Rate Requirements Derived from Visual Discrimination of Deceleration During Simulated Aircraft Landing

In order to determine the required visual frame rate (FR) for minimizing prediction errors with out-the-window video displays at remote/virtual airport towers, thirteen active air traffic controllers viewed high dynamic fidelity simulations of landing aircraft and decided whether aircraft would stop as if to be able to make a turnoff or whether a runway excursion would be expected. The viewing conditions and simulation dynamics replicated visual rates and environments of transport aircraft landing at small commercial airports. The required frame rate was estimated using Bayes inference on prediction errors by linear FRextrapolation of event probabilities conditional on predictions (stop, no-stop). Furthermore estimates were obtained from exponential model fits to the parametric and non-parametric perceptual discriminabilities d' and A (average area under ROC-curves) as dependent on FR. Decision errors are biased towards preference of overshoot and appear due to illusionary increase in speed at low frames rates. Both Bayes and A - extrapolations yield a framerate requirement of 35 40 Hz for minimizing decision errors. Definitive recommendations require further experiments with FR > 30 Hz

Are all behavioral reward benefits created equally? An EEG-fMRI study

Reward consistently boosts performance in cognitive tasks. Although many different reward manipulations exist, systematic comparisons are lacking. Reward effects on cognitive control are usually studied using monetary incentive delay (MID; cue-related reward information) or stimulus-reward association (SRA; target-related reward information) tasks. While for MID tasks, evidence clearly implicates reward-triggered global increases in proactive control, it is unclear how reward effects arise in SRA tasks, and in how far such mechanisms overlap during task preparation and target processing. Here, we address these questions with simultaneous EEG-fMRI using a Stroop task with four different block types. In addition to MID and SRA blocks, we used an SRA-task modification with reward-irrelevant cues (C-SRA) and regular reward-neutral Stroop-task blocks. Behaviorally, we observed superior performance for all reward conditions compared to Neutral, and more pronounced reward effects in the SRA and C-SRA blocks, compared to MID blocks. The fMRI data showed similar reward effects in value-related areas for events that signaled reward availability (MID cues and (C-)SRA targets), and comparable reward modulations in cognitive-control regions for all targets regardless of block type. This result pattern was echoed by the EEG data, showing clear markers of valuation and cognitive control, which only differed during task preparation, whereas reward-related modulations during target processing were again comparable across block types. Yet, considering only cue-related fMRI data, C-SRA cues triggered preparatory control processes beyond reward-unrelated MID cues, without simultaneous modulations in typical reward areas, implicating enhanced task preparation that is not directly driven by a concurrent neural reward-anticipation response

Differential working memory function between phonological and visuospatial strategies: a magnetoencephalography study using a same visual task

Previous studies have reported that, in working memory, the processing of visuospatial information and phonological information have different neural bases. However, in these studies, memory items were presented via different modalities. Therefore, the modality in which the memory items were presented and the strategy for memorizing them were not rigorously distinguished. In the present study, we explored the neural basis of two working memory strategies. Nineteen right-handed young adults memorized seven sequential directions presented visually in a task in which the memory strategy was either visuospatial or phonological (visuospatial/phonological condition). Source amplitudes of theta-band (5–7 Hz) rhythm were estimated from magnetoencephalography during the maintenance period and further analyzed using cluster-based permutation tests. Behavioral results revealed that the accuracy rates showed no significant differences between conditions, while the reaction time in the phonological condition was significantly longer than that in the visuospatial condition. Theta activity in the phonological condition was significantly greater than that in the visuospatial condition, and the cluster in spatio-temporal matrix with p < 5% difference extended to right prefrontal regions in the early maintenance period and right occipito-parietal regions in the late maintenance period. The theta activity results did not indicate strategy-specific neural bases but did reveal the dynamics of executive function required for phonological processing. The functions seemed to move from attention control and inhibition control in the prefrontal region to inhibition of irrelevant information in the occipito-parietal region

Cerebro-Cerebellar Pathways for Verbal Working Memory

open access articleThe current study examined the structural and functional connectivity of the cerebrocerebellar network of verbal working memory as proposed by Chen and Desmond (2005a). Diffusion spectrum imaging was employed to establish structural connectivity between cerebro-cerebellar regions co-activated during a verbal working memory task. The inferior frontal gyrus, inferior parietal lobule, pons, thalamus, superior cerebellum and inferior cerebellum were used as regions of interest to reconstruct and segment the contralateral white matter cerebro-cerebellar circuitry. The segmented pathways were examined further to establish the relationship between structural and effective connectivity as well as the relationship between structural connectivity and verbal working memory performance. No direct relationship between structural and effective connectivity was found but the results demonstrated that structural connectivity is indirectly related to effective connectivity as DCM models that resembled more closely with underlying white matter pathways had a higher degree of model inference confidence. Additionally, it was demonstrated that the structural connectivity of the ponto-cerebellar tract was associated with individual differences in response time for verbal working memory. The findings of the study contribute to further our understanding of the relationship between structural and functional connectivity and the impact of variability in verbal working memory performance

Cerebro-Cerebellar Pathways for Verbal Working Memory

The current study examined the structural and functional connectivity of the cerebro-cerebellar network of verbal working memory as proposed by Chen and Desmond (2005a). Diffusion spectrum imaging was employed to establish structural connectivity between cerebro-cerebellar regions co-activated during a verbal working memory task. The inferior frontal gyrus, inferior parietal lobule, pons, thalamus, superior cerebellum and inferior cerebellum were used as regions of interest to reconstruct and segment the contralateral white matter cerebro-cerebellar circuitry. The segmented pathways were examined further to establish the relationship between structural and effective connectivity as well as the relationship between structural connectivity and verbal working memory performance. No direct relationship between structural and effective connectivity was found but the results demonstrated that structural connectivity is indirectly related to effective connectivity as DCM models that resembled more closely with underlying white matter pathways had a higher degree of model inference confidence. Additionally, it was demonstrated that the structural connectivity of the ponto-cerebellar tract was associated with individual differences in response time for verbal working memory. The findings of the study contribute to further our understanding of the relationship between structural and functional connectivity and the impact of variability in verbal working memory performance

Brain wakefullness detection using frequency and time-frequency EEG signal analysis

Práce je zaměřena na základy elektroencefalografie, způsob měření elektroencefalogra- fických signálů, jejich zpracování a především interpretací signálu ve frekvenční a časově- frekvenční oblasti za účelem detekce mentální únavy jedince. Je diskutována mentální únava a její příčiny, důsledky a souvislost se senzoricko-kognitivním systémem a prováza- nosti s pamětí. Jsou popsány základní mezinárodní zapojení pro standardizované měření EEG signálů ze skalpu hlavy a experimenty, které vedou k navození mentální únavy. Na základě těchto vědomostí byl realizován vhodný experiment pro navození takovéhoto stavu. Celkem ho podstoupilo deset subjektů na měřícím zařízení GES 410MR od firmy EGI v laboratorních podmínkách. Data se analyzovala hlavně pomocí S-transformace a Hilbert-Huangovy transformace představující dva nejmodernější odlišné přístupy k časově-frekvenční analýze. Výsledkem práce je zhodnocení stavu mentální únavy v zá- vislosti na chybovosti v úkolu a čase.This work describes basics of electroencephalography, measuring methods of electroen- cephalographic signals, their processing and especially the interpretation of EEG signal in frequency and time-frequency domains for mental fatigue detection purposes. Mental fatigue, its sources, consequences and connection with sensory-cognitive system and link to memory is discussed. The most basic normalized international system for measuring EEG from the scalp as well as some of the experiments that ultimately lead to mental fatigue are described. With this knowledge in mind, an experiment was prepared for inducing such a state. Ten subjects participated in the test which was conducted in la- boratory with EEG machine GES 410MR by EGI. The data were analyzed mainly with S-transform and Hilbert-Huang transform. These two transforms represent two distinct state of the art time-frequency methods of spectral analysis. The result of this work lies in evaluating the relationship between mental fatigue, errors accumulated during the task and with time.