Prospection of potential actions during visual working memory starts early, is flexible, and predicts behavior

For visual working memory to serve upcoming behavior, it is crucial that we prepare for the potential use of working-memory contents ahead of time. Recent studies have demonstrated how the prospection and planning for an upcoming manual action starts early after visual encoding, and occurs alongside visual retention. Here, we address whether such ‘output planning’ in visual working memory flexibly adapts to different visual-motor mappings, and occurs even when an upcoming action will only potentially become relevant for behavior. Human participants (female and male) performed a visual-motor working memory task in which they remembered one or two colored oriented bars for later (potential) use. We linked, and counterbalanced, the tilt of the visual items to specific manual responses. This allowed us to track planning of upcoming behavior through contralateral attenuation of beta-band activity – a canonical motor-cortical EEG signature of manual-action planning. The results revealed how action encoding and subsequent planning alongside visual working memory (1) reflect anticipated task demands rather than specific visual-motor mappings, (2) occur even for actions that will only potentially become relevant for behavior, and (3) are associated with faster performance for the encoded item, at the expense of performance to other working-memory content. This reveals how the potential prospective use of visual working memory content is flexibly planned early on, with consequences for the speed of memory-guided behavior

Output planning at the input stage in visual working memory

Working memory serves as the buffer between past sensations and future behavior, making it vital to understand not only how we encode and retain sensory information in memory but also how we plan for its upcoming use. We ask when prospective action goals emerge alongside the encoding and retention of visual information in working memory. We show that prospective action plans do not emerge gradually during memory delays but are brought into memory early, in tandem with sensory encoding. This action encoding (i) precedes a second stage of action preparation that adapts to the time of expected memory utilization, (ii) occurs even ahead of an intervening motor task, and (iii) predicts visual memory–guided behavior several seconds later. By bringing prospective action plans into working memory at an early stage, the brain creates a dual (visual-motor) memory code that can make memories more effective and robust for serving ensuing behavior

Shielding working-memory representations from temporally predictable external interference

Protecting working-memory content from distracting external sensory inputs and intervening tasks is an ubiquitous demand in daily life. Here, we ask whether and how temporal expectations about external events can help mitigate effects of such interference during working-memory retention. We manipulated the temporal predictability of interfering items that occurred during the retention period of a visual working-memory task and report that temporal expectations reduce the detrimental influence of external interference on subsequent memory performance. Moreover, to determine if the protective effects of temporal expectations rely on distractor suppression or involve shielding of internal representations, we compared effects after irrelevant distractors that could be ignored vs. interrupters that required a response. Whereas distractor suppression may be sufficient to confer protection from predictable distractors, any benefits after interruption are likely to involve memory shielding. We found similar benefits of temporal expectations after both types of interference. We conclude that temporal expectations may play an important role in safeguarding behaviour based on working memory – acting through mechanisms that include the shielding of internal content from external interference

Consequences of predictable temporal structure in multi-task situations

In everyday life, we often anticipate the timing of an upcoming task or event while actively engaging in another. Here, we investigated the effects of predictable temporal structure within such a multi-task scenario. In a visual working-memory task, we manipulated whether the onset of a working-memory probe could be predicted in time, while also embedding a simple intervening task within the delay period. We first show that working-memory performance benefitted from temporal expectations, even though an intervening task had to be completed in the interim. Moreover, temporal predictions regarding the upcoming working-memory probe additionally affected performance on the intervening task, resulting in faster responses when the memory probe was expected early, and slower responses when the memory probe was expected late, as compared to when it was temporally unpredictable. Because the intervening task always occurred at the same time during the memory delay, differences in performance on this intervening task result from a between-task consequence of temporal expectation. Thus, we show that within multi-task settings, knowing when working-memory contents will be required for an upcoming task not only facilitates performance of the associated working-memory task, but can also influence the performance of other, intervening tasks