Oculomotor capture by search-irrelevant features in visual working memory: on the crucial role of target–distractor similarity

Foerster RM, Schneider WX. Oculomotor capture by search-irrelevant features in visual working memory: on the crucial role of target–distractor similarity. Attention, Perception, & Psychophysics. 2020;82:2379–2392.When searching for varying targets in the environment, a target template has to be maintained in visual working memory (VWM). Recently, we showed that search-irrelevant features of a VWM template bias attention in an object-based manner, so that objects sharing such features with a VWM template capture the eyes involuntarily. Here, we investigated whether target–distractor similarity modulates capture strength. Participants saccaded to a target accompanied by a distractor. A single feature (e.g., shape) defined the target in each trial indicated by a cue, and the cue also varied in one irrelevant feature (e.g., color). The distractor matched the cue’s irrelevant feature in half of the trials. Nine experiments showed that target–distractor similarity consistently influenced the degree of oculomotor capture. High target–distractor dissimilarity in the search-relevant feature reduced capture by the irrelevant feature (Experiments 1, 3, 6, 7). However, capture was reduced by high target–distractor similarity in the search-irrelevant feature (Experiments 1, 4, 5, 8). Strong oculomotor capture was observed if target–distractor similarity was reasonably low in the relevant and high in the irrelevant feature, irrespective of whether color or shape were relevant (Experiments 2 and 5). These findings argue for involuntary and object-based, top-down control by VWM templates, whereas its manifestation in oculomotor capture depends crucially on target–distractor similarity in relevant and irrelevant feature dimensions of the search object

Feature prediction across eye movements is location specific and based on retinotopic coordinates

Herwig A, Weiß K, Schneider WX. Feature prediction across eye movements is location specific and based on retinotopic coordinates. Journal of Vision. 2018;18(13):1-13

OOP: Object-Oriented-Priority for Motion Saliency Maps

Belardinelli A, Schneider WX, Steil JJ. OOP: Object-Oriented-Priority for Motion Saliency Maps. In: Workshop on Brain Inspired Cognitive Systems. 2010: 370-381

Task-irrelevant features in visual working memory influence covert attention: Evidence from a partial report task

Foerster RM, Schneider WX. Task-irrelevant features in visual working memory influence covert attention: Evidence from a partial report task. Vision. 2019;3(3): 42. Selecting a target based on a representation in visual working memory (VWM) affords biasing covert attention towards objects with memory-matching features. Recently, we showed that even task-irrelevant features of a VWM template bias attention. Specifically, when participants had to saccade to a cued shape, distractors sharing the cue’s search-irrelevant color captured the eyes. While a saccade always aims at one target location, multiple locations can be attended covertly. Here, we investigated whether covert attention is captured similarly as the eyes. In our partial report task, each trial started with a shape-defined search cue, followed by a fixation cross. Next, two colored shapes, each including a letter, appeared left and right from fixation, followed by masks. The letter inside that shape matching the preceding cue had to be reported. In Experiment 1, either target, distractor, both, or no object matched the cue’s irrelevant color. Target-letter reports were most frequent in target-match trials and least frequent in distractor-match trials. Irrelevant cue and target color never matched in Experiment 2. Still, participants reported the distractor more often to the target’s disadvantage, when cue and distractor color matched. Thus, irrelevant features of a VWM template can influence covert attention in an involuntarily object-based manner when searching for trial-wise varying targets.</jats:p

Expectation-violations in sensorimotor sequences: shifting from LTM-based attentional selection to visual search

Foerster RM, Schneider WX. Expectation-violations in sensorimotor sequences: shifting from LTM-based attentional selection to visual search. Annals of the New York Academy of Sciences. 2015;1339(1):45-59

Episodic Short-Term Recognition Requires Encoding into Visual Working Memory: Evidence from Probe Recognition after Letter Report

Poth CH, Schneider WX. Episodic Short-Term Recognition Requires Encoding into Visual Working Memory: Evidence from Probe Recognition after Letter Report. Frontiers in Psychology. 2016;7: 1440.Human vision is organized in discrete processing episodes (e.g., eye fixations or task-steps). Object information must be transmitted across episodes to enable episodic short-term recognition: recognizing whether a current object has been seen in a previous episode. We ask whether episodic short-term recognition presupposes that objects have been encoded into capacity-limited visual working memory (VWM), which retains visual information for report. Alternatively, it could rely on the activation of visual features or categories that occurs before encoding into VWM. We assessed the dependence of episodic short-term recognition on VWM by a new paradigm combining letter report and probe recognition. Participants viewed displays of 10 letters and reported as many as possible after a retention interval (whole report). Next, participants viewed a probe letter and indicated whether it had been one of the 10 letters (probe recognition). In Experiment 1, probe recognition was more accurate for letters that had been encoded into VWM (reported letters) compared with non-encoded letters (non-reported letters). Interestingly, those letters that participants reported in their whole report had been near to one another within the letter displays. This suggests that the encoding into VWM proceeded in a spatially clustered manner. In Experiment 2, participants reported only one of 10 letters (partial report) and probes either referred to this letter, to letters that had been near to it, or far from it. Probe recognition was more accurate for near than for far letters, although none of these letters had to be reported. These findings indicate that episodic short-term recognition is constrained to a small number of simultaneously presented objects that have been encoded into VWM

Involuntary top-down control by search-irrelevant features: Visual working memory biases attention in an object-based manner

Foerster RM, Schneider WX. Involuntary top-down control by search-irrelevant features: Visual working memory biases attention in an object-based manner. Cognition. 2018;172:37-45.Many everyday tasks involve successive visual-search episodes with changing targets. Converging evidence suggests that these targets are retained in visual working memory (VWM) and bias attention from there. It is unknown whether all or only search-relevant features of a VWM template bias attention during search. Bias signals might be configured exclusively to task-relevant features so that only search-relevant features bias at- tention. Alternatively, VWM might maintain objects in the form of bound features. Then, all template features will bias attention in an object-based manner, so that biasing effects are ranked by feature relevance. Here, we investigated whether search-irrelevant VWM template features bias attention. Participants had to saccade to a target opposite a distractor. A colored cue depicted the target prior to each search trial. The target was pre- defined only by its identity, while its color was irrelevant. When target and cue matched not only in identity (search-relevant) but also in color (search-irrelevant), saccades went more often and faster directly to the target than without any color match (Experiment 1). When introducing a cue-distractor color match (Experiment 2), direct target saccades were most likely when target and cue matched in the search-irrelevant color and least likely in case of a cue-distractor color match. When cue and target were never colored the same (Experiment 3), cue-colored distractors still captured the eyes more often than different-colored distractors despite color being search-irrelevant. As participants were informed about the misleading color, the result argues against a strate- gical and voluntary usage of color. Instead, search-irrelevant features biased attention obligatorily arguing for involuntary top-down control by object-based VWM templates

Anticipatory eye movements in sensorimotor actions: On the role of guiding fixations during learning

Foerster RM, Schneider WX. Anticipatory eye movements in sensorimotor actions: On the role of guiding fixations during learning. Cognitive Processing. 2015;16(Suppl. 1):227-231.During object-based sensorimotor tasks, humans look at target locations for subsequent hand actions. These anticipatory eye movements or guiding fixations seem to be necessary for a successful perfor- mance. By practicing such a sensorimotor task, humans become faster and perform fewer guiding fixations (Foer- ster and Schneider, In Prep; Foerster et al. in J Vis 11(7):9:1–16, 2011). We aimed at clarifying whether this decrease in guiding fixations is the cause or effect of faster task completion time. Participants may learn to use less visual input (fewer fixations) allowing shorter completion times. Alternatively, participants may speed up their hand movements (e.g., more efficient motor control) leaving less time for visual intake. The latter would imply that the number of fixations is directly connected to task speed. We investigated the relationship between the number of fixa- tions and task speed in a computerized version of the number connection task (Foerster and Schneider in Ann N Y Acad Sci 2015. doi:10.1111/nyas.12729). Eye move- ments were recorded while participants clicked in ascend- ing order on nine numbered circles. In 90 learning trials, they clicked the sequence with a constant spatial configu- ration as fast as possible. In the subsequent experimental phase, they should perform 30 trials again under high- speed instruction and 30 trials under slow-speed instruc- tion. During slow-speed instruction, fixation rates were & Rebecca M. Foerster [email protected] 1 Department of Psychology, Bielefeld University, Bielefeld, Germany 2 Cognitive Interaction Technology - Center of Excellence (CITEC), Bielefeld University, P. O. Box 100131, 33501 Bielefeld, Germany lower with longer fixation durations and more fixations were performed than during high-speed instruction. The results suggest that the number of fixations depends on both the need for visual intake and task completion time. It seems that the decrease in anticipatory eye movements through sensorimotor learning is at the same time a result and a cause of faster task performance

Breaking object correspondence across saccadic eye movements deteriorates object recognition

Poth CH, Herwig A, Schneider WX. Breaking object correspondence across saccadic eye movements deteriorates object recognition. Frontiers in Systems Neuroscience. 2015;9: 176.Visual perception is based on information processing during periods of eye fixations that are interrupted by fast saccadic eye movements. The ability to sample and relate information on task-relevant objects across fixations implies that correspondence between presaccadic and postsaccadic objects is established. Postsaccadic object information usually updates and overwrites information on the corresponding presaccadic object. The presaccadic object representation is then lost. In contrast, the presaccadic object is conserved when object correspondence is broken. This helps transsaccadic memory but it may impose attentional costs on object recognition. Therefore, we investigated how breaking object correspondence across the saccade affects postsaccadic object recognition. In Experiment 1, object correspondence was broken by a brief postsaccadic blank screen. Observers made a saccade to a peripheral object which was displaced during the saccade. This object reappeared either immediately after the saccade or after the blank screen. Within the postsaccadic object, a letter was briefly presented (terminated by a mask). Observers reported displacement direction and letter identity in different blocks. Breaking object correspondence by blanking improved displacement identification but deteriorated postsaccadic letter recognition. In Experiment 2, object correspondence was broken by changing the object’s contrast-polarity. There were no object displacements and observers only reported letter identity. Again, breaking object correspondence deteriorated postsaccadic letter recognition. These findings identify transsaccadic object correspondence as a key determinant of object recognition across the saccade. This is in line with the recent hypothesis that breaking object correspondence results in separate representations of presaccadic and postsaccadic objects which then compete for limited attentional processing resources (Schneider, 2013). Postsaccadic object recognition is then deteriorated because less resources are available for processing postsaccadic objects

Effects of monitoring for visual events on distinct components of attention

Poth CH, Petersen A, Bundesen C, Schneider WX. Effects of monitoring for visual events on distinct components of attention. Frontiers in Psychology. 2014;5:930.Monitoring the environment for visual events while performing a concurrent task requires adjustment of visual processing priorities. By use of Bundesen’s (1990) Theory of Visual Attention, we investigated how monitoring for an object-based brief event affected distinct components of visual attention in a concurrent task. The perceptual salience of the event was varied. Monitoring reduced the processing speed in the concurrent task, and the reduction was stronger when the event was less salient. The monitoring task neither affected the temporal threshold of conscious perception nor the storage capacity of visual short-term memory nor the efficiency of top-down controlled attentional selection