Topographic organization of eye-position dependent gain fields in human visual cortex

The ability to move has introduced animals with the problem of sensory ambiguity: the position of an external stimulus could change over time because the stimulus moved, or because the animal moved its receptors. This ambiguity can be resolved with a change in neural response gain as a function of receptor orientation. Here, we developed an encoding model to capture gain modulation of visual responses in high field (7 T) fMRI data. We characterized population eye-position dependent gain fields (pEGF). The information contained in the pEGFs allowed us to reconstruct eye positions over time across the visual hierarchy. We discovered a systematic distribution of pEGF centers: pEGF centers shift from contra- to ipsilateral following pRF eccentricity. Such a topographical organization suggests that signals beyond pure retinotopy are accessible early in the visual hierarchy, providing the potential to solve sensory ambiguity and optimize sensory processing information for functionally relevant behavior

Intra-saccadic displacement sensitivity after a lesion to the posterior parietal cortex

Visual perception is introspectively stable and continuous across eye movements. It has been hypothesized that displacements in retinal input caused by eye movements can be dissociated from displacements in the external world using extra-retinal information, such as a corollary discharge from the oculomotor system. The extra-retinal information can inform the visual system about an upcoming eye movement and accompanying displacements in retinal input. The parietal cortex has been hypothesized to be critically involved in integrating retinal and extra-retinal information. Two tasks have been widely used to assess the quality of this integration: double-step saccades and intra-saccadic displacements. Double-step saccades performed by patients with parietal cortex lesions seemed to show hypometric second saccades. However, recently idea has been refuted by demonstrating that patients with very similar lesions were able to perform the double step saccades, albeit taking multiple saccades to reach the saccade target. So, it seems that extra-retinal information is still available for saccade execution after a lesion to the parietal lobe. Here, we investigated whether extra-retinal signals are also available for perceptual judgements in nine patients with strokes affecting the posterior parietal cortex. We assessed perceptual continuity with the intra-saccadic displacement task. We exploited the increased sensitivity when a small temporal blank is introduced after saccade offset (blank effect). The blank effect is thought to reflect the availability of extra-retinal signals for perceptual judgements. Although patients exhibited a relative difference to control subjects, they still demonstrated the blank effect. The data suggest that a lesion to the posterior parietal cortex (PPC) alters the processing of extra-retinal signals but does not abolish their influence altogether

Time course of spatiotopic updating across saccades

Humans move their eyes several times per second, yet we perceive the outside world as continuous despite the sudden disruptions created by each eye movement. To date, the mechanism that the brain employs to achieve visual continuity across eye movements remains unclear. While it has been proposed that the oculomotor system quickly updates and informs the visual system about the upcoming eye movement, behavioral studies investigating the time course of this updating suggest the involvement of a slow mechanism, estimated to take more than 500 ms to operate effectively. This is a surprisingly slow estimate, because both the visual system and the oculomotor system process information faster. If spatiotopic updating is indeed this slow, it cannot contribute to perceptual continuity, because it is outside the temporal regime of typical oculomotor behavior. Here, we argue that the behavioral paradigms that have been used previously are suboptimal to measure the speed of spatiotopic updating. In this study, we used a fast gaze-contingent paradigm, using high phi as a continuous stimulus across eye movements. We observed fast spatiotopic updating within 150 ms after stimulus onset. The results suggest the involvement of a fast updating mechanism that predictively influences visual perception after an eye movement. The temporal characteristics of this mechanism are compatible with the rate at which saccadic eye movements are typically observed in natural viewing

Bilateral increase in MEG planar gradients prior to saccade onset

Every time we move our eyes, the retinal locations of objects change. To distinguish the changes caused by eye movements from actual external motion of the objects, the visual system is thought to anticipate the consequences of eye movements (saccades). Single neuron recordings have indeed demonstrated changes in receptive fields before saccade onset. Although some EEG studies with human participants have also demonstrated a pre-saccadic increased potential over the hemisphere that will process a stimulus after a saccade, results have been mixed. Here, we used magnetoencephalography to investigate the timing and lateralization of visually evoked planar gradients before saccade onset. We modelled the gradients from trials with both a saccade and a stimulus as the linear combination of the gradients from two conditions with either only a saccade or only a stimulus. We reasoned that any residual gradients in the condition with both a saccade and a stimulus must be uniquely linked to visually-evoked neural activity before a saccade. We observed a widespread increase in residual planar gradients. Interestingly, this increase was bilateral, showing activity both contralateral and ipsilateral to the stimulus, i.e. over the hemisphere that would process the stimulus after saccade offset. This pattern of results is consistent with predictive pre-saccadic changes involving both the current and the future receptive fields involved in processing an attended object, well before the start of the eye movement. The active, sensorimotor coupling of vision and the oculomotor system may underlie the seamless subjective experience of stable and continuous perception

Bilateral increase in MEG planar gradients prior to saccade onset

Every time we move our eyes, the retinal locations of objects change. To distinguish the changes caused by eye movements from actual external motion of the objects, the visual system is thought to anticipate the consequences of eye movements (saccades). Single neuron recordings have indeed demonstrated changes in receptive fields before saccade onset. Although some EEG studies with human participants have also demonstrated a pre-saccadic increased potential over the hemisphere that will process a stimulus after a saccade, results have been mixed. Here, we used magnetoencephalography to investigate the timing and lateralization of visually evoked planar gradients before saccade onset. We modelled the gradients from trials with both a saccade and a stimulus as the linear combination of the gradients from two conditions with either only a saccade or only a stimulus. We reasoned that any residual gradients in the condition with both a saccade and a stimulus must be uniquely linked to visually-evoked neural activity before a saccade. We observed a widespread increase in residual planar gradients. Interestingly, this increase was bilateral, showing activity both contralateral and ipsilateral to the stimulus, i.e. over the hemisphere that would process the stimulus after saccade offset. This pattern of results is consistent with predictive pre-saccadic changes involving both the current and the future receptive fields involved in processing an attended object, well before the start of the eye movement. The active, sensorimotor coupling of vision and the oculomotor system may underlie the seamless subjective experience of stable and continuous perception

Low-level visual information is maintained across saccades, allowing for a postsaccadic hand-off between visual areas

Experience seems continuous and detailed despite saccadic eye movements changing retinal input several times per second. There is debate whether neural signals related to updating across saccades contain information about stimulus features, or only location pointers without visual details. We investigated the time course of low-level visual information processing across saccades by decoding spatial frequency of a stationary stimulus that changed from one visual hemifield to the other due to a horizontal saccadic eye movement. We recorded magnetoencephalography while human subjects (both sexes) monitored the orientation of a grating stimulus, making spatial frequency task-irrelevant. Separate trials, in which subjects maintained fixation, were used to train a classifier, whose performance was then tested on saccade trials. Decoding performance showed that spatial frequency information of the presaccadic stimulus remained present for ∼200 ms after the saccade, transcending retinotopic specificity. Postsaccadic information ramped up rapidly after saccade offset. There was an overlap of over 100 ms during which decoding was significant from both pre- and postsaccadic processing areas. This suggest that the apparent richness of perception across saccades may be supported by the continuous availability of low-level information with a "soft hand-off" of information during the initial processing sweep of the new fixation. Saccades create frequent discontinuities in visual input, yet perception appears stable and continuous. How is this discontinuous input processed resulting in visual stability? Previous studies have focused on presaccadic remapping. Here we examined the time course of processing of low-level visual information (spatial frequency) across saccades with magnetoencephalography. The results suggest that spatial frequency information is not predictively remapped but also not discarded. Instead, they suggest a soft hand-off over time between different visual areas, making this information continuously available across the saccade. Information about the presaccadic stimulus remains available, while the information about the postsaccadic stimulus has also become available. The simultaneous availability of both the pre and postsaccadic information could enable rich and continuous perception across saccades

More (corrective) consecutive saccades after a lesion to the posterior parietal cortex

To reach a target, primary saccades (S1s) are often followed by (corrective) consecutive saccades (S2, and potentially S3, S4, S5), which are based on retinal and extraretinal feedback. Processing these extraretinal signals was found to be significantly impaired by lesions to the posterior parietal cortex (PPC). Recent studies, however, added a more nuanced view to the role of the PPC, where patients with PPC lesions still used extraretinal signals for S2s and perceptual judgements (Fabius et al., 2020; Rath-Wilson & Guitton, 2015). Hence, it seems that a PPC lesion is not disrupting extraretinal processing per se. Yet, a lesion might still result in less reliable processing of extraretinal signals. Here, we investigated whether this lower reliability manifests as decreased or delayed S2 initiation. Patients with PPC lesions (n = 7) and controls (n = 26) performed a prosaccade task where the target either remained visible or was removed after S1 onset. When S1 is removed, accurate S2s (corrections of S1 error) rely solely on extraretinal signals. We analysed S2 quantity and timing using linear mixed-effects modelling and additive hazards analyses. Patients demonstrated slower S1 execution and lower S1 amplitudes than controls, but their S2s still compensated the S1 undershoot, also when they only relied on extraretinal information. Surprisingly, patients showed an increased amount of S2s. This deviation from control behaviour can be seen as suboptimal, but given the decreased accuracy of the primary saccade, it could be optimal for patients to employ more (corrective) consecutive saccades to overcome this inaccuracy

Vision while the eyes move: Getting the full picture

Visual information is continuously sampled from our environment, even as the eyes move, which helps the visual system create a stable view of the world

Vision while the eyes move: Getting the full picture

Visual information is continuously sampled from our environment, even as the eyes move, which helps the visual system create a stable view of the world