Neural Dynamics of Saccadic and Smooth Pursuit Eye Movement Coordination during Visual Tracking of Unpredictably Moving Targets

How does the brain use eye movements to track objects that move in unpredictable directions and speeds? Saccadic eye movements rapidly foveate peripheral visual or auditory targets and smooth pursuit eye movements keep the fovea pointed toward an attended moving target. Analyses of tracking data in monkeys and humans reveal systematic deviations from predictions of the simplest model of saccade-pursuit interactions, which would use no interactions other than common target selection and recruitment of shared motoneurons. Instead, saccadic and smooth pursuit movements cooperate to cancel errors of gaze position and velocity, and thus to maximize target visibility through time. How are these two systems coordinated to promote visual localization and identification of moving targets? How are saccades calibrated to correctly foveate a target despite its continued motion during the saccade? A neural model proposes answers to such questions. The modeled interactions encompass motion processing areas MT, MST, FPA, DLPN and NRTP; saccade planning and execution areas FEF and SC; the saccadic generator in the brain stem; and the cerebellum. Simulations illustrate the model’s ability to functionally explain and quantitatively simulate anatomical, neurophysiological and behavioral data about SAC-SPEM tracking.National Science Foundation (SBE-0354378); Office of Naval Research (N00014-01-1-0624

Neurophysiological models of gaze control in Humanoid Robotics

This work present a robotic implementation of a neurophysiological model of rapid orienting gaze shifts in humans, with the final goal of model parameters validation and tuning. The quantitative assessment of robot performance confirmed a good ability to foveate the target with low residual errors around the desired target position. Furthermore, the ability to maintain the desired position was good and the gaze fixation after the saccadic movement was executed with only few oscillations of the head and eye. This is because the model required a very high dynamic. 9.1. Robotic point of view The head and eye residual oscillations increase linearly with increasing amplitude. In Fig. 16 is evident that the residual gaze oscillation is less than head. This is explained with the compensation introduced by the eye oscillations which compensate the gaze which becomes more stable. We explain these findings by observing that the accelerations required to execute (or stopand-invert) the movement are very high especially for the eye movement. Even if the robotic head was designed to match the human performances (in terms of angle and velocities) in its present configuration it is still not capable produce such accelerations. This is particularly evident for the movement of the eye because the motor has to invert its rotation when the fixation point is first achieved. With respect to the timing of the movement it has been found that the results of the experiments are in close accordance to the data available on humans (Goossens and Van Opstal, 1997). The same conclusion may be drawn for the shapes of the coordinated movement that can be directly compared to the typical examples reported in Fig. 14. Figure 16, 17 show that the model is capable of providing inadequate control of the redundant platform. The system response is very fast, due to the robotic head platform design. TGst time take into account the problem of eye-head coordination and the very high acceleration. The head is voluntarily delayed less than 30 millisecond after eye movement, according to human physiology, by means of Ph block (Goossens and Van Opstal ,1997). 9.2. Neurophysiological point of view A typical robotic eye-head movement is shows in Fig. 14

Neural Dynamics of Saccadic and Smooth Pursuit Eye Movement Coordination during Visual Tracking of Unpredictably Moving Targets

How does the brain use eye movements to track objects that move in unpredictable directions and speeds? Saccadic eye movements rapidly foveate peripheral visual or auditory targets and smooth pursuit eye movements keep the fovea pointed toward an attended moving target. Analyses of tracking data in monkeys and humans reveal systematic deviations from predictions of the simplest model of saccade-pursuit interactions, which would use no interactions other than common target selection and recruitment of shared motoneurons. Instead, saccadic and smooth pursuit movements cooperate to cancel errors of gaze position and velocity, and thus to maximize target visibility through time. How are these two systems coordinated to promote visual localization and identification of moving targets? How are saccades calibrated to correctly foveate a target despite its continued motion during the saccade? A neural model proposes answers to such questions. The modeled interactions encompass motion processing areas MT, MST, FPA, DLPN and NRTP; saccade planning and execution areas FEF and SC; the saccadic generator in the brain stem; and the cerebellum. Simulations illustrate the model’s ability to functionally explain and quantitatively simulate anatomical, neurophysiological and behavioral data about SAC-SPEM tracking.National Science Foundation (SBE-0354378); Office of Naval Research (N00014-01-1-0624

How Listing's Law May Emerge from Neural Control of Reactive Saccades

We hypothesize that Listing's Law emerges as a result of two key properties of the saccadic sensory-motor system: 1) The visual sensory apparatus has a 2-D topology and 2) motor synergists are synchronized. The theory is tested by showing that eye attitudes that obey Listing's Law are achieved in a 3-D saccadic control system that translates visual eccentricity into synchronized motor commands via a 2-D spatial gradient. Simulations of this system demonstrate that attitudes assumed by the eye upon accurate foveation tend to obey Listing's Law.Office of Naval Research (N00014-92-J-1309, N00014-95-1-1409); Air Force Office of Scientific Research (90-0083

Optimal Control of Saccades by Spatial-Temporal Activity Patterns in the Monkey Superior Colliculus

A major challenge in computational neurobiology is to understand how populations of noisy, broadly-tuned neurons produce accurate goal-directed actions such as saccades. Saccades are high-velocity eye movements that have stereotyped, nonlinear kinematics; their duration increases with amplitude, while peak eye-velocity saturates for large saccades. Recent theories suggest that these characteristics reflect a deliberate strategy that optimizes a speed-accuracy tradeoff in the presence of signal-dependent noise in the neural control signals. Here we argue that the midbrain superior colliculus (SC), a key sensorimotor interface that contains a topographically-organized map of saccade vectors, is in an ideal position to implement such an optimization principle. Most models attribute the nonlinear saccade kinematics to saturation in the brainstem pulse generator downstream from the SC. However, there is little data to support this assumption. We now present new neurophysiological evidence for an alternative scheme, which proposes that these properties reside in the spatial-temporal dynamics of SC activity. As predicted by this scheme, we found a remarkably systematic organization in the burst properties of saccade-related neurons along the rostral-to-caudal (i.e., amplitude-coding) dimension of the SC motor map: peak firing-rates systematically decrease for cells encoding larger saccades, while burst durations and skewness increase, suggesting that this spatial gradient underlies the increase in duration and skewness of the eye velocity profiles with amplitude. We also show that all neurons in the recruited population synchronize their burst profiles, indicating that the burst-timing of each cell is determined by the planned saccade vector in which it participates, rather than by its anatomical location. Together with the observation that saccade-related SC cells indeed show signal-dependent noise, this precisely tuned organization of SC burst activity strongly supports the notion of an optimal motor-control principle embedded in the SC motor map as it fully accounts for the straight trajectories and kinematic nonlinearity of saccades

The interaction between human vision and eye movements in health and disease

Human motor behaviour depends on the successful integration of vision and eye movements. Many studies have investigated neural correlates of visual processing in humans, but typically with the eyes stationary and fixated centrally. Similarly, many studies have sought to characterise which brain areas are responsible for oculomotor control, but generally in the absence of visual stimulation. The few studies to explicitly study the interaction between visual perception and eye movements suggest strong influences of both static and dynamic eye position on visual processing and modulation of oculomotor structures by properties of visual stimuli. However, the neural mechanisms underlying these interactions are poorly understood. This thesis uses a range of fMRI methodologies such as retinotopic mapping, multivariate analsyis techniques, dynamic causal modelling and ultra high resolution imaging to examine the interactions between the oculomotor and visual systems in the normal human brain. The results of the experiments presented in this thesis demonstrate that oculomotor behaviour has complex effects on activity in visual areas, while spatial properites of visual stimuli modify activity in oculomotor areas. Specifically, responses in the lateral geniculate nucleus and early cortical visual areas are modulated by saccadic eye movements (a process potentially mediated by the frontal eye fields) and by changes in static eye position. Additionally, responses in oculomotor structures such as the superior colliculus are biased for visual stimuli presented in the temporal rather than nasal hemifield. These findings reveal that although the visual and oculomotor systems are spatially segregated in the brain, they show a high degree of integration at the neural level. This is consistent with our everyday experience of the visual world where frequent eye movements do not lead to disruption of visual continuity and visual information is seamlessly transformed into motor behaviour

Interior maps in posterior pareital cortex

The posterior parietal cortex (PPC), historically believed to be a sensory structure, is now viewed as an area important for sensory-motor integration. Among its functions is the forming of intentions, that is, high-level cognitive plans for movement. There is a map of intentions within the PPC, with different subregions dedicated to the planning of eye movements, reaching movements, and grasping movements. These areas appear to be specialized for the multisensory integration and coordinate transformations required to convert sensory input to motor output. In several subregions of the PPC, these operations are facilitated by the use of a common distributed space representation that is independent of both sensory input and motor output. Attention and learning effects are also evident in the PPC. However, these effects may be general to cortex and operate in the PPC in the context of sensory-motor transformations

Aftereffects of Saccades Explored in a Dynamic Neural Field Model of the Superior Colliculus

When viewing a scene or searching for a target, an observer usually makes a series of saccades that quickly shift the orientation of the eyes. The present study explored how one saccade affects subsequent saccades within a dynamic neural field model of the superior colliculus (SC). The SC contains an oculocentric motor map that encodes the vector of saccades and remaps to the new fixation location after each saccade. Our simulations demonstrated that the observation that saccades which reverse their vectors are slower to initiate than those which repeat vectors can be explained by the afore-mentioned remapping process and the internal dynamics of the SC. How this finding connects to the study of inhibition of return is discussed and suggestions for future studies are presented