Functional correlates of optic flow motion processing in Parkinson’s disease

The visual input created by the relative motion between an individual and the environment, also called optic flow, influences the sense of self-motion, postural orientation, veering of gait, and visuospatial cognition. An optic flow network comprising visual motion areas V6, V3A, and MT+, as well as visuo-vestibular areas including posterior insula vestibular cortex (PIVC) and cingulate sulcus visual area (CSv), has been described as uniquely selective for parsing egomotion depth cues in humans. Individuals with Parkinson’s disease (PD) have known behavioral deficits in optic flow perception and visuospatial cognition compared to age- and education-matched control adults (MC). The present study used functional magnetic resonance imaging (fMRI) to investigate neural correlates related to impaired optic flow perception in PD. We conducted fMRI on 40 non-demented participants (23 PD and 17 MC) during passive viewing of simulated optic flow motion and random motion. We hypothesized that compared to the MC group, PD participants would show abnormal neural activity in regions comprising this optic flow network. MC participants showed robust activation across all regions in the optic flow network, consistent with studies in young adults, suggesting intact optic flow perception at the neural level in healthy aging. PD participants showed diminished activity compared to MC particularly within visual motion area MT+ and the visuo-vestibular region CSv. Further, activation in visuo-vestibular region CSv was associated with disease severity. These findings suggest that behavioral reports of impaired optic flow perception and visuospatial performance may be a result of impaired neural processing within visual motion and visuo-vestibular regions in PD.Published versio

Sparse Coding Predicts Optic Flow Specificities of Zebrafish Pretectal Neurons

Zebrafish pretectal neurons exhibit specificities for large-field optic flow patterns associated with rotatory or translatory body motion. We investigate the hypothesis that these specificities reflect the input statistics of natural optic flow. Realistic motion sequences were generated using computer graphics simulating self-motion in an underwater scene. Local retinal motion was estimated with a motion detector and encoded in four populations of directionally tuned retinal ganglion cells, represented as two signed input variables. This activity was then used as input into one of two learning networks: a sparse coding network (competitive learning) and backpropagation network (supervised learning). Both simulations develop specificities for optic flow which are comparable to those found in a neurophysiological study (Kubo et al. 2014), and relative frequencies of the various neuronal responses are best modeled by the sparse coding approach. We conclude that the optic flow neurons in the zebrafish pretectum do reflect the optic flow statistics. The predicted vectorial receptive fields show typical optic flow fields but also "Gabor" and dipole-shaped patterns that likely reflect difference fields needed for reconstruction by linear superposition.Comment: Published Conference Paper from ICANN 2018, Rhode

Two mechanisms for optic flow and scale change processing of looming

Published in final edited form as: J Vis. ; 11(3): . doi:10.1167/11.3.5.The detection of looming, the motion of objects in depth, underlies many behavioral tasks, including the perception of self-motion and time-to-collision. A number of studies have demonstrated that one of the most important cues for looming detection is optic flow, the pattern of motion across the retina. Schrater et al. have suggested that changes in spatial frequency over time, or scale changes, may also support looming detection in the absence of optic flow (P. R. Schrater, D. C. Knill, & E. P. Simoncelli, 2001). Here we used an adaptation paradigm to determine whether the perception of looming from optic flow and scale changes is mediated by single or separate mechanisms. We show first that when the adaptation and test stimuli were the same (both optic flow or both scale change), observer performance was significantly impaired compared to a dynamic (non-motion, non-scale change) null adaptation control. Second, we found no evidence of cross-cue adaptation, either from optic flow to scale change, or vice versa. Taken together, our data suggest that optic flow and scale changes are processed by separate mechanisms, providing multiple pathways for the detection of looming.We thank Jonathan Victor and the anonymous reviewers of the paper for feedback and suggestions regarding the stimuli used here. This work was supported by NIH grant R01NS064100 to LMV. (R01NS064100 - NIH)Accepted manuscrip

Functional neuroanatomy of time-to-passage perception

The time until an approaching object passes the observer is referred to as time-to-passage (TTP). Accurate judgment of TTP is critical for visually guided navigation, such as when walking, riding a bicycle, or driving a car. Previous research has shown that observers are able to make TTP judgments in the absence of information about local retinal object expansion. In this paper we combine psychophysics and functional MRI (fMRI) to investigate the neural substrate of TTP processing. In a previous psychophysical study, we demonstrated that when local retinal expansion cues are not available, observers take advantage of multiple sources of information to judge TTP, such as optic flow and object retinal velocities, and integrate these cues through a flexible and economic strategy. To induce strategy changes, we introduced trials with motion but without coherent optic flow (0% coherence of the background), and trials with coherent, but noisy, optic flow (75% coherence of the background). In a functional magnetic resonance imaging (fMRI) study we found that coherent optic flow cues resulted in better behavioral performance as well as higher and broader cortical activations across the visual motion processing pathway. Blood oxygen-level-dependent (BOLD) signal changes showed significant involvement of optic flow processing in the precentral sulcus (PreCS), postcentral sulcus (PostCS) and middle temporal gyrus (MTG) across all conditions. Not only highly activated during motion processing, bilateral hMT areas also showed a complex pattern in TTP judgment processing, which reflected a flexible TTP response strategy.Accepted manuscrip

Global Flow Impacts Time-to-passage Judgments Based on Local Motion Cues

We assessed the effect of the coherence of optic flow on time-to-passage judgments in order to investigate the strategies that observers use when local expansion information is reduced or lacking. In the standard display, we presented a cloud of dots whose image expanded consistent with constant observer motion. The dots themselves, however, did not expand and were thus devoid of object expansion cues. Only the separations between the dots expanded. Subjects had to judge which of two colored target dots, presented at different simulated depths and lateral displacements would pass them first. Image velocities of the target dots were chosen so as to correlate with time-to-passage only some of the time. When optic flow was mainly incoherent, subjects’ responses were biased and relied on image velocities rather than on global flow analysis. However, the bias induced by misleading image velocity cues diminished as a function of the coherence of the optic flow. We discuss the results in the context of a global tau mechanism and settle a debate whether local expansion cues or optic flow analysis are the basis for time-to-passage estimation

Rotational and Translational Velocity and Acceleration Thresholds for the Onset of Cybersickness in Virtual Reality

This paper determined rotational and translational velocity and acceleration thresholds for the onset of cybersickness. Cybersickness causes discomfort and discourages the widespread use of virtual reality systems for both recreational and professional use. Visual motion or optic flow is known to be one of the main causes of cybersickness due to the sensory conflict it creates with the vestibular system. The aim of this experiment is to detect rotational and translational velocity and acceleration thresholds that cause the onset of cybersickness. Participants were exposed to a moving particle field in virtual reality for a few seconds per run. The field moved in different directions (longitudinal, lateral, roll, and yaw), with different velocity profiles (steady and accelerating), and different densities. Using a staircase procedure, that controlled the speed or acceleration of the field, we detected the threshold at which participant started to feel temporary symptoms of cybersickness. The optic flow was quantified for each motion type and by modifying the number of features, the same amount of optic flow was present in each scene. Having the same optic flow in each scene allows a direct comparison of the thresholds. The results show that the velocity and acceleration thresholds for rotational optic flow were significantly lower than for translational optic flow. The thresholds suggestively decreased with the decreasing particle density of the scene. Finally, it was found that all the rotational and translational thresholds strongly correlate with each other. While the mean values of the thresholds could be used as guidelines to develop virtual reality applications, the high variability between individuals implies that the individual tuning of motion controls would be more effective to reduce cybersickness while minimizing the impact on the experience of immersion

Optic flow based perception of two-dimensional trajectories and the effects of a single landmark.

It is well established that human observers can detect their heading direction on a very short time scale on the basis of optic flow (500ms; Hooge et al., 2000). Can they also integrate these perceptions over time to reconstruct a 2D trajectory simulated by the optic flow stimulus? We investigated the visual perception and reconstruction of passively travelled two-dimensional trajectories from optic flow with and without a single landmark. Stimuli in which translation and yaw are unyoked can give rise to illusory percepts; using a structured visual environment instead of only dots can improve perception of these stimuli. Does the additional visual and/or extra-retinal information provided by a single landmark have a similar, beneficial effect? Here, seated, stationary subjects wore a head-mounted display showing optic flow stimuli that simulated various manoeuvres: linear or curvilinear 2D trajectories over a horizontal ground plane. The simulated orientation was either fixed in space, fixed relative to the path, or changed relative to both. Afterwards, subjects reproduced the perceived manoeuvre with a model vehicle, of which we recorded position and orientation. Yaw was perceived correctly. Perception of the travelled path was less accurate, but still good when the simulated orientation was fixed in space or relative to the trajectory. When the amount of yaw was not equal to the rotation of the path, or in the opposite direction, subjects still perceived orientation as fixed relative to the trajectory. This caused trajectory misperception because yaw was wrongly attributed to a rotation of the path. A single landmark could improve perception

Optic flow based perception of two-dimensional trajectories and the effects of a single landmark.

It is well established that human observers can detect their heading direction on a very short time scale on the basis of optic flow. Can they also integrate these perceptions over time to reconstruct a 2D trajectory simulated by the optic flow stimulus? We investigated the visual perception and reconstruction of visually travelled two-dimensional trajectories from optic flow with and without a single landmark. Stimuli in which translation and yaw are unyoked can give rise to illusory percepts; using a structured visual environment instead of only dots can improve perception of these stimuli. Does the additional visual and/or extra-retinal information provided by a single landmark have a similar, beneficial effect? Here, seated, stationary subjects wore a head-mounted display showing optic flow stimuli that simulated various manoeuvres: linear or curvilinear 2D trajectories over a horizontal plane. The simulated orientation was either fixed in space, fixed relative to the path, or changed relative to both. Afterwards, subjects reproduced the perceived manoeuvre with a model vehicle, of which we recorded position and orientation. Yaw was perceived correctly. Perception of the travelled path was less accurate, but still good when the simulated orientation was fixed in space or relative to the trajectory. When the amount of yaw was not equal to the rotation of the path, or in the opposite direction, subjects still perceived orientation as fixed relative to the trajectory. This caused trajectory misperception because yaw was wrongly attributed to a rotation of the path. A single landmark could improve perception

Effects of Parkinson’s disease on optic flow perception for heading direction during navigation

Visuoperceptual disorders have been identified in individuals with Parkinson’s disease (PD) and may affect the perception of optic flow for heading direction during navigation. Studies in healthy subjects have confirmed that heading direction can be determined by equalizing the optic flow speed (OS) between visual fields. The present study investigated the effects of PD on the use of optic flow for heading direction, walking parameters, and interlimb coordination during navigation, examining the contributions of OS and spatial frequency (dot density). Twelve individuals with PD without dementia, 18 age-matched normal control adults (NC), and 23 young control adults (YC) walked through a virtual hallway at about 0.8 m/s. The hallway was created by random dots on side walls. Three levels of OS (0.8, 1.2, and 1.8 m/s) and dot density (1, 2, and 3 dots/m2) were presented on one wall while on the other wall, OS and dot density were fixed at 0.8 m/s and 3 dots/m2, respectively. Three-dimensional kinematic data were collected, and lateral drift, walking speed, stride frequency and length, and frequency, and phase relations between arms and legs were calculated. A significant linear effect was observed on lateral drift to the wall with lower OS for YC and NC, but not for PD. Compared to YC and NC, PD veered more to the left under OS and dot density conditions. The results suggest that healthy adults perceive optic flow for heading direction. Heading direction in PD may be more affected by the asymmetry of dopamine levels between the hemispheres and by motor lateralization as indexed by handedness.Published versio

Optic flow improves step width and length in older adults while performing dual task

Background Dual-task paradigms are used to investigate gait and cognitive declines in older adults (OA). Optic-flow is a virtual reality environment where the scene flows past the subject while walking on a treadmill, mimicking real-life locomotion. Aims To investigate cost of environment (no optic-flow v. optic-flow) while completing single- and dual-task walking and dual-task costs (DTC; single- v. dual-task) in optic-flow and no optic-flow environments. Methods Twenty OA and seven younger adults (YA) walked on a self-paced treadmill in 3-min segments per task and both environments. Five task conditions included: no task, semantic fluency (category), phonemic fluency (letters), word reading, and serial-subtraction. Results OAs had a benefit of optic-flow compared to no optic-flow for step width (p = 0.015) and step length (p = 0.045) during letters compared to the YA. During letters, OA experienced improvement in step width DTC; whereas YA had a decrement in step width DTC from no optic-flow to optic-flow (p = 0.038). During serial-subtraction, OA had less step width DTC when compared to YA in both environments (p = 0.02). Discussion During letters, step width and step length improved in OA while walking in optic-flow. Also, step width DTC differed between the two groups. Sensory information from optic-flow appears to benefit OA. Letters relies more on verbal ability and word knowledge, which are preserved in aging. However, YA use a complex speech style during dual tasking, searching for complex words and an increased speed of speech. Conclusions OA can benefit from optic-flow by improving spatial gait parameters, specifically, step width, during dual-task walking