A model of ganglion axon pathways accounts for percepts elicited by retinal implants.

Degenerative retinal diseases such as retinitis pigmentosa and macular degeneration cause irreversible vision loss in more than 10 million people worldwide. Retinal prostheses, now implanted in over 250 patients worldwide, electrically stimulate surviving cells in order to evoke neuronal responses that are interpreted by the brain as visual percepts ('phosphenes'). However, instead of seeing focal spots of light, current implant users perceive highly distorted phosphenes that vary in shape both across subjects and electrodes. We characterized these distortions by asking users of the Argus retinal prosthesis system (Second Sight Medical Products Inc.) to draw electrically elicited percepts on a touchscreen. Using ophthalmic fundus imaging and computational modeling, we show that elicited percepts can be accurately predicted by the topographic organization of optic nerve fiber bundles in each subject's retina, successfully replicating visual percepts ranging from 'blobs' to oriented 'streaks' and 'wedges' depending on the retinal location of the stimulating electrode. This provides the first evidence that activation of passing axon fibers accounts for the rich repertoire of phosphene shape commonly reported in psychophysical experiments, which can severely distort the quality of the generated visual experience. Overall our findings argue for more detailed modeling of biological detail across neural engineering applications

Visual function before and after the removal of bilateral congenital cataracts in adulthood

AbstractSubject Peter Doyle (PD) had congenital bilateral cataracts removed at the age of 43. Pre-operatively PD's visual acuity was 20/80, with a resolution limit around 15 cpd, and he experienced monocular diplopia with high contrast stimuli. Post-operatively PD's visual acuity improved to approximately 20/40, with a resolution limit around 25 cpd. Using a variety of pre- and post-operative tests we have documented a wide range of neural adaptations to his limited and distorted visual input, and have found a limited amount of post-operative adaptation to his newly improved visual input. These results show that the human visual system is capable of significant adaptation to the particular optical input that is experienced

Visual Motion Area MT+/V5 Responds to Auditory Motion in Human Sight-Recovery Subjects

Using functional magnetic resonance imaging, we found that cortical visual motion area MT+/V5 responded to auditory motion in two rare subjects who had been blind since early childhood and whose vision was partially recovered in adulthood. Visually normal control subjects did not show similar auditory responses. These auditory responses in MT+ were specific to motion compared with other complex auditory stimuli including frequency sweeps and speech. Thus, MT+ developed motion-specific responses to nonvisual input, suggesting that cross-modal plasticity can be influenced by the normal functional specialization of a cortical region. Regarding sight recovery after early blindness, our results further demonstate that cross-modal responses coexist with regained visual responses within the visual cortex

Combining Visual Cues to Depth and Shape: A Comparison of Three Models

Performance in estimating the depth and shape of an ellipse on the basis of stereo, motion, and vergence angle information was compared for three models of visual depth cue combination. The three models were a weak model (strict modularity, with no interaction between motion and stereo cues), a modified weak model (restricted interaction allowed between motion and stereo cues), and a strong model (unconstrained interaction between all visual cues). Results are that the modified weak model performed best overall indicating that its structure, which contains both modular and interactive features, has advantages over both the extreme modular organization of the weak model and the extreme interactive organization of the strong model. In addition, the different weighting of motion and stereo cues by the modified weak model in the depth and shape judgment tasks provides a motivation for multiple visual representations of three-dimensional space

Spatiotemporal Interactions in Retinal Prosthesis Subjects

The authors show that synchronous and asynchronous stimulation on groups of electrodes in subjects with retinal prostheses leads to significant changes in the percept. Understanding how pulse timing across electrodes influences the percept is fundamental to the design of a functional retinal prosthesis

Surface segmentation based on the luminance and color statistics of natural scenes

The luminance and color of surfaces in natural scenes are relatively independent under certain linear transformations, with the luminance of a surface providing little information about the color of that surface, and vice versa. However, differences in luminance between two locations in a natural scene remain strongly associated with differences in color. We used the statistics of the spatiochromatic structure of natural scenes as the priors for a Bayesian model that decides whether or not two points within an image fall on the same surface. This model provides a biologically plausible algorithm for surface segmentation that models observe