Visual System Development in People with One Eye: Behaviour and Structural Neural Correlates

Postnatal monocular deprivation from the surgical removal (enucleation) of one eye in humans results in intact spatial form vision, although its consequences on motion perception development are less clear. Changes in brain structure following early monocular enucleation have either been assessed in species whose visual system is quite different from humans, or in enucleated monkeys and humans following short-term survival. In this dissertation, I sought to determine the long-term effects of enucleation on visual system development by examining behavioural visual abilities and visual system morphology in adults who have had one eye enucleated early in life due to retinoblastoma. In Chapter II, I conducted a series of speed and luminance contrast discrimination tasks not yet implemented in this group. Early monocular enucleation results in impaired speed discrimination but intact contrast perception compared to binocular and monocular viewing controls. These findings suggest differential effects of enucleation on the development of spatial form vision and motion perception. In Chapters III and IV, I obtained high-resolution structural magnetic resonance images to assess the morphological development of subcortical (Chapter III) and cortical (Chapter IV) structures in the visual pathway. Early monocular enucleation resulted in decreased optic chiasm width and volume, optic tract diameters, and lateral geniculate nuclei (LGN) volumes compared with binocularly intact controls. Surprisingly, however, optic tract diameter and LGN volume decreases were less severe contralateral to the remaining eye. Early monocular enucleation also resulted in increased grey matter surface area of visual and non-visual cortices compared with binocularly intact controls. Consistent with the LGN asymmetry, increased surface area of the primary visual cortex was restricted to the hemisphere contralateral to the remaining eye. Surprisingly, however, these increases were found for those with right- but not left-eye enucleation, suggesting different developmental time periods for each hemisphere. Possible mechanisms of altered development following early monocular enucleation include: 1) recruitment of deafferented cells by the remaining eye, 2) retention of deafferented cells due to feedback from visual cortex, and 3) a disruption in synaptic pruning. These data highlight the importance of receiving normal levels of binocular visual input during infancy for typical visual development

Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-opera- tive morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilites by observ- ing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted in- struments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D opti- cal imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task

Loss of Binocular Vision in Monocularly Blind Patients Causes Selective Degeneration of the Superior Lateral Occipital Cortices

PURPOSE. Chronic ocular pathology, such as glaucoma and macular degeneration, is associated with neuroanatomic changes in the visual pathways. It is a challenge to determine the mechanism responsible for these changes. This could be functional deprivation or transsynaptic degeneration. Acquired monocular blindness provides a unique opportunity to establish which mechanism underlies neuroanatomic changes in ocular pathology in general, since the loss of input is well defined, and it causes selective functional deprivation due to the loss of stereopsis. Here, we assessed whether acquired monocular blindness is associated with neuroanatomic changes, and if so, where these changes are located. METHODS. High-resolution T1-weighted magnetic resonance images were obtained in 15 monocularly blind patients and 18 healthy controls. We used voxel-and surface-based morphometry to compare gray and white matter volume, cortical thickness, mean curvature, and surface area between these groups. RESULTS. The gray matter volume in the bilateral superior lateral occipital cortices was decreased in the monocular blind patients, in the absence of volumetric differences in their early visual cortex. CONCLUSIONS. The volumetric decrease in the superior lateral occipital cortices is consistent with specific functional deprivation, as the superior lateral occipital cortices play an important role in depth perception. Moreover, in the absence of differences in the early visual cortex, the decrease is inconsistent with transsynaptic degeneration propagating from the degenerated retinal axons

Spatial and temporal integration of binocular disparity in the primate brain

Le système visuel du primate s'appuie sur les légères différences entre les deux projections rétiniennes pour percevoir la profondeur. Cependant, on ne sait pas exactement comment ces disparités binoculaires sont traitées et intégrées par le système nerveux. D'un côté, des enregistrements unitaires chez le macaque permettent d'avoir accès au codage neuronal de la disparité à un niveau local. De l'autre côté, la neuroimagerie fonctionnelle (IRMf) chez l'humain met en lumière les réseaux corticaux impliqués dans le traitement de la disparité à un niveau macroscopique mais chez une espèce différente. Dans le cadre de cette thèse, nous proposons d'utiliser la technique de l'IRMf chez le macaque pour permettre de faire le lien entre les enregistrements unitaires chez le macaque et les enregistrements IRMf chez l'humain. Cela, afin de pouvoir faire des comparaisons directes entre les deux espèces. Plus spécifiquement, nous nous sommes intéressés au traitement spatial et temporal des disparités binoculaires au niveau cortical mais aussi au niveau perceptif. En étudiant l'activité corticale en réponse au mouvement tridimensionnel (3D), nous avons pu montrer pour la première fois 1) qu'il existe un réseau dédié chez le macaque qui contient des aires allant au-delà du cluster MT et des aires environnantes et 2) qu'il y a des homologies avec le réseau trouvé chez l'humain en réponse à des stimuli similaires. Dans une deuxième étude, nous avons tenté d'établir un lien entre les biais perceptifs qui reflètent les régularités statistiques 3D ans l'environnement visuel et l'activité corticale. Nous nous sommes demandés si de tels biais existent et peuvent être reliés à des réponses spécifiques au niveau macroscopique. Nous avons trouvé de plus fortes activations pour le stimulus reflétant les statistiques naturelles chez un sujet, démontrant ainsi une possible influence des régularités spatiales sur l'activité corticale. Des analyses supplémentaires sont cependant nécessaires pour conclure de façon définitive. Néanmoins, nous avons pu confirmer de façon robuste l'existence d'un vaste réseau cortical répondant aux disparités corrélées chez le macaque. Pour finir, nous avons pu mesurer pour la première fois les points rétiniens correspondants au niveau du méridien vertical chez un sujet macaque qui réalisait une tâche comportementale (procédure à choix forcé). Nous avons pu comparer les résultats obtenus avec des données également collectées chez des participants humains avec le même protocole. Dans les différentes sections de discussion, nous montrons comment nos différents résultats ouvrent la voie à de nouvelles perspectives.The primate visual system strongly relies on the small differences between the two retinal projections to perceive depth. However, it is not fully understood how those binocular disparities are computed and integrated by the nervous system. On the one hand, single-unit recordings in macaque give access to neuronal encoding of disparity at a very local level. On the other hand, functional neuroimaging (fMRI) studies in human shed light on the cortical networks involved in disparity processing at a macroscopic level but with a different species. In this thesis, we propose to use an fMRI approach in macaque to bridge the gap between single-unit and fMRI recordings conducted in the non-human and human primate brain, respectively, by allowing direct comparisons between the two species. More specifically, we focused on the temporal and spatial processing of binocular disparities at the cortical but also at the perceptual level. Investigating cortical activity in response to motion-in-depth, we could show for the first time that 1) there is a dedicated network in macaque that comprises areas beyond the MT cluster and its surroundings and that 2) there are homologies with the human network involved in processing very similar stimuli. In a second study, we tried to establish a link between perceptual biases that reflect statistical regularities in the three-dimensional visual environment and cortical activity, by investigating whether such biases exist and can be related to specific responses at a macroscopic level. We found stronger activity for the stimulus reflecting natural statistics in one subject, demonstrating a potential influence of spatial regularities on the cortical activity. Further work is needed to firmly conclude about such a link. Nonetheless, we robustly confirmed the existence of a vast cortical network responding to correlated disparities in the macaque brain. Finally, we could measure for the first time retinal corresponding points on the vertical meridian of a macaque subject performing a behavioural task (forced-choice procedure) and compare it to the data we also collected in several human observers with the very same protocol. In the discussion sections, we showed how these findings open the door to varied perspectives

Representation Learning in Sensory Cortex: a theory

We review and apply a computational theory of the feedforward path of the ventral stream in visual cortex based on the hypothesis that its main function is the encoding of invariant representations of images. A key justification of the theory is provided by a theorem linking invariant representations to small sample complexity for recognition – that is, invariant representations allows learning from very few labeled examples. The theory characterizes how an algorithm that can be implemented by a set of ”simple” and ”complex” cells – a ”HW module” – provides invariant and selective representations. The invariance can be learned in an unsupervised way from observed transformations. Theorems show that invariance implies several properties of the ventral stream organization, including the eccentricity dependent lattice of units in the retina and in V1, and the tuning of its neurons. The theory requires two stages of processing: the first, consisting of retinotopic visual areas such as V1, V2 and V4 with generic neuronal tuning, leads to representations that are invariant to translation and scaling; the second, consisting of modules in IT, with class- and object-specific tuning, provides a representation for recognition with approximate invariance to class specific transformations, such as pose (of a body, of a face) and expression. In the theory the ventral stream main function is the unsupervised learning of ”good” representations that reduce the sample complexity of the final supervised learning stage.This work was supported by the Center for Brains, Minds and Machines (CBMM), funded by NSF STC award CCF - 1231216

Functional anatomy of stereoscopic visual process assessed using functional magnetic resonance imaging and structural equation modelling.

The purpose of this thesis is to study the functional anatomy of stereoscopic vision. Although many studies have investigated the physiological mechanisms by which the brain transforms the retinal disparities into three-dimensional representations, the invasive nature of the techniques available have restricted them to studies in non-human primates, whilst the research on humans has been limited to psychophysical studies. Modem non-invasive neuroimaging techniques now allow the investigation of the functional organisation of the human brain. Although PET and fMRI studies have been widely used, few researchers have explored the functional anatomy of stereoscopic vision. Most of these studies appear to be pilot work, showing inconsistency, not only in the areas sensitive to stereo disparities, but also in the specific role that each of these possesses in the perception of depth. In order to investigate the cortical regions involved in stereoscopic vision, four fMRI studies were performed using anaglyph random dot stereo grams. Our results suggest that the stereo disparity processing is widespread over a network of cortical regions which include VI, V3A, V3B and B7. Functionally, the V3A region seems to be the main processing centre of pure stereo disparities and the V3B region to be engaged in motion defined purely by spatio-temporal changes of local horizontal disparities (stereoscopic -cyclopean- motion). Interregional connectivity was investigated with two approaches. Structural Equation Modelling (SEM), as the classical technique for the analysis of effective connectivity, was used to assess one connectivity model proposed to· explain the cortical interaction observed in the first experiment. The implementation and application of this technique permitted us to identify some of its weaknesses in representing fMRI data. An extension of the SEM technique was introduced as a Non-linear Auto-Regressive Moving Average with eXogenous variables (NARMAX) approach. This can be thought of as an attempt to bring SEM towards a non-linear dynamic system modelling technique which permits a more appropriate representation of effective connectivity models using fMRI time series

Increased cortical surface area and gyrification following long-term survival from early monocular enucleation

AbstractPurposeRetinoblastoma is typically diagnosed before 5 years of age and is often treated by enucleation (surgical removal) of the cancerous eye. Here, we sought to characterize morphological changes of the cortex following long-term survival from early monocular enucleation.MethodsNine adults with early right-eye enucleation (≤48 months of age) due to retinoblastoma were compared to 18 binocularly intact controls. Surface area, cortical thickness, and gyrification estimates were obtained from T1 weighted images and group differences were examined.ResultsEarly monocular enucleation was associated with increased surface area and/or gyrification in visual (i.e., V1, inferior temporal), auditory (i.e., supramarginal), and multisensory (i.e., superior temporal, inferior parietal, superior parietal) cortices compared with controls. Visual cortex increases were restricted to the right hemisphere contralateral to the remaining eye, consistent with previous subcortical data showing asymmetrical lateral geniculate nucleus volume following early monocular enucleation.ConclusionsAltered morphological development of visual, auditory, and multisensory regions occurs subsequent to long-time survival from early eye loss