The functional anatomy of white matter pathways for visual configuration learning

The role of the medial temporal lobes (MTL) in visuo-spatial learning has been extensively studied and documented in the neuroscientific literature. Numerous animal and human studies have demonstrated that the parahippocampal place area (PPA), which sits at the confluence of the parahippocampal and lingual gyri, is particularly important for learning the spatial configuration of objects in visually presented scenes. In current visuo-spatial processing models, the PPA sits downstream from the parietal lobes which are involved in multiple facets of spatial processing. Yet, direct input to the PPA from early visual cortex (EVC) is rarely discussed and poorly understood. This thesis adopted a multimodal neuroimaging analysis approach to study the functional anatomy of these connections. First, the pattern of structural connectivity between EVC and the MTL was explored by means of surface-based ‘connectomes’ constructed from diffusion MRI tractography in a cohort of 200 healthy young adults from the Human Connectome Project. Through this analysis, the PPA emerged as a primary recipient of EVC connections within the MTL. Second, a data-driven clustering analysis of the PPA’s connectivity to an extended cortical region (including EVC, retrosplenial cortex, and other areas) revealed multiple clusters with different connectivity profiles within the PPA. The two main clusters were located in the posterior and anterior portions of the PPA, with the posterior cluster preferentially connected to EVC. Motivated by this result, virtual tractography dissections were used to delineate the medial occipital longitudinal tract (MOLT), the white matter bundle connecting the PPA with EVC. The properties of this bundle and its relation to visual configuration learning were verified in a different, cross-sectional adult cohort of 90 subjects. Finally, the role of the MOLT in the visuo-spatial learning domain was further confirmed in the case of a stroke patient who, after bilateral occipital injury, exhibited deficits confined to this domain. The results presented in this work suggest that the MOLT should be included in current visuo-spatial processing models as it offers additional insight into how the MTL acquires and processes information for spatial learning

Quantitation in MRI : application to ageing and epilepsy

Multi-atlas propagation and label fusion techniques have recently been developed for segmenting the human brain into multiple anatomical regions. In this thesis, I investigate possible adaptations of these current state-of-the-art methods. The aim is to study ageing on the one hand, and on the other hand temporal lobe epilepsy as an example for a neurological disease. Overall effects are a confounding factor in such anatomical analyses. Intracranial volume (ICV) is often preferred to normalize for global effects as it allows to normalize for estimated maximum brain size and is hence independent of global brain volume loss, as seen in ageing and disease. I describe systematic differences in ICV measures obtained at 1.5T versus 3T, and present an automated method of measuring intracranial volume, Reverse MNI Brain Masking (RBM), based on tissue probability maps in MNI standard space. I show that this is comparable to manual measurements and robust against field strength differences. Correct and robust segmentation of target brains which show gross abnormalities, such as ventriculomegaly, is important for the study of ageing and disease. We achieved this with incorporating tissue classification information into the image registration process. The best results in elderly subjects, patients with TLE and healthy controls were achieved using a new approach using multi-atlas propagation with enhanced registration (MAPER). I then applied MAPER to the problem of automatically distinguishing patients with TLE with (TLE-HA) and without (TLE-N) hippocampal atrophy on MRI from controls, and determine the side of seizure onset. MAPER-derived structural volumes were used for a classification step consisting of selecting a set of discriminatory structures and applying support vector machine on the structural volumes as well as morphological similarity information such as volume difference obtained with spectral analysis. Acccuracies were 91-100 %, indicating that the method might be clinically useful. Finally, I used the methods developed in the previous chapters to investigate brain regional volume changes across the human lifespan in over 500 healthy subjects between 20 to 90 years of age, using data from three different scanners (2x 1.5T, 1x 3T), using the IXI database. We were able to confirm several known changes, indicating the veracity of the method. In addition, we describe the first multi-region, whole-brain database of normal ageing

Representation of contralateral visual space in the human hippocampus

The initial encoding of visual information primarily from the contralateral visual field is a fundamental organizing principle of the primate visual system. Recently, the presence of such retinotopic sensitivity has been shown to extend well beyond early visual cortex to regions not historically considered retinotopically sensitive. In particular, human scene-selective regions in parahippocampal and medial parietal cortex exhibit prominent biases for the contralateral visual field. Here we used fMRI to test the hypothesis that the human hippocampus, which is thought to be anatomically connected with these scene-selective regions, would also exhibit a biased representation of contralateral visual space. First, population receptive field mapping with scene stimuli revealed strong biases for the contralateral visual field in bilateral hippocampus. Second, the distribution of retinotopic sensitivity suggested a more prominent representation in anterior medial portions of the hippocampus. Finally, the contralateral bias was confirmed in independent data taken from the Human Connectome Project initiative. The presence of contralateral biases in the hippocampus - a structure considered by many as the apex of the visual hierarchy - highlights the truly pervasive influence of retinotopy. Moreover, this finding has important implications for understanding how this information relates to the allocentric global spatial representations known to be encoded therein.SIGNIFICANCE STATEMENT:Retinotopic encoding of visual information is an organizing principle of visual cortex. Recent work demonstrates this sensitivity in structures far beyond early visual cortex, including those anatomically connected to the hippocampus. Here, using population receptive field modelling in two independent sets of data we demonstrate a consistent bias for the contralateral visual field in bilateral hippocampus. Such a bias highlights the truly pervasive influence of retinotopy, with important implications for understanding how the presence of retinotopy relates to more allocentric spatial representations

Neural Encoding and Decoding with Deep Learning for Natural Vision

The overarching objective of this work is to bridge neuroscience and artificial intelligence to ultimately build machines that learn, act, and think like humans. In the context of vision, the brain enables humans to readily make sense of the visual world, e.g. recognizing visual objects. Developing human-like machines requires understanding the working principles underlying the human vision. In this dissertation, I ask how the brain encodes and represents dynamic visual information from the outside world, whether brain activity can be directly decoded to reconstruct and categorize what a person is seeing, and whether neuroscience theory can be applied to artificial models to advance computer vision. To address these questions, I used deep neural networks (DNN) to establish encoding and decoding models for describing the relationships between the brain and the visual stimuli. Using the DNN, the encoding models were able to predict the functional magnetic resonance imaging (fMRI) responses throughout the visual cortex given video stimuli; the decoding models were able to reconstruct and categorize the visual stimuli based on fMRI activity. To further advance the DNN model, I have implemented a new bidirectional and recurrent neural network based on the predictive coding theory. As a theory in neuroscience, predictive coding explains the interaction among feedforward, feedback, and recurrent connections. The results showed that this brain-inspired model significantly outperforms feedforward-only DNNs in object recognition. These studies have positive impact on understanding the neural computations under human vision and improving computer vision with the knowledge from neuroscience

A network linking scene perception and spatial memory systems in posterior cerebral cortex

The neural systems supporting scene-perception and spatial-memory systems of the human brain are well-described. But how do these neural systems interact? Here, using fine-grained individual-subject fMRI, we report three cortical areas of the human brain, each lying immediately anterior to a region of the scene perception network in posterior cerebral cortex, that selectively activate when recalling familiar real-world locations. Despite their close proximity to the scene-perception areas, network analyses show that these regions constitute a distinct functional network that interfaces with spatial memory systems during naturalistic scene understanding. These “place-memory areas” offer a new framework for understanding how the brain implements memory-guided visual behaviors, including navigation

Direct comparison of contralateral bias and face/scene selectivity in human occipitotemporal cortex

Human visual cortex is organised broadly according to two major principles: retinotopy (the spatial mapping of the retina in cortex) and category-selectivity (preferential responses to specific categories of stimuli). Historically, these principles were considered anatomically separate, with retinotopy restricted to the occipital cortex and category-selectivity emerging in the lateral-occipital and ventral-temporal cortex. However, recent studies show that category-selective regions exhibit systematic retinotopic biases, for example exhibiting stronger activation for stimuli presented in the contra- compared to the ipsilateral visual field. It is unclear, however, whether responses within category-selective regions are more strongly driven by retinotopic location or by category preference, and if there are systematic differences between category-selective regions in the relative strengths of these preferences. Here, we directly compare contralateral and category preferences by measuring fMRI responses to scene and face stimuli presented in the left or right visual field and computing two bias indices: a contralateral bias (response to the contralateral minus ipsilateral visual field) and a face/scene bias (preferred response to scenes compared to faces, or vice versa). We compare these biases within and between scene- and face-selective regions and across the lateral and ventral surfaces of the visual cortex more broadly. We find an interaction between surface and bias: lateral surface regions show a stronger contralateral than face/scene bias, whilst ventral surface regions show the opposite. These effects are robust across and within subjects, and appear to reflect large-scale, smoothly varying gradients. Together, these findings support distinct functional roles for the lateral and ventral visual cortex in terms of the relative importance of the spatial location of stimuli during visual information processing. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00429-021-02411-8

Direct comparison of contralateral bias and face/scene selectivity in human occipitotemporal cortex

Human visual cortex is organised broadly according to two major principles: retinotopy (the spatial mapping of the retina in cortex) and category-selectivity (preferential responses to specific categories of stimuli). Historically, these principles were considered anatomically separate, with retinotopy restricted to the occipital cortex and category-selectivity emerging in the lateral-occipital and ventral-temporal cortex. However, recent studies show that category-selective regions exhibit systematic retinotopic biases, for example exhibiting stronger activation for stimuli presented in the contra- compared to the ipsilateral visual field. It is unclear, however, whether responses within category-selective regions are more strongly driven by retinotopic location or by category preference, and if there are systematic differences between category-selective regions in the relative strengths of these preferences. Here, we directly compare contralateral and category preferences by measuring fMRI responses to scene and face stimuli presented in the left or right visual field and computing two bias indices: a contralateral bias (response to the contralateral minus ipsilateral visual field) and a face/scene bias (preferred response to scenes compared to faces, or vice versa). We compare these biases within and between scene- and face-selective regions and across the lateral and ventral surfaces of the visual cortex more broadly. We find an interaction between surface and bias: lateral surface regions show a stronger contralateral than face/scene bias, whilst ventral surface regions show the opposite. These effects are robust across and within subjects, and appear to reflect large-scale, smoothly varying gradients. Together, these findings support distinct functional roles for the lateral and ventral visual cortex in terms of the relative importance of the spatial location of stimuli during visual information processing. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00429-021-02411-8

Function follows form : how connectivity patterns govern neural responses

Thesis (Ph. D. in Neuroscience)--Massachusetts Institute of Technology, Dept. of Brain and Cognitive Sciences, 2013.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Cataloged from student-submitted PDF version of thesis.Includes bibliographical references.Connectivity restricts and defines the information that a network can process. It is the substance of information processing that underlies the patterns of functional activity in the brain. By combining diffusion-weighted imaging or DWI, with fMRI, we are able to non-invasively measure connectivity and neural responses in the same individuals and directly relate these two measures to one another. In Chapter 2, I first establish the proof-of-principle that anatomical connectivity alone can predict neural responses in cortex, specifically of face-selectivity in the fusiform gyrus. I then extend this novel approach to the rest of the brain and test whether connectivity can accurately predict neural responses to various visual categories in Chapter 3. Finally, in Chapter 4, I compare and contrast the resulting models, which are essentially networks of connectivity that are functionally-relevant to each visual category, and demonstrate the type of knowledge that can be uncovered by directly integrating structure and function.by David Eugene Osher.Ph.D.in Neuroscienc

Spatial Representation in Postrhinal Cortex

Animals rely on a variety of internal and external cues to orient themselves when navigating their environments and determining their current spatial context. Information regarding these cues enters the brain from the navigator’s first-person perspective. Information of this type is considered to be egocentric, or self-centered. However, decades of behavioral, electrophysiological, and imaging research suggest that the brain contains a rich collection of spatial representations that are unrestricted by the animal’s first-person perspective, and instead are defined relative to the surrounding environment. These representations are considered allocentric, or world-centered. Despite an abundance of promising modeling work, the specific mechanisms by which first-person sensory information is transformed into an allocentric map-like representation within the brain are just beginning to be elucidated. One potential locus for the transformation from egocentric to allocentric is the rodent postrhinal cortex (POR), which has been implicated in spatial and contextual learning and is densely interconnected with brain regions that process egocentric sensory and allocentric spatial information. POR is also considered to be homologous to the human parahippocampal cortex, which has been strongly implicated in topographic spatial learning and visual scene processing. We therefore sought to determine exactly how egocentric and allocentric spatial variables are represented and combined in POR. We first recorded from POR neurons as rats navigated an open field environment, and found a large proportion of cells that responded to either the egocentric bearing of the environment centroid (center-bearing), the egocentric distance of the environment centroid (center-distance), the animal’s allocentric head direction (HD), or a combination of the three, confirming that POR neurons express a mixture of egocentric and allocentric correlates. Next, we used visual landmark manipulations to demonstrate that POR HD cells are sensitive to the number, distribution, and properties of visual landmarks, such that they fire bidirectionally under certain circumstances (i.e., with two different preferred firing directions), and may produce an estimate of HD based on the constellation of visual landmarks. Finally, we used chemical inactivation of the anterior thalamus to demonstrate that the POR HD signal is at least partially derived from the ‘classic’ vestibular-based HD signal, and is likely to reflect a combination of HD and visual inputs. These experiments provide insight into how egocentric and allocentric spatial information converge in the mammalian brain, and help to elucidate the role of the POR in processing spatial and contextual information