Establishing the boundaries: the hippocampal contribution to imagining scenes

When we visualize scenes, either from our own past or invented, we impose a viewpoint for our “mind's eye” and we experience the resulting image as spatially coherent from that viewpoint. The hippocampus has been implicated in this process, but its precise contribution is unknown. We tested a specific hypothesis based on the spatial firing properties of neurons in the hippocampal formation of rats, that this region supports the construction of spatially coherent mental images by representing the locations of the environmental boundaries surrounding our viewpoint. Using functional magnetic resonance imaging, we show that hippocampal activation increases parametrically with the number of enclosing boundaries in the imagined scene. In contrast, hippocampal activity is not modulated by a nonspatial manipulation of scene complexity nor to increasing difficulty of imagining the scenes in general. Our findings identify a specific computational role for the hippocampus in mental imagery and episodic recollection

Anterior Hippocampus and Goal-Directed Spatial Decision Making

Contains fulltext : 115487.pdf (publisher's version ) (Open Access

Deforming the metric of cognitive maps distorts memory

Entorhinal grid cells, characterized by spatially periodic activity patterns, are thought to provide a universal spatial metric. However, grid cell firing-patterns are distorted in highly polarized environments such as trapezoids. Additionally, the functional role of grid cells in guiding behavior remains elusive. Here, we leverage immersive virtual reality using a novel motion platform to test the impact of environmental geometry on spatial memory in participants navigating a trapezoid arena. Object position memory in the trapezoid was degraded compared to a square control environment. Consistent with grid pattern distortions in rodents, this effect was more pronounced in the narrow than the broad part of the trapezoid. Remarkably, even outside of the encoding environment, these distortions persistently affected both navigated and judged distance estimates of never experienced paths between remembered positions and reconstructed memory maps. These distorted memory maps in turn explained behavior better than objective maps. Our findings demonstrate that environmental geometry interacts with human spatial memory similarly to how it affects rodent grid cells − thus strengthening the putative link between grid cells and behavior as well as cognitive functions beyond navigation

Parallel cognitive maps for short-term statistical and long-term semantic relationships in the hippocampal formation

The hippocampal-entorhinal system uses cognitive maps to represent spatial knowledge and other types of relational information, such as the transition probabilities between objects. However, objects can often be characterized in terms of different types of relations simultaneously, e.g. semantic similarities learned over the course of a lifetime as well as transitions experienced over a brief timeframe in an experimental setting. Here we ask how the hippocampal formation handles the embedding of stimuli in multiple relational structures that differ vastly in terms of their mode and timescale of acquisition: Does it integrate the different stimulus dimensions into one conjunctive map, or is each dimension represented in a parallel map? To this end, we reanalyzed functional magnetic resonance imaging (fMRI) data from Garvert et al. (2017) that had previously revealed an entorhinal map which coded for newly learnt statistical regularities. We used a triplet odd-one-out task to construct a semantic distance matrix for presented items and applied fMRI adaptation analysis to show that the degree of similarity of representations in bilateral hippocampus decreases as a function of semantic distance between presented objects. Importantly, while both maps localize to the hippocampal formation, this semantic map is anatomically distinct from the originally described entorhinal map. This finding supports the idea that the hippocampal-entorhinal system forms parallel cognitive maps reflecting the embedding of objects in diverse relational structures

Rapid encoding of task regularities in the human hippocampus guides sensorimotor timing

The brain encodes the statistical regularities of the environment in a task-specific yet flexible and generalizable format. Here, we seek to understand this process by bridging two parallel lines of research, one centered on sensorimotor timing, and the other on cognitive mapping in the hippocampal system. By combining functional magnetic resonance imaging (fMRI) with a fast-paced time-to-contact (TTC) estimation task, we found that the hippocampus signaled behavioral feedback received in each trial as well as performance improvements across trials along with reward-processing regions. Critically, it signaled performance improvements independent from the tested intervals, and its activity accounted for the trial-wise regression-to-the-mean biases in TTC estimation. This is in line with the idea that the hippocampus supports the rapid encoding of temporal context even on short time scales in a behavior-dependent manner. Our results emphasize the central role of the hippocampus in statistical learning and position it at the core of a brain-wide network updating sensorimotor representations in real time for flexible behavior

A combined DTI-fMRI approach for optimizing the delineation of posteromedial vs. anterolateral entorhinal cortex

In the entorhinal cortex (EC), attempts have been made to identify the human homologue regions of the medial (MEC) and lateral (LEC) subdivision using either functional magnetic resonance imaging (fMRI) or diffusion tensor imaging (DTI). However, there are still discrepancies between entorhinal subdivisions depending on the choice of connectivity seed regions and the imaging modality used. While DTI can be used to follow the white matter tracts of the brain, fMRI can identify functionally connected brain regions. In this study, we used both DTI and resting-state fMRI in 103 healthy adults to investigate both structural and functional connectivity between the EC and associated cortical brain regions. Differential connectivity with these regions was then used to predict the locations of the human homologues of MEC and LEC. Our results from combining DTI and fMRI support a subdivision into posteromedial (pmEC) and anterolateral (alEC) EC and reveal a discrete border between the pmEC and alEC. Furthermore, the EC subregions obtained by either imaging modality showed similar distinct connectivity patterns: While pmEC showed increased connectivity preferentially with the default mode network, the alEC exhibited increased connectivity with regions in the dorsal attention and salience networks. Optimizing the delineation of the human homologues of MEC and LEC with a combined, cross-validated DTI-fMRI approach allows to define a likely border between the two subdivisions and has implications for both cognitive and translational neuroscience research

Structural connectivity-based segmentation of the human entorhinal cortex

The medial (MEC) and lateral entorhinal cortex (LEC), widely studied in rodents, are well defined and characterized. In humans, however, the exact locations of their homologues remain uncertain. Previous functional magnetic resonance imaging (fMRI) studies have subdivided the human EC into posteromedial (pmEC) and anterolateral (alEC) parts, but uncertainty remains about the choice of imaging modality and seed regions, in particular in light of a substantial revision of the classical model of EC connectivity based on novel insights from rodent anatomy. Here, we used structural, not functional imaging, namely diffusion tensor imaging (DTI) and probabilistic tractography to segment the human EC based on differential connectivity to other brain regions known to project selectively to MEC or LEC. We defined MEC as more strongly connected with presubiculum and retrosplenial cortex (RSC), and LEC as more strongly connected with distal CA1 and proximal subiculum (dCA1pSub) and lateral orbitofrontal cortex (OFC). Although our DTI segmentation had a larger medial-lateral component than in the previous fMRI studies, our results show that the human MEC and LEC homologues have a border oriented both towards the posterior-anterior and medial-lateral axes, supporting the differentiation between pmEC and alEC

Interpreting wde-band neural activity using convolutional neural networks

Rapid progress in technologies such as calcium imaging and electrophysiology has seen a dramatic increase in the size and extent of neural recordings. Even so, interpretation of this data requires considerable knowledge about the nature of the representation and often depends on manual operations. Decoding provides a means to infer the information content of such recordings but typically requires highly processed data and prior knowledge of the encoding scheme. Here, we developed a deep-learning framework able to decode sensory and behavioral variables directly from wide-band neural data. The network requires little user input and generalizes across stimuli, behaviors, brain regions, and recording techniques. Once trained, it can be analyzed to determine elements of the neural code that are informative about a given variable. We validated this approach using electrophysiological and calcium-imaging data from rodent auditory cortex and hippocampus as well as human electrocorticography (ECoG) data. We show successful decoding of finger movement, auditory stimuli, and spatial behaviors – including a novel representation of head direction - from raw neural activity

The CABB dataset: A multimodal corpus of communicative interactions for behavioural and neural analyses

We present a dataset of behavioural and fMRI observations acquired in the context of humans involved in multimodal referential communication. The dataset contains audio/video and motion-tracking recordings of face-to-face, task-based communicative interactions in Dutch, as well as behavioural and neural correlates of participants’ representations of dialogue referents. Seventy-one pairs of unacquainted participants performed two interleaved interactional tasks in which they described and located 16 novel geometrical objects (i.e., Fribbles) yielding spontaneous interactions of about one hour. We share high-quality video (from three cameras), audio (from head-mounted microphones), and motion-tracking (Kinect) data, as well as speech transcripts of the interactions. Before and after engaging in the face-to-face communicative interactions, participants’ individual representations of the 16 Fribbles were estimated. Behaviourally, participants provided a written description (one to three words) for each Fribble and positioned them along 29 independent conceptual dimensions (e.g., rounded, human, audible). Neurally, fMRI signal evoked by each Fribble was measured during a one-back working-memory task. To enable functional hyperalignment across participants, the dataset also includes fMRI measurements obtained during visual presentation of eight animated movies (35 minutes total). We present analyses for the various types of data demonstrating their quality and consistency with earlier research. Besides high-resolution multimodal interactional data, this dataset includes different correlates of communicative referents, obtained before and after face-to-face dialogue, allowing for novel investigations into the relation between communicative behaviours and the representational space shared by communicators. This unique combination of data can be used for research in neuroscience, psychology, linguistics, and beyond