Using Strategic Movement to Calibrate a Neural Compass: A Spiking Network for Tracking Head Direction in Rats and Robots

The head direction (HD) system in mammals contains neurons that fire to represent the direction the animal is facing in its environment. The ability of these cells to reliably track head direction even after the removal of external sensory cues implies that the HD system is calibrated to function effectively using just internal (proprioceptive and vestibular) inputs. Rat pups and other infant mammals display stereotypical warm-up movements prior to locomotion in novel environments, and similar warm-up movements are seen in adult mammals with certain brain lesion-induced motor impairments. In this study we propose that synaptic learning mechanisms, in conjunction with appropriate movement strategies based on warm-up movements, can calibrate the HD system so that it functions effectively even in darkness. To examine the link between physical embodiment and neural control, and to determine that the system is robust to real-world phenomena, we implemented the synaptic mechanisms in a spiking neural network and tested it on a mobile robot platform. Results show that the combination of the synaptic learning mechanisms and warm-up movements are able to reliably calibrate the HD system so that it accurately tracks real-world head direction, and that calibration breaks down in systematic ways if certain movements are omitted. This work confirms that targeted, embodied behaviour can be used to calibrate neural systems, demonstrates that ‘grounding’ of modelled biological processes in the real world can reveal underlying functional principles (supporting the importance of robotics to biology), and proposes a functional role for stereotypical behaviours seen in infant mammals and those animals with certain motor deficits. We conjecture that these calibration principles may extend to the calibration of other neural systems involved in motion tracking and the representation of space, such as grid cells in entorhinal cortex

Accurate path integration in continuous attractor network models of grid cells

Grid cells in the rat entorhinal cortex display strikingly regular firing responses to the animal's position in 2-D space and have been hypothesized to form the neural substrate for dead-reckoning. However, errors accumulate rapidly when velocity inputs are integrated in existing models of grid cell activity. To produce grid-cell-like responses, these models would require frequent resets triggered by external sensory cues. Such inadequacies, shared by various models, cast doubt on the dead-reckoning potential of the grid cell system. Here we focus on the question of accurate path integration, specifically in continuous attractor models of grid cell activity. We show, in contrast to previous models, that continuous attractor models can generate regular triangular grid responses, based on inputs that encode only the rat's velocity and heading direction. We consider the role of the network boundary in the integration performance of the network and show that both periodic and aperiodic networks are capable of accurate path integration, despite important differences in their attractor manifolds. We quantify the rate at which errors in the velocity integration accumulate as a function of network size and intrinsic noise within the network. With a plausible range of parameters and the inclusion of spike variability, our model networks can accurately integrate velocity inputs over a maximum of ~10–100 meters and ~1–10 minutes. These findings form a proof-of-concept that continuous attractor dynamics may underlie velocity integration in the dorsolateral medial entorhinal cortex. The simulations also generate pertinent upper bounds on the accuracy of integration that may be achieved by continuous attractor dynamics in the grid cell network. We suggest experiments to test the continuous attractor model and differentiate it from models in which single cells establish their responses independently of each other

Choosing the right bar: a complex problem

Inputs to the central complex, the navigation center of Drosophila, are strongly modulated by the visual stimulus history. These history effects carry forward to bias turning behavior when flies choose between two visual stimuli

Fumarate is an epigenetic modifier that elicits epithelial-to-mesenchymal transition.

Mutations of the tricarboxylic acid cycle enzyme fumarate hydratase cause hereditary leiomyomatosis and renal cell cancer. Fumarate hydratase-deficient renal cancers are highly aggressive and metastasize even when small, leading to a very poor clinical outcome. Fumarate, a small molecule metabolite that accumulates in fumarate hydratase-deficient cells, plays a key role in cell transformation, making it a bona fide oncometabolite. Fumarate has been shown to inhibit α-ketoglutarate-dependent dioxygenases that are involved in DNA and histone demethylation. However, the link between fumarate accumulation, epigenetic changes, and tumorigenesis is unclear. Here we show that loss of fumarate hydratase and the subsequent accumulation of fumarate in mouse and human cells elicits an epithelial-to-mesenchymal-transition (EMT), a phenotypic switch associated with cancer initiation, invasion, and metastasis. We demonstrate that fumarate inhibits Tet-mediated demethylation of a regulatory region of the antimetastatic miRNA cluster mir-200ba429, leading to the expression of EMT-related transcription factors and enhanced migratory properties. These epigenetic and phenotypic changes are recapitulated by the incubation of fumarate hydratase-proficient cells with cell-permeable fumarate. Loss of fumarate hydratase is associated with suppression of miR-200 and the EMT signature in renal cancer and is associated with poor clinical outcome. These results imply that loss of fumarate hydratase and fumarate accumulation contribute to the aggressive features of fumarate hydratase-deficient tumours.This work was supported by the Medical Research Council (UK). S.F. was supported by a Herchel Smith Research Studentship and K.F. by an MRC Career Development Award. E.R.M is supported by the ERC Advanced Researcher award 323004–ONCOTREAT. P.H.M. is supported by Senior Investigator Awards from the Wellcome Trust and NIHR. The Cambridge Human Research Tissue Bank and A.W. are supported by the NIHR Cambridge Biomedical Research Centre.This is the author accepted manuscript. The final version is available from Nature Publishing at http://dx.doi.org/10.1038/nature19353

Solving Navigational Uncertainty Using Grid Cells on Robots

To successfully navigate their habitats, many mammals use a combination of two mechanisms, path integration and calibration using landmarks, which together enable them to estimate their location and orientation, or pose. In large natural environments, both these mechanisms are characterized by uncertainty: the path integration process is subject to the accumulation of error, while landmark calibration is limited by perceptual ambiguity. It remains unclear how animals form coherent spatial representations in the presence of such uncertainty. Navigation research using robots has determined that uncertainty can be effectively addressed by maintaining multiple probabilistic estimates of a robot's pose. Here we show how conjunctive grid cells in dorsocaudal medial entorhinal cortex (dMEC) may maintain multiple estimates of pose using a brain-based robot navigation system known as RatSLAM. Based both on rodent spatially-responsive cells and functional engineering principles, the cells at the core of the RatSLAM computational model have similar characteristics to rodent grid cells, which we demonstrate by replicating the seminal Moser experiments. We apply the RatSLAM model to a new experimental paradigm designed to examine the responses of a robot or animal in the presence of perceptual ambiguity. Our computational approach enables us to observe short-term population coding of multiple location hypotheses, a phenomenon which would not be easily observable in rodent recordings. We present behavioral and neural evidence demonstrating that the conjunctive grid cells maintain and propagate multiple estimates of pose, enabling the correct pose estimate to be resolved over time even without uniquely identifying cues. While recent research has focused on the grid-like firing characteristics, accuracy and representational capacity of grid cells, our results identify a possible critical and unique role for conjunctive grid cells in filtering sensory uncertainty. We anticipate our study to be a starting point for animal experiments that test navigation in perceptually ambiguous environments

Spontaneous Reorientation Is Guided by Perceived Surface Distance, Not by Image Matching Or Comparison

Humans and animals recover their sense of position and orientation using properties of the surface layout, but the processes underlying this ability are disputed. Although behavioral and neurophysiological experiments on animals long have suggested that reorientation depends on representations of surface distance, recent experiments on young children join experimental studies and computational models of animal navigation to suggest that reorientation depends either on processing of any continuous perceptual variables or on matching of 2D, depthless images of the landscape. We tested the surface distance hypothesis against these alternatives through studies of children, using environments whose 3D shape and 2D image properties were arranged to enhance or cancel impressions of depth. In the absence of training, children reoriented by subtle differences in perceived surface distance under conditions that challenge current models of 2D-image matching or comparison processes. We provide evidence that children’s spontaneous navigation depends on representations of 3D layout geometry.National Institutes of Health (U.S.) (Grant HD 23103

Modeling Boundary Vector Cell Firing Given Optic Flow as a Cue

Boundary vector cells in entorhinal cortex fire when a rat is in locations at a specific distance from walls of an environment. This firing may originate from memory of the barrier location combined with path integration, or the firing may depend upon the apparent visual input image stream. The modeling work presented here investigates the role of optic flow, the apparent change of patterns of light on the retina, as input for boundary vector cell firing. Analytical spherical flow is used by a template model to segment walls from the ground, to estimate self-motion and the distance and allocentric direction of walls, and to detect drop-offs. Distance estimates of walls in an empty circular or rectangular box have a mean error of less than or equal to two centimeters. Integrating these estimates into a visually driven boundary vector cell model leads to the firing patterns characteristic for boundary vector cells. This suggests that optic flow can influence the firing of boundary vector cells