A Review of Findings from Neuroscience and Cognitive Psychology as Possible Inspiration for the Path to Artificial General Intelligence

This review aims to contribute to the quest for artificial general intelligence by examining neuroscience and cognitive psychology methods for potential inspiration. Despite the impressive advancements achieved by deep learning models in various domains, they still have shortcomings in abstract reasoning and causal understanding. Such capabilities should be ultimately integrated into artificial intelligence systems in order to surpass data-driven limitations and support decision making in a way more similar to human intelligence. This work is a vertical review that attempts a wide-ranging exploration of brain function, spanning from lower-level biological neurons, spiking neural networks, and neuronal ensembles to higher-level concepts such as brain anatomy, vector symbolic architectures, cognitive and categorization models, and cognitive architectures. The hope is that these concepts may offer insights for solutions in artificial general intelligence.Comment: 143 pages, 49 figures, 244 reference

Predictive maps in rats and humans for spatial navigation

Much of our understanding of navigation comes from the study of individual species, often with specific tasks tailored to those species. Here, we provide a novel experimental and analytic framework integrating across humans, rats, and simulated reinforcement learning (RL) agents to interrogate the dynamics of behavior during spatial navigation. We developed a novel open-field navigation task ("Tartarus maze") requiring dynamic adaptation (shortcuts and detours) to frequently changing obstructions on the path to a hidden goal. Humans and rats were remarkably similar in their trajectories. Both species showed the greatest similarity to RL agents utilizing a "successor representation," which creates a predictive map. Humans also displayed trajectory features similar to model-based RL agents, which implemented an optimal tree-search planning procedure. Our results help refine models seeking to explain mammalian navigation in dynamic environments and highlight the utility of modeling the behavior of different species to uncover the shared mechanisms that support behavior

All-optical interrogation of neural circuits during behaviour

This thesis explores the fundamental question of how patterns of neural activity encode information and guide behaviour. To address this, one needs three things: a way to record neural activity so that one can correlate neuronal responses with environmental variables; a flexible and specific way to influence neural activity so that one can modulate the variables that may underlie how information is encoded; a robust behavioural paradigm that allows one to assess how modulation of both environmental and neural variables modify behaviour. Techniques combining all three would be transformative for investigating which features of neural activity, and which neurons, most influence behavioural output. Previous electrical and optogenetic microstimulation studies have told us much about the impact of spatially or genetically defined groups of neurons, however they lack the flexibility to probe the contribution of specific, functionally defined subsets. In this thesis I leverage a combination of existing technologies to approach this goal. I combine two-photon calcium imaging with two-photon optogenetics and digital holography to generate an “all-optical” method for simultaneous reading and writing of neural activity in vivo with high spatio-temporal resolution. Calcium imaging allows for cellular resolution recordings from neural populations. Two-photon optogenetics allows for targeted activation of individual cells. Digital holography, using spatial light modulators (SLMs), allows for simultaneous photostimulation of tens to hundreds of neurons in arbitrary spatial locations. Taken together, I demonstrate that this method allows one to map the functional signature of neurons in superficial mouse barrel cortex and to target photostimulation to functionally-defined subsets of cells. I develop a suite of software that allows for quick, intuitive execution of such experiments and I combine this with a behavioural paradigm testing the effect of targeted perturbations on behaviour. In doing so, I demonstrate that animals are able to reliably detect the targeted activation of tens of neurons, with some sensitive to as few as five cortical cells. I demonstrate that such learning can be specific to targeted cells, and that the lower bound of perception shifts with training. The temporal structure of such perturbations had little impact on behaviour, however different groups of neurons drive behaviour to different extents. In order to probe which characteristics underly such variation, I tested whether the sensory response strength or correlation structure of targeted ensembles influenced their behavioural salience. Whilst these final experiments were inconclusive, they demonstrate their feasibility and provide us with some key actionable improvements that could further strengthen the all-optical approach. This thesis therefore represents a significant step forward towards the goal of combining high resolution readout and perturbation of neural activity with behaviour in order to investigate which features of the neural code are behaviourally relevant

Neural plasticity in decision making and memory formation

Goal-directed behaviour is characterized by an ability to make inferences without direct experience. This requires a model of the environment and of ourselves, which is flexibly adjusted in light of new incoming information. This thesis uses representational functional magnetic resonance imaging (fMRI) techniques in combination with computational modelling to investigate (1) whether humans can construct models of other people’s preferences and whether this process influences their own value representation, and (2) how statistical relationships between discrete, non-spatial objects are combined into a model of the world. The first part of the thesis investigates how subjective values are computed in an intertemporal choice paradigm, and how these value computations are updated as a consequence of learning about the preferences of another. Critically, subjects’ own preferences shift towards those of the other when learning about their choices, suggesting that subjects incorporate new knowledge about others into a model of their own preferences. The underlying mechanism involves prediction errors, which introduce plasticity into subjects’ mPFC value representations, in turn resulting in a shift in subjects’ own preferences. The second part of this thesis investigates how relationships between arbitrary objects are represented in the brain. Relational knowledge is often considered analogous to spatial reasoning, where relationships are encoded in a hippocampal-entorhinal ‘cognitive map’. Here, I show that maps can also be extracted from the entorhinal cortex for discrete relationships between arbitrary stimuli, and in the absence of conscious knowledge. The representation of abstract knowledge in map-like structures suggests that inferences do not need to rely on direct experiences but can be computed anew from mapped knowledge. Together, these studies reveal how world models are represented and updated at the level of neural representations, providing a bridge between representational codes and cognitive computations

Modelling human choices: MADeM and decision‑making

Research supported by FAPESP 2015/50122-0 and DFG-GRTK 1740/2. RP and AR are also part of the Research, Innovation and Dissemination Center for Neuromathematics FAPESP grant (2013/07699-0). RP is supported by a FAPESP scholarship (2013/25667-8). ACR is partially supported by a CNPq fellowship (grant 306251/2014-0)

Micro-, Meso- and Macro-Dynamics of the Brain

Neurosciences, Neurology, Psychiatr

25th Annual Computational Neuroscience Meeting: CNS-2016

Abstracts of the 25th Annual Computational Neuroscience Meeting: CNS-2016 Seogwipo City, Jeju-do, South Korea. 2–7 July 201