Improving Associative Memory in a Network of Spiking Neurons

In this thesis we use computational neural network models to examine the dynamics and functionality of the CA3 region of the mammalian hippocampus. The emphasis of the project is to investigate how the dynamic control structures provided by inhibitory circuitry and cellular modification may effect the CA3 region during the recall of previously stored information. The CA3 region is commonly thought to work as a recurrent auto-associative neural network due to the neurophysiological characteristics found, such as, recurrent collaterals, strong and sparse synapses from external inputs and plasticity between coactive cells. Associative memory models have been developed using various configurations of mathematical artificial neural networks which were first developed over 40 years ago. Within these models we can store information via changes in the strength of connections between simplified model neurons (two-state). These memories can be recalled when a cue (noisy or partial) is instantiated upon the net. The type of information they can store is quite limited due to restrictions caused by the simplicity of the hard-limiting nodes which are commonly associated with a binary activation threshold. We build a much more biologically plausible model with complex spiking cell models and with realistic synaptic properties between cells. This model is based upon some of the many details we now know of the neuronal circuitry of the CA3 region. We implemented the model in computer software using Neuron and Matlab and tested it by running simulations of storage and recall in the network. By building this model we gain new insights into how different types of neurons, and the complex circuits they form, actually work. The mammalian brain consists of complex resistive-capacative electrical circuitry which is formed by the interconnection of large numbers of neurons. A principal cell type is the pyramidal cell within the cortex, which is the main information processor in our neural networks. Pyramidal cells are surrounded by diverse populations of interneurons which have proportionally smaller numbers compared to the pyramidal cells and these form connections with pyramidal cells and other inhibitory cells. By building detailed computational models of recurrent neural circuitry we explore how these microcircuits of interneurons control the flow of information through pyramidal cells and regulate the efficacy of the network. We also explore the effect of cellular modification due to neuronal activity and the effect of incorporating spatially dependent connectivity on the network during recall of previously stored information. In particular we implement a spiking neural network proposed by Sommer and Wennekers (2001). We consider methods for improving associative memory recall using methods inspired by the work by Graham and Willshaw (1995) where they apply mathematical transforms to an artificial neural network to improve the recall quality within the network. The networks tested contain either 100 or 1000 pyramidal cells with 10% connectivity applied and a partial cue instantiated, and with a global pseudo-inhibition.We investigate three methods. Firstly, applying localised disynaptic inhibition which will proportionalise the excitatory post synaptic potentials and provide a fast acting reversal potential which should help to reduce the variability in signal propagation between cells and provide further inhibition to help synchronise the network activity. Secondly, implementing a persistent sodium channel to the cell body which will act to non-linearise the activation threshold where after a given membrane potential the amplitude of the excitatory postsynaptic potential (EPSP) is boosted to push cells which receive slightly more excitation (most likely high units) over the firing threshold. Finally, implementing spatial characteristics of the dendritic tree will allow a greater probability of a modified synapse existing after 10% random connectivity has been applied throughout the network. We apply spatial characteristics by scaling the conductance weights of excitatory synapses which simulate the loss in potential in synapses found in the outer dendritic regions due to increased resistance. To further increase the biological plausibility of the network we remove the pseudo-inhibition and apply realistic basket cell models with differing configurations for a global inhibitory circuit. The networks are configured with; 1 single basket cell providing feedback inhibition, 10% basket cells providing feedback inhibition where 10 pyramidal cells connect to each basket cell and finally, 100% basket cells providing feedback inhibition. These networks are compared and contrasted for efficacy on recall quality and the effect on the network behaviour. We have found promising results from applying biologically plausible recall strategies and network configurations which suggests the role of inhibition and cellular dynamics are pivotal in learning and memory

Learning Mechanisms to account for the Speed, Selectivity and Invariance of Responses in the visual Cortex

Dans cette thèse je propose plusieurs mécanismes de plasticité synaptique qui pourraient expliquer la rapidité, la sélectivité et l'invariance des réponses neuronales dans le cortex visuel. Leur plausibilité biologique est discutée. J'expose également les résultats d'une expérience de psychophysique pertinente, qui montrent que la familiarité peut accélérer les traitements visuels. Au delà de ces résultats propres au système visuel, les travaux présentés ici créditent l'hypothèse de l'utilisation des dates de spikes pour encoder, décoder, et traiter l'information dans le cerveau - c'est la théorie dite du 'codage temporel'. Dans un tel cadre, la Spike Timing Dependent Plasticity pourrait jouer un rôle clef, en détectant des patterns de spikes répétitifs et en permettant d'y répondre de plus en plus rapidement.In this thesis I propose various activity-driven synaptic plasticity mechanisms that could account for the speed, selectivity and invariance of the neuronal responses in the visual cortex. Their biological plausibility is discussed. I also present the results of a relevant psychophysical experiment demonstrating that familiarity can accelerate visual processing. Beyond these results on the visual system, the studies presented here also credit the hypothesis that the brain uses the spike times to encode, decode, and process information - a theory referred to as 'temporal coding'. In such a framework the Spike Timing Dependent Plasticity may play a key role, by detecting repeating spike patterns and by generating faster and faster responses to those patterns

Biologically Plausible Cortical Hierarchical-Classifier Circuit Extensions in Spiking Neurons

Hierarchical categorization inter-leaved with sequence recognition of incoming stimuli in the mammalian brain is theorized to be performed by circuits composed of the thalamus and the six-layer cortex. Using these circuits, the cortex is thought to learn a ‘brain grammar’ composed of recursive sequences of categories. A thalamo-cortical, hierarchical classification and sequence learning “Core” circuit implemented as a linear matrix simulation and was published by Rodriguez, Whitson & Granger in 2004. In the brain, these functions are implemented by cortical and thalamic circuits composed of recurrently-connected, spiking neurons. The Neural Engineering Framework (NEF) (Eliasmith & Anderson, 2003) allows for the construction of large-scale biologically plausible neural networks. Existing NEF models of the basal-ganglia and the thalamus exist but to the best of our knowledge there does not exist an integrated, spiking-neuron, cortical-thalamic-Core network model. We construct a more biologically-plausible version of the hierarchical-classification function of the Core circuit using leaky-integrate-and-fire neurons which performs progressive visual classification of static image sequences relying on the neural activity levels to trigger the progressive classification of the stimulus. We proceed by implementing a recurrent NEF model of the cortical-thalamic Core circuit and then test the resulting model on the hierarchical categorization of images

Oscillatory architecture of memory circuits

The coordinated activity between remote brain regions underlies cognition and memory function. Although neuronal oscillations have been proposed as a mechanistic substrate for the coordination of information transfer and memory consolidation during sleep, little is known about the mechanisms that support the widespread synchronization of brain regions and the relationship of neuronal dynamics with other bodily rhythms, such as breathing. During exploratory behavior, the hippocampus and the prefrontal cortex are organized by theta oscillations, known to support memory encoding and retrieval, while during sleep the same structures are dominated by slow oscillations that are believed to underlie the consolidation of recent experiences. The expression of conditioned fear and extinction memories relies on the coordinated activity between the mPFC and the basolateral amygdala (BLA), a neuronal structure encoding associative fear memories. However, to date, the mechanisms allowing this long-range network synchronization of neuronal activity between the mPFC and BLA during fear behavior remain virtually unknown. Using a combination of extracellular recordings and open- and closed-loop optogenetic manipulations, we investigated the oscillatory and coding mechanisms mediating the organization and coupling of the limbic circuit in the awake and asleep brain, as well as during memory encoding and retrieval. We found that freezing, a behavioral expression of fear, is tightly associated with an internally generated brain state that manifests in sustained 4Hz oscillatory dynamics in prefrontal-amygdala circuits. 4Hz oscillations accurately predict the onset and termination of the freezing state. These oscillations synchronize prefrontal-amygdala circuits and entrain neuronal activity to dynamically regulate the development of neuronal ensembles. This enables the precise timing of information transfer between the two structures and the expression of fear responses. Optogenetic induction of prefrontal 4Hz oscillations promotes freezing behavior and the formation of long-lasting fear memory, while closed-loop phase specific manipulations bidirectionally modulate fear expression. Our results unravel a physiological signature of fear memory and identify a novel internally generated brain state, characterized by 4Hz oscillations. This oscillation enables the temporal coordination and information transfer in the prefrontal-amygdala circuit via a phase-specific coding mechanism, facilitating the encoding and expression of fear memory. In the search for the origin of this oscillation, we focused our attention on breathing, the most fundamental and ubiquitous rhythmic activity in life. Using large-scale extracellular recordings from a number of structures, including the medial prefrontal cortex, hippocampus, thalamus, amygdala and nucleus accumbens in mice we identified and characterized the entrainment by breathing of a host of network dynamics across the limbic circuit. We established that fear-related 4Hz oscillations are a state-specific manifestation of this cortical entrainment by the respiratory rhythm. We characterized the translaminar and transregional profile of this entrainment and demonstrated a causal role of breathing in synchronizing neuronal activity and network dynamics between these structures in a variety of behavioral scenarios in the awake and sleep state. We further revealed a dual mechanism of respiratory entrainment, in the form of an intracerebral corollary discharge that acts jointly with an olfactory reafference to coordinate limbic network dynamics, such as hippocampal ripples and cortical UP and DOWN states, involved in memory consolidation. Respiration provides a perennial stream of rhythmic input to the brain. In addition to its role as the condicio sine qua non for life, here we provide evidence that breathing rhythm acts as a global pacemaker for the brain, providing a reference signal that enables the integration of exteroceptive and interoceptive inputs with the internally generated dynamics of the hippocampus and the neocortex. Our results highlight breathing, a perennial rhythmic input to the brain, as an oscillatory scaffold for the functional coordination of the limbic circuit, enabling the segregation and integration of information flow across neuronal networks

On microelectronic self-learning cognitive chip systems

After a brief review of machine learning techniques and applications, this Ph.D. thesis examines several approaches for implementing machine learning architectures and algorithms into hardware within our laboratory. From this interdisciplinary background support, we have motivations for novel approaches that we intend to follow as an objective of innovative hardware implementations of dynamically self-reconfigurable logic for enhanced self-adaptive, self-(re)organizing and eventually self-assembling machine learning systems, while developing this new particular area of research. And after reviewing some relevant background of robotic control methods followed by most recent advanced cognitive controllers, this Ph.D. thesis suggests that amongst many well-known ways of designing operational technologies, the design methodologies of those leading-edge high-tech devices such as cognitive chips that may well lead to intelligent machines exhibiting conscious phenomena should crucially be restricted to extremely well defined constraints. Roboticists also need those as specifications to help decide upfront on otherwise infinitely free hardware/software design details. In addition and most importantly, we propose these specifications as methodological guidelines tightly related to ethics and the nowadays well-identified workings of the human body and of its psyche

Activation of the pro-resolving receptor Fpr2 attenuates inflammatory microglial activation

Poster number: P-T099 Theme: Neurodegenerative disorders & ageing Activation of the pro-resolving receptor Fpr2 reverses inflammatory microglial activation Authors: Edward S Wickstead - Life Science & Technology University of Westminster/Queen Mary University of London Inflammation is a major contributor to many neurodegenerative disease (Heneka et al. 2015). Microglia, as the resident immune cells of the brain and spinal cord, provide the first line of immunological defence, but can become deleterious when chronically activated, triggering extensive neuronal damage (Cunningham, 2013). Dampening or even reversing this activation may provide neuronal protection against chronic inflammatory damage. The aim of this study was to determine whether lipopolysaccharide (LPS)-induced inflammation could be abrogated through activation of the receptor Fpr2, known to play an important role in peripheral inflammatory resolution. Immortalised murine microglia (BV2 cell line) were stimulated with LPS (50ng/ml) for 1 hour prior to the treatment with one of two Fpr2 ligands, either Cpd43 or Quin-C1 (both 100nM), and production of nitric oxide (NO), tumour necrosis factor alpha (TNFα) and interleukin-10 (IL-10) were monitored after 24h and 48h. Treatment with either Fpr2 ligand significantly suppressed LPS-induced production of NO or TNFα after both 24h and 48h exposure, moreover Fpr2 ligand treatment significantly enhanced production of IL-10 48h post-LPS treatment. As we have previously shown Fpr2 to be coupled to a number of intracellular signaling pathways (Cooray et al. 2013), we investigated potential signaling responses. Western blot analysis revealed no activation of ERK1/2, but identified a rapid and potent activation of p38 MAP kinase in BV2 microglia following stimulation with Fpr2 ligands. Together, these data indicate the possibility of exploiting immunomodulatory strategies for the treatment of neurological diseases, and highlight in particular the important potential of resolution mechanisms as novel therapeutic targets in neuroinflammation. References Cooray SN et al. (2013). Proc Natl Acad Sci U S A 110: 18232-7. Cunningham C (2013). Glia 61: 71-90. Heneka MT et al. (2015). Lancet Neurol 14: 388-40

In vivo electrophysiology in humans reveals neural codes for space and memory

Memory serves an integral function in every aspect of human life. Losing that function can be adevastating consequence of disease, dementia, and trauma. In order to develop treatments or prophylactics for memory disorders we must identify the neural basis of memory. Animal research has made prominent strides studying the neural correlates of memory by examining the more easily observable and manipulable neural correlates of spatial context, since the brain regions necessary for declarative memory intersect profoundly with those needed for spatial navigation. My research has two main goals. My first two studies, in Chapters 2 and 3, translate animal research relating the neural correlates of space to memory processes, and go beyond animal work to explore how internal features of experience such as goal states influence these conjunctive representations of space and memory. In Chapter 4, I expand my scope to examine how another internal feature, emotional context, affects the same brain regions on a network level to influence memory representations in the human brain. To perform these studies I recorded directly from the human brain in epilepsy patients performing a variety of memory tasks. First, I measured single-neuron activity as subjects navigated a virtual environment, encountering various objects at unique locations. As subjects moved through the environments, they were instructed to recall the locations of specific objects they encountered—I identified neurons in the human entorhinal cortex, called “memory-trace cells”, which selectively activated near the object-location that people were instructed to retrieve from memory. This is the first evidence that neurons in the brain can be tuned to the spatial context of an event for memory, and demonstrated a direct link between memory retrieval and the spatial tuning properties of neurons. For my second study, I examined whether spatially-tuned neurons in the MTL discharge at intervals organized by theta (2–10 Hz) oscillations (which represent network level brain-activity). I identified a particular pattern that is prominent in rodents, called “phase precession”, during which spatially-tuned neurons spike slightly faster than the network oscillation, and which is theorized to hold great value throughout the brain for learning and memory. In addition to discovering this pattern for spatial sequences, I discovered that phase precession was also present during more abstract features of experience, like the specific goal a person was seeking. These findings suggest that principles of network-level brain activity for organizing spatial navigation may extend to humans, and to broader forms of cognition and memory. Finally, I examined the role of the amygdala in memory encoding during a verbal episodic memory task, finding that the emotional context of a word influenced the probability of its subsequent recall. By measuring the prevalence and coordination of brain oscillations in the amygdala-hippocampal circuit, I found that gamma oscillations (30–120 Hz) increased in both regions as a function of word arousal and encoding success, and connectivity within the amygdala-hippocampal circuit also showed significant theta-gamma coupling as a function of memory and high arousal. Furthermore, direct 50 Hz stimulation impaired memory for high arousal words. These findings suggest a causal relationship between gamma oscillations in the amygdala-hippocampal circuit for memory as a function of emotional context during encoding. My work generalizes important neuronal principles from animal studies to humans (such as spatially-tuned neurons and phase precession), but also extends those findings more deeply to memory, and to internal/subjective aspects of memory that are difficult to directly measure in animals. Overall this work represents an important step towards understanding how the human brain enables declarative memory

Memory stability and synaptic plasticity

Numerous experiments have demonstrated that the activity of neurons can alter the strength of excitatory synapses. This synaptic plasticity is bidirectional and synapses can be strengthened (potentiation) or weakened (depression). Synaptic plasticity offers a mechanism that links the ongoing activity of the brain with persistent physical changes to its structure. For this reason it is widely believed that synaptic plasticity mediates learning and memory. The hypothesis that synapses store memories by modifying their strengths raises an important issue. There should be a balance between the necessity that synapses change frequently, allowing new memories to be stored with high fidelity, and the necessity that synapses retain previously stored information. This is the plasticity stability dilemma. In this thesis the plasticity stability dilemma is studied in the context of the two dominant paradigms of activity dependent synaptic plasticity: Spike timing dependent plasticity (STDP) and long term potentiation and depression (LTP/D). Models of biological synapses are analysed and processes that might ameliorate the plasticity stability dilemma are identified. Two popular existing models of STDP are compared. Through this comparison it is demonstrated that the synaptic weight dynamics of STDP has a large impact upon the retention time of correlation between the weights of a single neuron and a memory. In networks it is shown that lateral inhibition stabilises the synaptic weights and receptive fields. To analyse LTP a novel model of LTP/D is proposed. The model centres on the distinction between early LTP/D, when synaptic modifications are persistent on a short timescale, and late LTP/D when synaptic modifications are persistent on a long timescale. In the context of the hippocampus it is proposed that early LTP/D allows the rapid and continuous storage of short lasting memory traces over a long lasting trace established with late LTP/D. It is shown that this might confer a longer memory retention time than in a system with only one phase of LTP/D. Experimental predictions about the dynamics of amnesia based upon this model are proposed. Synaptic tagging is a phenomenon whereby early LTP can be converted into late LTP, by subsequent induction of late LTP in a separate but nearby input. Synaptic tagging is incorporated into the LTP/D framework. Using this model it is demonstrated that synaptic tagging could lead to the conversion of a short lasting memory trace into a longer lasting trace. It is proposed that this allows the rescue of memory traces that were initially destined for complete decay. When combined with early and late LTP/D iii synaptic tagging might allow the management of hippocampal memory traces, such that not all memories must be stored on the longest, most stable late phase timescale. This lessens the plasticity stability dilemma in the hippocampus, where it has been hypothesised that memory traces must be frequently and vividly formed, but that not all traces demand eventual consolidation at the systems level