Signal Propagation in Feedforward Neuronal Networks with Unreliable Synapses

In this paper, we systematically investigate both the synfire propagation and firing rate propagation in feedforward neuronal network coupled in an all-to-all fashion. In contrast to most earlier work, where only reliable synaptic connections are considered, we mainly examine the effects of unreliable synapses on both types of neural activity propagation in this work. We first study networks composed of purely excitatory neurons. Our results show that both the successful transmission probability and excitatory synaptic strength largely influence the propagation of these two types of neural activities, and better tuning of these synaptic parameters makes the considered network support stable signal propagation. It is also found that noise has significant but different impacts on these two types of propagation. The additive Gaussian white noise has the tendency to reduce the precision of the synfire activity, whereas noise with appropriate intensity can enhance the performance of firing rate propagation. Further simulations indicate that the propagation dynamics of the considered neuronal network is not simply determined by the average amount of received neurotransmitter for each neuron in a time instant, but also largely influenced by the stochastic effect of neurotransmitter release. Second, we compare our results with those obtained in corresponding feedforward neuronal networks connected with reliable synapses but in a random coupling fashion. We confirm that some differences can be observed in these two different feedforward neuronal network models. Finally, we study the signal propagation in feedforward neuronal networks consisting of both excitatory and inhibitory neurons, and demonstrate that inhibition also plays an important role in signal propagation in the considered networks.Comment: 33pages, 16 figures; Journal of Computational Neuroscience (published

A biologically inspired spiking model of visual processing for image feature detection

To enable fast reliable feature matching or tracking in scenes, features need to be discrete and meaningful, and hence edge or corner features, commonly called interest points are often used for this purpose. Experimental research has illustrated that biological vision systems use neuronal circuits to extract particular features such as edges or corners from visual scenes. Inspired by this biological behaviour, this paper proposes a biologically inspired spiking neural network for the purpose of image feature extraction. Standard digital images are processed and converted to spikes in a manner similar to the processing that transforms light into spikes in the retina. Using a hierarchical spiking network, various types of biologically inspired receptive fields are used to extract progressively complex image features. The performance of the network is assessed by examining the repeatability of extracted features with visual results presented using both synthetic and real images

The importance of space and time in neuromorphic cognitive agents

Artificial neural networks and computational neuroscience models have made tremendous progress, allowing computers to achieve impressive results in artificial intelligence (AI) applications, such as image recognition, natural language processing, or autonomous driving. Despite this remarkable progress, biological neural systems consume orders of magnitude less energy than today's artificial neural networks and are much more agile and adaptive. This efficiency and adaptivity gap is partially explained by the computing substrate of biological neural processing systems that is fundamentally different from the way today's computers are built. Biological systems use in-memory computing elements operating in a massively parallel way rather than time-multiplexed computing units that are reused in a sequential fashion. Moreover, activity of biological neurons follows continuous-time dynamics in real, physical time, instead of operating on discrete temporal cycles abstracted away from real-time. Here, we present neuromorphic processing devices that emulate the biological style of processing by using parallel instances of mixed-signal analog/digital circuits that operate in real time. We argue that this approach brings significant advantages in efficiency of computation. We show examples of embodied neuromorphic agents that use such devices to interact with the environment and exhibit autonomous learning

How Structure Determines Correlations in Neuronal Networks

Networks are becoming a ubiquitous metaphor for the understanding of complex biological systems, spanning the range between molecular signalling pathways, neural networks in the brain, and interacting species in a food web. In many models, we face an intricate interplay between the topology of the network and the dynamics of the system, which is generally very hard to disentangle. A dynamical feature that has been subject of intense research in various fields are correlations between the noisy activity of nodes in a network. We consider a class of systems, where discrete signals are sent along the links of the network. Such systems are of particular relevance in neuroscience, because they provide models for networks of neurons that use action potentials for communication. We study correlations in dynamic networks with arbitrary topology, assuming linear pulse coupling. With our novel approach, we are able to understand in detail how specific structural motifs affect pairwise correlations. Based on a power series decomposition of the covariance matrix, we describe the conditions under which very indirect interactions will have a pronounced effect on correlations and population dynamics. In random networks, we find that indirect interactions may lead to a broad distribution of activation levels with low average but highly variable correlations. This phenomenon is even more pronounced in networks with distance dependent connectivity. In contrast, networks with highly connected hubs or patchy connections often exhibit strong average correlations. Our results are particularly relevant in view of new experimental techniques that enable the parallel recording of spiking activity from a large number of neurons, an appropriate interpretation of which is hampered by the currently limited understanding of structure-dynamics relations in complex networks

Functional integration in the cortical neuronal network of conscious and anesthetized animals

General anesthesia consists of amnesia, analgesia, areflexia and unconsciousness. How anesthetics suppress consciousness has been a mystery for more than one and a half centuries. The overall goal of my research has been to determine the neural correlates of anesthetic-induced loss of consciousness. I hypothesized that anesthetics induce unconsciousness by interfering with the functional connectivity of neuronal networks of the brain and consequently, reducing the brain\u27s capacity for information processing. To test this hypothesis, I performed experiments in which neuronal spiking activity was measured with chronically implanted microelectrode arrays in the visual cortex of freely-moving rats during wakefulness and at graded levels of anesthesia produced by the inhalational anesthetic agent desflurane. I then applied linear and non-parametric information-theoretic analyses to quantify the concentration-dependent effect of general anesthetics on spontaneous and visually evoked spike firing activity in rat primary visual cortex. Results suggest that desflurane anesthesia disrupts cortical neuronal integration as measured by monosynaptic connectivity, spike burst coherence and information capacity. This research furthers our understanding of the mechanisms involved with the anesthetic-induced LOC which may facilitate in the development of better anesthetic monitoring devices and the creation of effective anesthetic agents that will be free of unwanted side effects

Models of spatial representation in the medial entorhinal cortex

Komplexe kognitive Funktionen wie Gedächtnisbildung, Navigation und Entscheidungsprozesse hängen von der Kommunikation zwischen Hippocampus und Neokortex ab. An der Schnittstelle dieser beiden Gehirnregionen liegt der entorhinale Kortex - ein Areal, das Neurone mit bemerkenswerten räumlichen Repräsentationen enthält: Gitterzellen. Gitterzellen sind Neurone, die abhängig von der Position eines Tieres in seiner Umgebung feuern und deren Feuerfelder ein dreieckiges Muster bilden. Man vermutet, dass Gitterzellen Navigation und räumliches Gedächtnis unterstützen, aber die Mechanismen, die diese Muster erzeugen, sind noch immer unbekannt. In dieser Dissertation untersuche ich mathematische Modelle neuronaler Schaltkreise, um die Entstehung, Weitervererbung und Verstärkung von Gitterzellaktivität zu erklären. Zuerst konzentriere ich mich auf die Entstehung von Gittermustern. Ich folge der Idee, dass periodische Repräsentationen des Raumes durch Konkurrenz zwischen dauerhaft aktiven, räumlichen Inputs und der Tendenz eines Neurons, durchgängiges Feuern zu vermeiden, entstehen könnten. Aufbauend auf vorangegangenen theoretischen Arbeiten stelle ich ein Einzelzell-Modell vor, das gitterartige Aktivität allein durch räumlich-irreguläre Inputs, Feuerratenadaptation und Hebbsche synaptische Plastizität erzeugt. Im zweiten Teil der Dissertation untersuche ich den Einfluss von Netzwerkdynamik auf das Gitter-Tuning. Ich zeige, dass Gittermuster zwischen neuronalen Populationen weitervererbt werden können und dass sowohl vorwärts gerichtete als auch rekurrente Verbindungen die Regelmäßigkeit von räumlichen Feuermustern verbessern können. Schließlich zeige ich, dass eine entsprechende Konnektivität, die diese Funktionen unterstützt, auf unüberwachte Weise entstehen könnte. Insgesamt trägt diese Arbeit zu einem besseren Verständnis der Prinzipien der neuronalen Repräsentation des Raumes im medialen entorhinalen Kortex bei.High-level cognitive abilities such as memory, navigation, and decision making rely on the communication between the hippocampal formation and the neocortex. At the interface between these two brain regions is the entorhinal cortex, a multimodal association area where neurons with remarkable representations of self-location have been discovered: the grid cells. Grid cells are neurons that fire according to the position of an animal in its environment and whose firing fields form a periodic triangular pattern. Grid cells are thought to support animal's navigation and spatial memory, but the cellular mechanisms that generate their tuning are still unknown. In this thesis, I study computational models of neural circuits to explain the emergence, inheritance, and amplification of grid-cell activity. In the first part of the thesis, I focus on the initial formation of grid-cell tuning. I embrace the idea that periodic representations of space could emerge via a competition between persistently-active spatial inputs and the reluctance of a neuron to fire for long stretches of time. Building upon previous theoretical work, I propose a single-cell model that generates grid-like activity solely form spatially-irregular inputs, spike-rate adaptation, and Hebbian synaptic plasticity. In the second part of the thesis, I study the inheritance and amplification of grid-cell activity. Motivated by the architecture of entorhinal microcircuits, I investigate how feed-forward and recurrent connections affect grid-cell tuning. I show that grids can be inherited across neuronal populations, and that both feed-forward and recurrent connections can improve the regularity of spatial firing. Finally, I show that a connectivity supporting these functions could self-organize in an unsupervised manner. Altogether, this thesis contributes to a better understanding of the principles governing the neuronal representation of space in the medial entorhinal cortex

Unified developmental model of maps, complex cells and surround modulation in the primary visual cortex

For human and animal vision, the perception of local visual features can depend on the spatial arrangement of the surrounding visual stimuli. In the earliest stages of visual processing this phenomenon is called surround modulation, where the response of visually selective neurons is influenced by the response of neighboring neurons. Surround modulation has been implicated in numerous important perceptual phenomena, such as contour integration and figure-ground segregation. In cats, one of the major potential neural substrates for surround modulation are lateral connections between cortical neurons in layer 2/3, which typically contains ”complex” cells that appear to combine responses from ”simple” cells in layer 4C. Interestingly, these lateral connections have also been implicated in the development of functional maps in primary visual cortex, such as smooth, well-organized maps for the preference of oriented lines. Together, this evidence suggests a common underlying substrate the lateral interactions in layer 2/3—as the driving force behind development of orientation maps for both simple and complex cells, and at the same time expression of surround modulation in adult animals. However, previously these phenomena have been studied largely in isolation, and we are not aware of a computational model that can account for all of them simultaneously and show how they are related. In this thesis we resolve this problem by building a single, unified computational model that can explain the development of orientation maps, the development of simple and complex cells, and surround modulation. First we build a simple, single-layer model of orientation map development based on ALISSOM, which has more realistic single cell properties (such as contrast gain control and contrast invariant orientation tuning) than its predecessor. Then we extend this model by adding layer 2/3, and show how the model can explain development of orientation maps of both simple and complex cells. As the last step towards a developmental model of surround modulation, we replace Mexican-hat-like lateral connectivity in layer 2/3 of the model with a more realistic configuration based on long-range excitation and short-range inhibitory cells, extending a simpler model by Judith Law. The resulting unified model of V1 explains how orientation maps of simple and complex cells can develop, while individual neurons in the developed model express realistic orientation tuning and various surround modulation properties. In doing so, we not only offer a consistent explanation behind all these phenomena, but also create a very rich model of V1 in which the interactions between various V1 properties can be studied. The model allows us to formulate several novel predictions that relate the variation of single cell properties to their location in the orientation preference maps in V1, and we show how these predictions can be tested experimentally. Overall, this model represents a synthesis of a wide body of experimental evidence, forming a compact hypothesis for much of the development and behavior of neurons in the visual cortex