Neuronal Synchronization Can Control the Energy Efficiency of Inter-Spike Interval Coding

The role of synchronous firing in sensory coding and cognition remains controversial. While studies, focusing on its mechanistic consequences in attentional tasks, suggest that synchronization dynamically boosts sensory processing, others failed to find significant synchronization levels in such tasks. We attempt to understand both lines of evidence within a coherent theoretical framework. We conceptualize synchronization as an independent control parameter to study how the postsynaptic neuron transmits the average firing activity of a presynaptic population, in the presence of synchronization. We apply the Berger-Levy theory of energy efficient information transmission to interpret simulations of a Hodgkin-Huxley-type postsynaptic neuron model, where we varied the firing rate and synchronization level in the presynaptic population independently. We find that for a fixed presynaptic firing rate the simulated postsynaptic interspike interval distribution depends on the synchronization level and is well-described by a generalized extreme value distribution. For synchronization levels of 15% to 50%, we find that the optimal distribution of presynaptic firing rate, maximizing the mutual information per unit cost, is maximized at ~30% synchronization level. These results suggest that the statistics and energy efficiency of neuronal communication channels, through which the input rate is communicated, can be dynamically adapted by the synchronization level.Comment: 47 pages, 14 figures, 2 Table

Sum Rate of MISO Neuro-Spike Communication Channel With Constant Spiking Threshold.

Communication among neurons, known as neuro-spike communication, is the most promising technique for realization of a bio-inspired nanoscale communication paradigm to achieve biocompatible nanonetworks. In neuro-spike communication, the information, encoded into spike trains, is communicated to various brain regions through neuronal network. An output neuron needs to receive signal from multiple input neurons to generate a spike. Hence, in this paper, we aim to quantify the information transmitted through the multiple-input single-output (MISO) neuro-spike communication channel by considering models for axonal propagation, synaptic transmission, and spike generation. Moreover, the spike generation and propagation in each neuron requires opening and closing of numerous ionic channels on the cell membrane, which consumes considerable amount of ATP molecules called metabolic energy. Thus, we evaluate how applying a constraint on available metabolic energy affects the maximum achievable mutual information of this system. To this aim, we derive a closed form equation for the sum rate of the MISO neuro-spike communication channel and analyze it under the metabolic cost constraints. Finally, we discuss the impacts of changes in number of pre-synaptic neurons on the achievable rate and quantify the tradeoff between maximum achievable sum rate and the consumed metabolic energy

Sum rate analysis of multiple-access neuro-spike communication channel with dynamic spiking threshold

© 2019 Elsevier B.V. The information from outside world is encoded into spikes by the sensory neurons. These spikes are further propagated to different brain regions through various neural pathways. In the cortical region, each neuron receives inputs from multiple neurons that change its membrane potential. If the accumulated change in the membrane potential is more than a threshold value, a spike is generated. According to various studies in neuroscience, this spiking threshold adapts with time depending on the previous spike. This causes short-term changes in the neural responses giving rise to short-term plasticity. Therefore, in this paper, we analyze a multiple-input single-output (MISO) neuro-spike communication channel and study the effects of dynamic spiking threshold on mutual information and maximum achievable sum rate of the channel. Since spike generation consumes a generous portion of the metabolic energy provided to the brain, we further put metabolic constraint in calculating the mutual information and find a trade-off between maximum achievable sum rate and metabolic energy consumed. Moreover, we analyze three types of neurons present in the cortical region, i.e., Regular spiking, Intrinsic bursting and Fast spiking neurons. We aim to characterize these neurons in terms of encoding/transmission rates and energy expenditure. It will provide a guideline for the practical implementation of bio-inspired nanonetworks as well as for the development of ICT-based diagnosis and treatment techniques for neural diseases.This work was supported in part by European Research Council (ERC) under grant ERC-2013-CoG 616922 (Project MINERVA) and ERC-2017-PoC 780645 (ERC Proof of Concept project MINRGRACE)

Principles of Neuromorphic Photonics

In an age overrun with information, the ability to process reams of data has become crucial. The demand for data will continue to grow as smart gadgets multiply and become increasingly integrated into our daily lives. Next-generation industries in artificial intelligence services and high-performance computing are so far supported by microelectronic platforms. These data-intensive enterprises rely on continual improvements in hardware. Their prospects are running up against a stark reality: conventional one-size-fits-all solutions offered by digital electronics can no longer satisfy this need, as Moore's law (exponential hardware scaling), interconnection density, and the von Neumann architecture reach their limits. With its superior speed and reconfigurability, analog photonics can provide some relief to these problems; however, complex applications of analog photonics have remained largely unexplored due to the absence of a robust photonic integration industry. Recently, the landscape for commercially-manufacturable photonic chips has been changing rapidly and now promises to achieve economies of scale previously enjoyed solely by microelectronics. The scientific community has set out to build bridges between the domains of photonic device physics and neural networks, giving rise to the field of \emph{neuromorphic photonics}. This article reviews the recent progress in integrated neuromorphic photonics. We provide an overview of neuromorphic computing, discuss the associated technology (microelectronic and photonic) platforms and compare their metric performance. We discuss photonic neural network approaches and challenges for integrated neuromorphic photonic processors while providing an in-depth description of photonic neurons and a candidate interconnection architecture. We conclude with a future outlook of neuro-inspired photonic processing.Comment: 28 pages, 19 figure

Memory and information processing in neuromorphic systems

A striking difference between brain-inspired neuromorphic processors and current von Neumann processors architectures is the way in which memory and processing is organized. As Information and Communication Technologies continue to address the need for increased computational power through the increase of cores within a digital processor, neuromorphic engineers and scientists can complement this need by building processor architectures where memory is distributed with the processing. In this paper we present a survey of brain-inspired processor architectures that support models of cortical networks and deep neural networks. These architectures range from serial clocked implementations of multi-neuron systems to massively parallel asynchronous ones and from purely digital systems to mixed analog/digital systems which implement more biological-like models of neurons and synapses together with a suite of adaptation and learning mechanisms analogous to the ones found in biological nervous systems. We describe the advantages of the different approaches being pursued and present the challenges that need to be addressed for building artificial neural processing systems that can display the richness of behaviors seen in biological systems.Comment: Submitted to Proceedings of IEEE, review of recently proposed neuromorphic computing platforms and system

Synaptic Transmission: An Information-Theoretic Perspective

Here we analyze synaptic transmission from an information-theoretic perspective. We derive closed-form expressions for the lower-bounds on the capacity of a simple model of a cortical synapse under two explicit coding paradigms. Under the ``signal estimation'' paradigm, we assume the signal to be encoded in the mean firing rate of a Poisson neuron. The performance of an optimal linear estimator of the signal then provides a lower bound on the capacity for signal estimation. Under the ``signal detection'' paradigm, the presence or absence of the signal has to be detected. Performance of the optimal spike detector allows us to compute a lower bound on the capacity for signal detection. We find that single synapses (for empirically measured parameter values) transmit information poorly but significant improvement can be achieved with a small amount of redundancy.Comment: 7 pages, 4 figures, NIPS97 proceedings: neuroscience. Originally submitted to the neuro-sys archive which was never publicly announced (was 9809002