Sum rate analysis of multiple-access neuro-spike communication channel with dynamic spiking threshold

© 2019 Elsevier B.V. The information from outside world is encoded into spikes by the sensory neurons. These spikes are further propagated to different brain regions through various neural pathways. In the cortical region, each neuron receives inputs from multiple neurons that change its membrane potential. If the accumulated change in the membrane potential is more than a threshold value, a spike is generated. According to various studies in neuroscience, this spiking threshold adapts with time depending on the previous spike. This causes short-term changes in the neural responses giving rise to short-term plasticity. Therefore, in this paper, we analyze a multiple-input single-output (MISO) neuro-spike communication channel and study the effects of dynamic spiking threshold on mutual information and maximum achievable sum rate of the channel. Since spike generation consumes a generous portion of the metabolic energy provided to the brain, we further put metabolic constraint in calculating the mutual information and find a trade-off between maximum achievable sum rate and metabolic energy consumed. Moreover, we analyze three types of neurons present in the cortical region, i.e., Regular spiking, Intrinsic bursting and Fast spiking neurons. We aim to characterize these neurons in terms of encoding/transmission rates and energy expenditure. It will provide a guideline for the practical implementation of bio-inspired nanonetworks as well as for the development of ICT-based diagnosis and treatment techniques for neural diseases.This work was supported in part by European Research Council (ERC) under grant ERC-2013-CoG 616922 (Project MINERVA) and ERC-2017-PoC 780645 (ERC Proof of Concept project MINRGRACE)

Impacts of Spike Shape Variations on Synaptic Communication.

Understanding the communication theoretical capabilities of information transmission among neurons, known as neuro-spike communication, is a significant step in developing bio-inspired solutions for nanonetworking. In this paper, we focus on a part of this communication known as synaptic transmission for pyramidal neurons in the Cornu Ammonis area of the hippocampus location in the brain and propose a communication-based model for it that includes effects of spike shape variation on neural calcium signaling and the vesicle release process downstream of it. For this aim, we find impacts of spike shape variation on opening of voltage-dependent calcium channels, which control the release of vesicles from the pre-synaptic neuron by changing the influx of calcium ions. Moreover, we derive the structure of the optimum receiver based on the Neyman-Pearson detection method to find the effects of spike shape variations on the functionality of neuro-spike communication. Numerical results depict that changes in both spike width and amplitude affect the error detection probability. Moreover, these two factors do not control the performance of the system independently. Hence, a proper model for neuro-spike communication should contain effects of spike shape variations during axonal transmission on both synaptic propagation and spike generation mechanisms to enable us to accurately explain the performance of this communication paradigm

Rate region analysis of multi-terminal neuronal nanoscale molecular communication channel

© 2017 IEEE. In this paper, we investigate the communication channel capacity among hippocampal pyramidal neurons. To this aim, we study the processes included in this communication and model them with realistic communication system components based on the existing reports in the physiology literature. We consider the communication between two neurons and reveal the effects of the existence of multiple terminals between these neurons on the achievable rate per spike. To this objective, we derive the power spectral density (PSD) of the signal in the output neuron and utilize it to calculate the rate region of the channel. Moreover, we evaluate the impacts of vesicle availability on the achievable rate by deriving the expected number of available vesicles in input neuron using a realistic vesicle release model. Simulation results show that number of available vesicles for release does not affect the achievable rate of neuro-spike communication with univesicular release model. However, in neurons that multiple vesicles can release from each synaptic terminal, achievable rate is significantly affected by depletion of vesicles. Moreover, we show that increasing the number of synaptic terminals between two neurons makes the synaptic connection stronger. Hence, it is an important factor in learning and memory, which occur in the hippocampal region of the brain based on the synaptic connectivity

Neuronal Synchronization Can Control the Energy Efficiency of Inter-Spike Interval Coding

The role of synchronous firing in sensory coding and cognition remains controversial. While studies, focusing on its mechanistic consequences in attentional tasks, suggest that synchronization dynamically boosts sensory processing, others failed to find significant synchronization levels in such tasks. We attempt to understand both lines of evidence within a coherent theoretical framework. We conceptualize synchronization as an independent control parameter to study how the postsynaptic neuron transmits the average firing activity of a presynaptic population, in the presence of synchronization. We apply the Berger-Levy theory of energy efficient information transmission to interpret simulations of a Hodgkin-Huxley-type postsynaptic neuron model, where we varied the firing rate and synchronization level in the presynaptic population independently. We find that for a fixed presynaptic firing rate the simulated postsynaptic interspike interval distribution depends on the synchronization level and is well-described by a generalized extreme value distribution. For synchronization levels of 15% to 50%, we find that the optimal distribution of presynaptic firing rate, maximizing the mutual information per unit cost, is maximized at ~30% synchronization level. These results suggest that the statistics and energy efficiency of neuronal communication channels, through which the input rate is communicated, can be dynamically adapted by the synchronization level.Comment: 47 pages, 14 figures, 2 Table

Sum Rate of MISO Neuro-Spike Communication Channel With Constant Spiking Threshold.

Communication among neurons, known as neuro-spike communication, is the most promising technique for realization of a bio-inspired nanoscale communication paradigm to achieve biocompatible nanonetworks. In neuro-spike communication, the information, encoded into spike trains, is communicated to various brain regions through neuronal network. An output neuron needs to receive signal from multiple input neurons to generate a spike. Hence, in this paper, we aim to quantify the information transmitted through the multiple-input single-output (MISO) neuro-spike communication channel by considering models for axonal propagation, synaptic transmission, and spike generation. Moreover, the spike generation and propagation in each neuron requires opening and closing of numerous ionic channels on the cell membrane, which consumes considerable amount of ATP molecules called metabolic energy. Thus, we evaluate how applying a constraint on available metabolic energy affects the maximum achievable mutual information of this system. To this aim, we derive a closed form equation for the sum rate of the MISO neuro-spike communication channel and analyze it under the metabolic cost constraints. Finally, we discuss the impacts of changes in number of pre-synaptic neurons on the achievable rate and quantify the tradeoff between maximum achievable sum rate and the consumed metabolic energy

An information theoretical analysis of multi-terminal neuro-spike communication network in spinal cord

© 2018 Association for Computing Machinery. Communication theoretical understanding of healthy and diseased connections in the spinal cord motor system is crucial for realizing future information and communication technology (ICT) based diagnosis and treatment techniques for spinal cord injuries (SCI). A spinal cord motor nucleus associated with a particular muscle constitutes an ideal candidate for studying to have an understanding of SCI. Typical spinal cord motor nucleus system contains pool of lower motor neurons (MNs) controlling a muscle by integrating synaptic inputs from spinal interneurons (INs), upper motor neurons (DNs) and sensory neurons (SNs). In this study, we consider this system from ICT perspective. Our aim is to quantify the rate of information flow across a spinal cord motor nucleus. To this end, we model an equivalent single-hop multiterminal network, where multiple transmitting nodes representing heterogeneous population of DNs, INs and SNs send information to multiple receiving nodes corresponding to MNs. To identify the outputs at receiving nodes, we define corresponding neurospike communication channel and then find the bound on total rates across this network. Based on the network model, we analyze achievable rates for a particular motor nucleus system called Tibialis Anterior (TA) motor nucleus in the spinal cord numerically and simulate several spinal cord dysfunction scenarios. The numerical results reveal that decrease in the maximum total rates with the lower motor neuron injury causes weakness in the affected muscle

VLSI Implementation of a 2.8 Gevent/s Packet-Based AER Interface with Routing and Event Sorting Functionality

State-of-the-art large-scale neuromorphic systems require sophisticated spike event communication between units of the neural network. We present a high-speed communication infrastructure for a waferscale neuromorphic system, based on application-specific neuromorphic communication ICs in an field programmable gate arrays (FPGA)-maintained environment. The ICs implement configurable axonal delays, as required for certain types of dynamic processing or for emulating spike-based learning among distant cortical areas. Measurements are presented which show the efficacy of these delays in influencing behavior of neuromorphic benchmarks. The specialized, dedicated address-event-representation communication in most current systems requires separate, low-bandwidth configuration channels. In contrast, the configuration of the waferscale neuromorphic system is also handled by the digital packet-based pulse channel, which transmits configuration data at the full bandwidth otherwise used for pulse transmission. The overall so-called pulse communication subgroup (ICs and FPGA) delivers a factor 25–50 more event transmission rate than other current neuromorphic communication infrastructures

Characterization and Compensation of Network-Level Anomalies in Mixed-Signal Neuromorphic Modeling Platforms

Advancing the size and complexity of neural network models leads to an ever increasing demand for computational resources for their simulation. Neuromorphic devices offer a number of advantages over conventional computing architectures, such as high emulation speed or low power consumption, but this usually comes at the price of reduced configurability and precision. In this article, we investigate the consequences of several such factors that are common to neuromorphic devices, more specifically limited hardware resources, limited parameter configurability and parameter variations. Our final aim is to provide an array of methods for coping with such inevitable distortion mechanisms. As a platform for testing our proposed strategies, we use an executable system specification (ESS) of the BrainScaleS neuromorphic system, which has been designed as a universal emulation back-end for neuroscientific modeling. We address the most essential limitations of this device in detail and study their effects on three prototypical benchmark network models within a well-defined, systematic workflow. For each network model, we start by defining quantifiable functionality measures by which we then assess the effects of typical hardware-specific distortion mechanisms, both in idealized software simulations and on the ESS. For those effects that cause unacceptable deviations from the original network dynamics, we suggest generic compensation mechanisms and demonstrate their effectiveness. Both the suggested workflow and the investigated compensation mechanisms are largely back-end independent and do not require additional hardware configurability beyond the one required to emulate the benchmark networks in the first place. We hereby provide a generic methodological environment for configurable neuromorphic devices that are targeted at emulating large-scale, functional neural networks

Scaling of a large-scale simulation of synchronous slow-wave and asynchronous awake-like activity of a cortical model with long-range interconnections

Cortical synapse organization supports a range of dynamic states on multiple spatial and temporal scales, from synchronous slow wave activity (SWA), characteristic of deep sleep or anesthesia, to fluctuating, asynchronous activity during wakefulness (AW). Such dynamic diversity poses a challenge for producing efficient large-scale simulations that embody realistic metaphors of short- and long-range synaptic connectivity. In fact, during SWA and AW different spatial extents of the cortical tissue are active in a given timespan and at different firing rates, which implies a wide variety of loads of local computation and communication. A balanced evaluation of simulation performance and robustness should therefore include tests of a variety of cortical dynamic states. Here, we demonstrate performance scaling of our proprietary Distributed and Plastic Spiking Neural Networks (DPSNN) simulation engine in both SWA and AW for bidimensional grids of neural populations, which reflects the modular organization of the cortex. We explored networks up to 192x192 modules, each composed of 1250 integrate-and-fire neurons with spike-frequency adaptation, and exponentially decaying inter-modular synaptic connectivity with varying spatial decay constant. For the largest networks the total number of synapses was over 70 billion. The execution platform included up to 64 dual-socket nodes, each socket mounting 8 Intel Xeon Haswell processor cores @ 2.40GHz clock rates. Network initialization time, memory usage, and execution time showed good scaling performances from 1 to 1024 processes, implemented using the standard Message Passing Interface (MPI) protocol. We achieved simulation speeds of between 2.3x10^9 and 4.1x10^9 synaptic events per second for both cortical states in the explored range of inter-modular interconnections.Comment: 22 pages, 9 figures, 4 table

A laminar organization for selective cortico-cortical communication

The neocortex is central to mammalian cognitive ability, playing critical roles in sensory perception, motor skills and executive function. This thin, layered structure comprises distinct, functionally specialized areas that communicate with each other through the axons of pyramidal neurons. For the hundreds of such cortico-cortical pathways to underlie diverse functions, their cellular and synaptic architectures must differ so that they result in distinct computations at the target projection neurons. In what ways do these pathways differ? By originating and terminating in different laminae, and by selectively targeting specific populations of excitatory and inhibitory neurons, these “interareal” pathways can differentially control the timing and strength of synaptic inputs onto individual neurons, resulting in layer-specific computations. Due to the rapid development in transgenic techniques, the mouse has emerged as a powerful mammalian model for understanding the rules by which cortical circuits organize and function. Here we review our understanding of how cortical lamination constrains long-range communication in the mammalian brain, with an emphasis on the mouse visual cortical network. We discuss the laminar architecture underlying interareal communication, the role of neocortical layers in organizing the balance of excitatory and inhibitory actions, and highlight the structure and function of layer 1 in mouse visual cortex