Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons

The organization of computations in networks of spiking neurons in the brain is still largely unknown, in particular in view of the inherently stochastic features of their firing activity and the experimentally observed trial-to-trial variability of neural systems in the brain. In principle there exists a powerful computational framework for stochastic computations, probabilistic inference by sampling, which can explain a large number of macroscopic experimental data in neuroscience and cognitive science. But it has turned out to be surprisingly difficult to create a link between these abstract models for stochastic computations and more detailed models of the dynamics of networks of spiking neurons. Here we create such a link and show that under some conditions the stochastic firing activity of networks of spiking neurons can be interpreted as probabilistic inference via Markov chain Monte Carlo (MCMC) sampling. Since common methods for MCMC sampling in distributed systems, such as Gibbs sampling, are inconsistent with the dynamics of spiking neurons, we introduce a different approach based on non-reversible Markov chains that is able to reflect inherent temporal processes of spiking neuronal activity through a suitable choice of random variables. We propose a neural network model and show by a rigorous theoretical analysis that its neural activity implements MCMC sampling of a given distribution, both for the case of discrete and continuous time. This provides a step towards closing the gap between abstract functional models of cortical computation and more detailed models of networks of spiking neurons

Fundamental questions relating to ion conduction in disordered solids

A number of basic scientific questions relating to ion conduction in homogeneously disordered solids are discussed. The questions deal with how to define the mobile ion density, what can be learned from electrode effects, what is the ion transport mechanism, the role of dimensionality, and what are the origins of the mixed-alkali effect, of time-temperature superposition, and of the nearly-constant loss. Answers are suggested to some of these questions, but the main purpose of the paper is to draw attention to the fact that this field of research still presents several fundamental challenges.Comment: Reports on Progress in Physics, to appea

Distributed Bayesian Computation and Self-Organized Learning in Sheets of Spiking Neurons with Local Lateral Inhibition

During the last decade, Bayesian probability theory has emerged as a framework in cognitive science and neuroscience for describing perception, reasoning and learning of mammals. However, our understanding of how probabilistic computations could be organized in the brain, and how the observed connectivity structure of cortical microcircuits supports these calculations, is rudimentary at best. In this study, we investigate statistical inference and self-organized learning in a spatially extended spiking network model, that accommodates both local competitive and large-scale associative aspects of neural information processing, under a unified Bayesian account. Specifically, we show how the spiking dynamics of a recurrent network with lateral excitation and local inhibition in response to distributed spiking input, can be understood as sampling from a variational posterior distribution of a well-defined implicit probabilistic model. This interpretation further permits a rigorous analytical treatment of experience-dependent plasticity on the network level. Using machine learning theory, we derive update rules for neuron and synapse parameters which equate with Hebbian synaptic and homeostatic intrinsic plasticity rules in a neural implementation. In computer simulations, we demonstrate that the interplay of these plasticity rules leads to the emergence of probabilistic local experts that form distributed assemblies of similarly tuned cells communicating through lateral excitatory connections. The resulting sparse distributed spike code of a well-adapted network carries compressed information on salient input features combined with prior experience on correlations among them. Our theory predicts that the emergence of such efficient representations benefits from network architectures in which the range of local inhibition matches the spatial extent of pyramidal cells that share common afferent input

Neuromorphic Hardware In The Loop: Training a Deep Spiking Network on the BrainScaleS Wafer-Scale System

Emulating spiking neural networks on analog neuromorphic hardware offers several advantages over simulating them on conventional computers, particularly in terms of speed and energy consumption. However, this usually comes at the cost of reduced control over the dynamics of the emulated networks. In this paper, we demonstrate how iterative training of a hardware-emulated network can compensate for anomalies induced by the analog substrate. We first convert a deep neural network trained in software to a spiking network on the BrainScaleS wafer-scale neuromorphic system, thereby enabling an acceleration factor of 10 000 compared to the biological time domain. This mapping is followed by the in-the-loop training, where in each training step, the network activity is first recorded in hardware and then used to compute the parameter updates in software via backpropagation. An essential finding is that the parameter updates do not have to be precise, but only need to approximately follow the correct gradient, which simplifies the computation of updates. Using this approach, after only several tens of iterations, the spiking network shows an accuracy close to the ideal software-emulated prototype. The presented techniques show that deep spiking networks emulated on analog neuromorphic devices can attain good computational performance despite the inherent variations of the analog substrate.Comment: 8 pages, 10 figures, submitted to IJCNN 201

Pattern representation and recognition with accelerated analog neuromorphic systems

Despite being originally inspired by the central nervous system, artificial neural networks have diverged from their biological archetypes as they have been remodeled to fit particular tasks. In this paper, we review several possibilites to reverse map these architectures to biologically more realistic spiking networks with the aim of emulating them on fast, low-power neuromorphic hardware. Since many of these devices employ analog components, which cannot be perfectly controlled, finding ways to compensate for the resulting effects represents a key challenge. Here, we discuss three different strategies to address this problem: the addition of auxiliary network components for stabilizing activity, the utilization of inherently robust architectures and a training method for hardware-emulated networks that functions without perfect knowledge of the system's dynamics and parameters. For all three scenarios, we corroborate our theoretical considerations with experimental results on accelerated analog neuromorphic platforms.Comment: accepted at ISCAS 201

Structural trends in atomic nuclei from laser spectroscopy of tin

Tin is the chemical element with the largest number of stable isotopes. Its complete proton shell, comparable with the closed electron shells in the chemically inert noble gases, is not a mere precursor to extended stability; since the protons carry the nuclear charge, their spatial arrangement also drives the nuclear electromagnetism. We report high-precision measurements of the electromagnetic moments and isomeric differences in charge radii between the lowest 1/2(+), 3/2(+), and 11/2(-) states in Sn117-131, obtained by collinear laser spectroscopy. Supported by state-of-the-art atomic-structure calculations, the data accurately show a considerable attenuation of the quadrupole moments in the closed-shell tin isotopes relative to those of cadmium, with two protons less. Linear and quadratic mass-dependent trends are observed. While microscopic density functional theory explains the global behaviour of the measured quantities, interpretation of the local patterns demands higher-fidelity modelling. Measurements of the hyperfine structure of chemical elements isotopes provide unique insight into the atomic nucleus in a nuclear model-independent way. The authors present collinear laser spectroscopy data obtained at the CERN ISOLDE and measure hyperfine splitting along a long chain of odd-mass tin isotopes.Peer reviewe

Quadrupole moments of odd-A ⁵³⁻⁶³Mn: Onset of collectivity towards N = 40

The spectroscopic quadrupole moments of the odd–even Mn isotopes between N=28 and N=38 have been measured using bunched-beam collinear laser spectroscopy at ISOLDE, CERN. In order to increase sensitivity to the quadrupole interaction, the measurements have been done using a transition in the ion rather than in the atom, with the additional advantage of better spectroscopic efficiency. Since the chosen transition is from a metastable state, optical pumping in ISOLDE’s cooler and buncher (ISCOOL) was used to populate this state. The extracted quadrupole moments are compared to large-scale shell model predictions using three effective interactions, GXPF1A, LNPS and modified A3DA. The inclusion of both the 1νg9/2and 2νd5/2orbitals in the model space is shown to be necessary to reproduce the observed increase in the quadrupole deformation from N=36 onwards. Specifically, the inclusion of the 2νd5/2orbital induces an increase in neutron and proton excitations across the reduced gaps at N=40and Z=28, leading to an increase in deformation above N=36

Multidimensional Characterization and Differentiation of Neurons in the Anteroventral Cochlear Nucleus

Multiple parallel auditory pathways ascend from the cochlear nucleus. It is generally accepted that the origin of these pathways are distinct groups of neurons differing in their anatomical and physiological properties. In extracellular in vivo recordings these neurons are typically classified on the basis of their peri-stimulus time histogram. In the present study we reconsider the question of classification of neurons in the anteroventral cochlear nucleus (AVCN) by taking a wider range of response properties into account. The study aims at a better understanding of the AVCN's functional organization and its significance as the source of different ascending auditory pathways. The analyses were based on 223 neurons recorded in the AVCN of the Mongolian gerbil. The range of analysed parameters encompassed spontaneous activity, frequency coding, sound level coding, as well as temporal coding. In order to categorize the unit sample without any presumptions as to the relevance of certain response parameters, hierarchical cluster analysis and additional principal component analysis were employed which both allow a classification on the basis of a multitude of parameters simultaneously. Even with the presently considered wider range of parameters, high number of neurons and more advanced analytical methods, no clear boundaries emerged which would separate the neurons based on their physiology. At the current resolution of the analysis, we therefore conclude that the AVCN units more likely constitute a multi-dimensional continuum with different physiological characteristics manifested at different poles. However, more complex stimuli could be useful to uncover physiological differences in future studies

Large scale multifactorial likelihood quantitative analysis of BRCA1 and BRCA2 variants: An ENIGMA resource to support clinical variant classification

The multifactorial likelihood analysis method has demonstrated utility for quantitative assessment of variant pathogenicity for multiple cancer syndrome genes. Independent data types currently incorporated in the model for assessing BRCA1 and BRCA2 variants include clinically calibrated prior probability of pathogenicity based on variant location and bioinformatic prediction of variant effect, co-segregation, family cancer history profile, co-occurrence with a pathogenic variant in the same gene, breast tumor pathology, and case-control information. Research and clinical data for multifactorial likelihood analysis were collated for 1,395 BRCA1/2 predominantly intronic and missense variants, enabling classification based on posterior probability of pathogenicity for 734 variants: 447 variants were classified as (likely) benign, and 94 as (likely) pathogenic; and 248 classifications were new or considerably altered relative to ClinVar submissions. Classifications were compared with information not yet included in the likelihood model, and evidence strengths aligned to those recommended for ACMG/AMP classification codes. Altered mRNA splicing or function relative to known nonpathogenic variant controls were moderately to strongly predictive of variant pathogenicity. Variant absence in population datasets provided supporting evidence for variant pathogenicity. These findings have direct relevance for BRCA1 and BRCA2 variant evaluation, and justify the need for gene-specific calibration of evidence types used for variant classification