Self-organized Criticality in Neural Networks by Inhibitory and Excitatory Synaptic Plasticity

Neural networks show intrinsic ongoing activity even in the absence of information processing and task-driven activities. This spontaneous activity has been reported to have specific characteristics ranging from scale-free avalanches in microcircuits to the power-law decay of the power spectrum of oscillations in coarse-grained recordings of large populations of neurons. The emergence of scale-free activity and power-law distributions of observables has encouraged researchers to postulate that the neural system is operating near a continuous phase transition. At such a phase transition, changes in control parameters or the strength of the external input lead to a change in the macroscopic behavior of the system. On the other hand, at a critical point due to critical slowing down, the phenomenological mesoscopic modeling of the system becomes realizable. Two distinct types of phase transitions have been suggested as the operating point of the neural system, namely active-inactive and synchronous-asynchronous phase transitions. In contrast to normal phase transitions in which a fine-tuning of the control parameter(s) is required to bring the system to the critical point, neural systems should be supplemented with self-tuning mechanisms that adaptively adjust the system near to the critical point (or critical region) in the phase space. In this work, we introduce a self-organized critical model of the neural network. We consider dynamics of excitatory and inhibitory (EI) sparsely connected populations of spiking leaky integrate neurons with conductance-based synapses. Ignoring inhomogeneities and internal fluctuations, we first analyze the mean-field model. We choose the strength of the external excitatory input and the average strength of excitatory to excitatory synapses as control parameters of the model and analyze the bifurcation diagram of the mean-field equations. We focus on bifurcations at the low firing rate regime in which the quiescent state loses stability due to Saddle-node or Hopf bifurcations. In particular, at the Bogdanov-Takens (BT) bifurcation point which is the intersection of the Hopf bifurcation and Saddle-node bifurcation lines of the 2D dynamical system, the network shows avalanche dynamics with power-law avalanche size and duration distributions. This matches the characteristics of low firing spontaneous activity in the cortex. By linearizing gain functions and excitatory and inhibitory nullclines, we can approximate the location of the BT bifurcation point. This point in the control parameter phase space corresponds to the internal balance of excitation and inhibition and a slight excess of external excitatory input to the excitatory population. Due to the tight balance of average excitation and inhibition currents, the firing of the individual cells is fluctuation-driven. Around the BT point, the spiking of neurons is a Poisson process and the population average membrane potential of neurons is approximately at the middle of the operating interval $[V_{Rest}, V_{th}]$. Moreover, the EI network is close to both oscillatory and active-inactive phase transition regimes. Next, we consider self-tuning of the system at this critical point. The self-organizing parameter in our network is the balance of opposing forces of inhibitory and excitatory populations' activities and the self-organizing mechanisms are long-term synaptic plasticity and short-term depression of the synapses. The former tunes the overall strength of excitatory and inhibitory pathways to be close to a balanced regime of these currents and the latter which is based on the finite amount of resources in brain areas, act as an adaptive mechanism that tunes micro populations of neurons subjected to fluctuating external inputs to attain the balance in a wider range of external input strengths. Using the Poisson firing assumption, we propose a microscopic Markovian model which captures the internal fluctuations in the network due to the finite size and matches the macroscopic mean-field equation by coarse-graining. Near the critical point, a phenomenological mesoscopic model for excitatory and inhibitory fields of activity is possible due to the time scale separation of slowly changing variables and fast degrees of freedom. We will show that the mesoscopic model corresponding to the neural field model near the local Bogdanov-Takens bifurcation point matches Langevin's description of the directed percolation process. Tuning the system at the critical point can be achieved by coupling fast population dynamics with slow adaptive gain and synaptic weight dynamics, which make the system wander around the phase transition point. Therefore, by introducing short-term and long-term synaptic plasticity, we have proposed a self-organized critical stochastic neural field model.:1. Introduction 1.1. Scale-free Spontaneous Activity 1.1.1. Nested Oscillations in the Macro-scale Collective Activity 1.1.2. Up and Down States Transitions 1.1.3. Avalanches in Local Neuronal Populations 1.2. Criticality and Self-organized Criticality in Systems out of Equilibrium 1.2.1. Sandpile Models 1.2.2. Directed Percolation 1.3. Critical Neural Models 1.3.1. Self-Organizing Neural Automata 1.3.2. Criticality in the Mesoscopic Models of Cortical Activity 1.4. Balance of Inhibition and Excitation 1.5. Functional Benefits of Being in the Critical State 1.6. Arguments Against the Critical State of the Brain 1.7. Organization of the Current Work 2. Single Neuron Model 2.1. Impulse Response of the Neuron 2.2. Response of the Neuron to the Constant Input 2.3. Response of the Neuron to the Poisson Input 2.3.1. Potential Distribution of a Neuron Receiving Poisson Input 2.3.2. Firing Rate and Interspike intervals’ CV Near the Threshold 2.3.3. Linear Poisson Neuron Approximation 3. Interconnected Homogeneous Population of Excitatory and Inhibitory Neurons 3.1. Linearized Nullclines and Different Dynamic Regimes 3.2. Logistic Function Approximation of Gain Functions 3.3. Dynamics Near the BT Bifurcation Point 3.4. Avalanches in the Region Close to the BT Point 3.5. Stability Analysis of the Fixed Points in the Linear Regime 3.6. Characteristics of Avalanches 4. Long Term and Short Term Synaptic Plasticity rules Tune the EI Population Close to the BT Bifurcation Point 4.1. Long Term Synaptic Plasticity by STDP Tunes Synaptic Weights Close to the Balanced State 4.2. Short-term plasticity and Up-Down states transition 5. Interconnected network of EI populations: Wilson-Cowan Neural Field Model 6. Stochastic Neural Field 6.1. Finite size fluctuations in a single EI population 6.2. Stochastic Neural Field with a Tuning Mechanism to the Critical State 7. Conclusio

EF-hand protein Ca²⁺ buffers regulate Ca²⁺ influx and exocytosis in sensory hair cells

EF-hand Ca²⁺-binding proteins are thought to shape the spatiotemporal properties of cellular Ca²⁺ signaling and are prominently expressed in sensory hair cells in the ear. Here, we combined genetic disruption of parvalbumin-α, calbindin-D28k, and calretinin in mice with patch-clamp recording, in vivo physiology, and mathematical modeling to study their role in Ca²⁺ signaling, exocytosis, and sound encoding at the synapses of inner hair cells (IHCs). IHCs lacking all three proteins showed excessive exocytosis during prolonged depolarizations, despite enhanced Ca²⁺-dependent inactivation of their Ca²⁺ current. Exocytosis of readily releasable vesicles remained unchanged, in accordance with the estimated tight spatial coupling of Ca²⁺ channels and release sites (effective “coupling distance” of 17 nm). Substitution experiments with synthetic Ca²⁺ chelators indicated the presence of endogenous Ca²⁺ buffers equivalent to 1 mM synthetic Ca²⁺-binding sites, approximately half of them with kinetics as fast as 1,2-Bis(2-aminophenoxy)ethane-N,N,N′,N′-tetraacetic acid (BAPTA). Synaptic sound encoding was largely unaltered, suggesting that excess exocytosis occurs extrasynaptically. We conclude that EF-hand Ca²⁺ buffers regulate presynaptic IHC function for metabolically efficient sound coding

Modeling and Analysis of Neural Spike Trains

open

Constraining the function of CA1 in associative memory models of the hippocampus

Institute for Adaptive and Neural ComputationCA1 is the main source of afferents from the hippocampus, but the function of CA1 and its perforant path (PP) input remains unclear. In this thesis, Marr’s model of the hippocampus is used to investigate previously hypothesized functions, and also to investigate some of Marr’s unexplored theoretical ideas. The last part of the thesis explains the excitatory responses to PP activity in vivo, despite inhibitory responses in vitro. Quantitative support for the idea of CA1 as a relay of information from CA3 to the neocortex and subiculum is provided by constraining Marr’s model to experimental data. Using the same approach, the much smaller capacity of the PP input by comparison implies it is not a one-shot learning network. In turn, it is argued that the entorhinal-CA1 connections cannot operate as a short-term memory network through reverberating activity. The PP input to CA1 has been hypothesized to control the activity of CA1 pyramidal cells. Marr suggested an algorithm for self-organising the output activity during pattern storage. Analytic calculations show a greater capacity for self-organised patterns than random patterns for low connectivities and high loads, confirmed in simulations over a broader parameter range. This superior performance is maintained in the absence of complex thresholding mechanisms, normally required to maintain performance levels in the sparsely connected networks. These results provide computational motivation for CA3 to establish patterns of CA1 activity without involvement from the PP input. The recent report of CA1 place cell activity with CA3 lesioned (Brun et al., 2002. Science, 296(5576):2243-6) is investigated using an integrate-and-fire neuron model of the entorhinal-CA1 network. CA1 place field activity is learnt, despite a completely inhibitory response to the stimulation of entorhinal afferents. In the model, this is achieved using N-methyl-D-asparate receptors to mediate a significant proportion of the excitatory response. Place field learning occurs over a broad parameter space. It is proposed that differences between similar contexts are slowly learnt in the PP and as a result are amplified in CA1. This would provide improved spatial memory in similar but different contexts