Analog integrated neural-like circuits for nonlinear programming

A systematic approach for the design of analog neural nonlinear programming solvers using switched-capacitor (SC) integrated circuit techniques is presented. The method is based on formulating a dynamic gradient system whose state evolves in time towards the solution point of the corresponding programming problem. A neuron cell for the linear and the quadratic problem suitable for monolithic implementation is introduced. The design of this neuron and its corresponding synapses using SC techniques is considered in detail. An SC circuit architecture based on a reduced set of basic building blocks with high modularity is presented. Simulation results using a mixed-mode simulator (DIANA) and experimental results from breadboard prototypes are included, illustrating the validity of the proposed technique

Subthreshold dynamics of a single neuron from a Hamiltonian perspective

We use Hamilton's equations of classical mechanics to investigate the behavior of a cortical neuron on the approach to an action potential. We use a two-component dynamic model of a single neuron, due to Wilson, with added noise inputs. We derive a Lagrangian for the system, from which we construct Hamilton's equations. The conjugate momenta are found to be linear combinations of the noise input to the system. We use this approach to consider theoretically and computationally the most likely manner in which such a modeled neuron approaches a firing event. We find that the firing of a neuron is a result of a drop in inhibition, due to a temporary increase in negative bias of the mean noise input to the inhibitory control equation. Moreover, we demonstrate through theory and simulation that, on average, the bias in the noise increases in an exponential manner on the approach to an action potential. In the Hamiltonian description, an action potential can therefore be considered a result of the exponential growth of the conjugate momenta variables pulling the system away from its equilibrium state, into a nonlinear regime

Enhancement of synchronization in a hybrid neural circuit by spike timing dependent plasticity

Synchronization of neural activity is fundamental for many functions of the brain. We demonstrate that spike-timing dependent plasticity (STDP) enhances synchronization (entrainment) in a hybrid circuit composed of a spike generator, a dynamic clamp emulating an excitatory plastic synapse, and a chemically isolated neuron from the Aplysia abdominal ganglion. Fixed-phase entrainment of the Aplysia neuron to the spike generator is possible for a much wider range of frequency ratios and is more precise and more robust with the plastic synapse than with a nonplastic synapse of comparable strength. Further analysis in a computational model of HodgkinHuxley-type neurons reveals the mechanism behind this significant enhancement in synchronization. The experimentally observed STDP plasticity curve appears to be designed to adjust synaptic strength to a value suitable for stable entrainment of the postsynaptic neuron. One functional role of STDP might therefore be to facilitate synchronization or entrainment of nonidentical neurons

Controlling Chaos in a Neural Network Based on the Phase Space Constraint

The chaotic neural network constructed with chaotic neurons exhibits very rich dynamic behaviors and has a nonperiodic associative memory. In the chaotic neural network, however, it is dicult to distinguish the stored patters from others, because the states of output of the network are in chaos. In order to apply the nonperiodic associative memory into information search and pattern identication, etc, it is necessary to control chaos in this chaotic neural network. In this paper, the phase space constraint method focused on the chaotic neural network is proposed. By analyzing the orbital of the network in phase space, we chose a part of states to be disturbed. In this way, the evolutional spaces of the strange attractors are constrained. The computer simulation proves that the chaos in the chaotic neural network can be controlled with above method and the network can converge in one of its stored patterns or their reverses which has the smallest Hamming distance with the initial state of the network. The work claries the application prospect of the associative dynamics of the chaotic neural network

CMOS circuit implementations for neuron models

The mathematical neuron basic cells used as basic cells in popular neural network architectures and algorithms are discussed. The most popular neuron models (without training) used in neural network architectures and algorithms (NNA) are considered, focusing on hardware implementation of neuron models used in NAA, and in emulation of biological systems. Mathematical descriptions and block diagram representations are utilized in an independent approach. Nonoscillatory and oscillatory models are discusse

Integration of continuous-time dynamics in a spiking neural network simulator

Contemporary modeling approaches to the dynamics of neural networks consider two main classes of models: biologically grounded spiking neurons and functionally inspired rate-based units. The unified simulation framework presented here supports the combination of the two for multi-scale modeling approaches, the quantitative validation of mean-field approaches by spiking network simulations, and an increase in reliability by usage of the same simulation code and the same network model specifications for both model classes. While most efficient spiking simulations rely on the communication of discrete events, rate models require time-continuous interactions between neurons. Exploiting the conceptual similarity to the inclusion of gap junctions in spiking network simulations, we arrive at a reference implementation of instantaneous and delayed interactions between rate-based models in a spiking network simulator. The separation of rate dynamics from the general connection and communication infrastructure ensures flexibility of the framework. We further demonstrate the broad applicability of the framework by considering various examples from the literature ranging from random networks to neural field models. The study provides the prerequisite for interactions between rate-based and spiking models in a joint simulation