Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks

A long-term goal of AI is to produce agents that can learn a diversity of skills throughout their lifetimes and continuously improve those skills via experience. A longstanding obstacle towards that goal is catastrophic forgetting, which is when learning new information erases previously learned information. Catastrophic forgetting occurs in artificial neural networks (ANNs), which have fueled most recent advances in AI. A recent paper proposed that catastrophic forgetting in ANNs can be reduced by promoting modularity, which can limit forgetting by isolating task information to specific clusters of nodes and connections (functional modules). While the prior work did show that modular ANNs suffered less from catastrophic forgetting, it was not able to produce ANNs that possessed task-specific functional modules, thereby leaving the main theory regarding modularity and forgetting untested. We introduce diffusion-based neuromodulation, which simulates the release of diffusing, neuromodulatory chemicals within an ANN that can modulate (i.e. up or down regulate) learning in a spatial region. On the simple diagnostic problem from the prior work, diffusion-based neuromodulation 1) induces task-specific learning in groups of nodes and connections (task-specific localized learning), which 2) produces functional modules for each subtask, and 3) yields higher performance by eliminating catastrophic forgetting. Overall, our results suggest that diffusion-based neuromodulation promotes task-specific localized learning and functional modularity, which can help solve the challenging, but important problem of catastrophic forgetting

Octopamine increases the excitability of neurons in the snail feeding system by modulation of inward sodium current but not outward potassium currents

Background: Although octopamine has long been known to have major roles as both transmitter and modulator in arthropods, it has only recently been shown to be functionally important in molluscs, playing a role as a neurotransmitter in the feeding network of the snail Lymnaea stagnalis. The synaptic potentials cannot explain all the effects of octopamine-containing neurons on the feeding network, and here we test the hypothesis that octopamine is also a neuromodulator. Results: The excitability of the B1 and B4 motoneurons in the buccal ganglia to depolarising current clamp pulses is significantly (P << 0.05) increased by (10 mu M) octopamine, whereas the B2 motoneuron becomes significantly less excitable. The ionic currents evoked by voltage steps were recorded using 2-electrode voltage clamp. The outward current of B1, B2 and B4 motoneurons had two components, a transient I-A current and a sustained I-K delayed-rectifier current, but neither was modulated by octopamine in any of these three buccal neurons. The fast inward current was eliminated in sodium - free saline and so is likely to be carried by sodium ions. 10 mu M octopamine enhanced this current by 33 and 45% in the B1 and B4 motoneurons respectively (P << 0.05), but a small reduction was seen in the B2 neuron. A Hodgkin-Huxley style simulation of the B1 motoneuron confirms that a 33% increase in the fast inward current by octopamine increases the excitability markedly. Conclusion: We conclude that octopamine is also a neuromodulator in snails, changing the excitability of the buccal neurons. This is supported by the close relationship from the voltage clamp data, through the quantitative simulation, to the action potential threshold, changing the properties of neurons in a rhythmic network. The increase in inward sodium current provides an explanation for the polycyclic modulation of the feeding system by the octopamine-containing interneurons, making feeding easier to initiate and making the feeding bursts more intense

Neuronal avalanches differ from wakefulness to deep sleep - evidence from intracranial depth recordings in humans

Neuronal activity differs between wakefulness and sleep states. In contrast, an attractor state, called self-organized critical (SOC), was proposed to govern brain dynamics because it allows for optimal information coding. But is the human brain SOC for each vigilance state despite the variations in neuronal dynamics? We characterized neuronal avalanches – spatiotemporal waves of enhanced activity - from dense intracranial depth recordings in humans. We showed that avalanche distributions closely follow a power law – the hallmark feature of SOC - for each vigilance state. However, avalanches clearly differ with vigilance states: slow wave sleep (SWS) shows large avalanches, wakefulness intermediate, and rapid eye movement (REM) sleep small ones. Our SOC model, together with the data, suggested first that the differences are mediated by global but tiny changes in synaptic strength, and second, that the changes with vigilance states reflect small deviations from criticality to the subcritical regime, implying that the human brain does not operate at criticality proper but close to SOC. Independent of criticality, the analysis confirms that SWS shows increased correlations between cortical areas, and reveals that REM sleep shows more fragmented cortical dynamics

Cholinergic Modulation of the Locomotor Network in the Lamprey Spinal Cord

Acetylcholine (ACh) was found here to be a strong modulator of swimming activity in the isolated spinal cord preparation of the adult lamprey (Ichthyomyzon unicuspis). During fictive swimming induced with either D-glutamate or N-methyl-D-aspartate, addition of ACh (200 µM) significantly reduced the cycle period of ventral root bursts to 54%, intersegmental phase lag to 32%, and ventral root burst proportion to 80% of control levels. Effects of ACh were apparent at concentrations as low as 1 µM. Both nicotinic and muscarinic receptors are involved, in that application of either nicotinic or muscarinic agonists alone significantly reduced cycle period. There is sufficient endogenous ACh in the spinal cord to modulate ongoing fictive swimming, as shown by application of the cholinesterase inhibitor eserine (physostigmine). Eserine (20 µM) significantly reduced the cycle period to 78% and phase lag to 58% of control levels, and these effects were reversed with the addition of cholinergic blockers. Addition of only a nicotinic or muscarinic antagonist, mecamylamine (10 µM) or scopolamine (20 µM), respectively, to the spinal cord during fictive swimming produced significant increases in cycle period and phase lag, suggesting that both types of cholinergic receptors participate in endogenous cholinergic modulation. It is concluded that ACh is an endogenous modulator of the locomotor network in the lamprey spinal cord and that ACh may take part in the regulation of cycle period, intersegmental coupling, and ventral root burst duration

On the Dynamics of the Spontaneous Activity in Neuronal Networks

Most neuronal networks, even in the absence of external stimuli, produce spontaneous bursts of spikes separated by periods of reduced activity. The origin and functional role of these neuronal events are still unclear. The present work shows that the spontaneous activity of two very different networks, intact leech ganglia and dissociated cultures of rat hippocampal neurons, share several features. Indeed, in both networks: i) the inter-spike intervals distribution of the spontaneous firing of single neurons is either regular or periodic or bursting, with the fraction of bursting neurons depending on the network activity; ii) bursts of spontaneous spikes have the same broad distributions of size and duration; iii) the degree of correlated activity increases with the bin width, and the power spectrum of the network firing rate has a 1/f behavior at low frequencies, indicating the existence of long-range temporal correlations; iv) the activity of excitatory synaptic pathways mediated by NMDA receptors is necessary for the onset of the long-range correlations and for the presence of large bursts; v) blockage of inhibitory synaptic pathways mediated by GABA(A) receptors causes instead an increase in the correlation among neurons and leads to a burst distribution composed only of very small and very large bursts. These results suggest that the spontaneous electrical activity in neuronal networks with different architectures and functions can have very similar properties and common dynamics

Conductance Ratios and Cellular Identity

Recent experimental evidence suggests that coordinated expression of ion channels plays a role in constraining neuronal electrical activity. In particular, each neuronal cell type of the crustacean stomatogastric ganglion exhibits a unique set of positive linear correlations between ionic membrane conductances. These data suggest a causal relationship between expressed conductance correlations and features of cellular identity, namely electrical activity type. To test this idea, we used an existing database of conductance-based model neurons. We partitioned this database based on various measures of intrinsic activity, to approximate distinctions between biological cell types. We then tested individual conductance pairs for linear dependence to identify correlations. Contrary to experimental evidence, in which all conductance correlations are positive, 32% of correlations seen in this database were negative relationships. In addition, 80% of correlations seen here involved at least one calcium conductance, which have been difficult to measure experimentally. Similar to experimental results, each activity type investigated had a unique combination of correlated conductances. Finally, we found that populations of models that conform to a specific conductance correlation have a higher likelihood of exhibiting a particular feature of electrical activity. We conclude that regulating conductance ratios can support proper electrical activity of a wide range of cell types, particularly when the identity of the cell is well-defined by one or two features of its activity. Furthermore, we predict that previously unseen negative correlations and correlations involving calcium conductances are biologically plausible