Sparse Coding with a Somato-Dendritic Rule

© 2020 Elsevier Ltd. All rights reserved. This manuscript is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Licence http://creativecommons.org/licenses/by-nc-nd/4.0/.Cortical neurons are silent most of the time. This sparse activity is energy efficient, and the resulting neural code has favourable properties for associative learning. Most neural models of sparse coding use some form of homeostasis to ensure that each neuron fires infrequently. But homeostatic plasticity acting on a fast timescale may not be biologically plausible, and could lead to catastrophic forgetting in embodied agents that learn continuously. We set out to explore whether inhibitory plasticity could play that role instead, regulating both the population sparseness and the average firing rates. We put the idea to the test in a hybrid network where rate-based dendritic compartments integrate the feedforward input, while spiking somas compete through recurrent inhibition. A somato-dendritic learning rule allows somatic inhibition to modulate nonlinear Hebbian learning in the dendrites. Trained on MNIST digits and natural images, the network discovers independent components that form a sparse encoding of the input and support linear decoding. These findings con-firm that intrinsic plasticity is not strictly required for regulating sparseness: inhibitory plasticity can have the same effect, although that mechanism comes with its own stability-plasticity dilemma. Going beyond point neuron models, the network illustrates how a learning rule can make use of dendrites and compartmentalised inputs; it also suggests a functional interpretation for clustered somatic inhibition in cortical neurons.Peer reviewe

A synaptic learning rule for exploiting nonlinear dendritic computation

Information processing in the brain depends on the integration of synaptic input distributed throughout neuronal dendrites. Dendritic integration is a hierarchical process, proposed to be equivalent to integration by a multilayer network, potentially endowing single neurons with substantial computational power. However, whether neurons can learn to harness dendritic properties to realize this potential is unknown. Here, we develop a learning rule from dendritic cable theory and use it to investigate the processing capacity of a detailed pyramidal neuron model. We show that computations using spatial or temporal features of synaptic input patterns can be learned, and even synergistically combined, to solve a canonical nonlinear feature-binding problem. The voltage dependence of the learning rule drives coactive synapses to engage dendritic nonlinearities, whereas spike-timing dependence shapes the time course of subthreshold potentials. Dendritic input-output relationships can therefore be flexibly tuned through synaptic plasticity, allowing optimal implementation of nonlinear functions by single neurons

Inhibitory Regulation of Dendritic Activity in vivo

The spatiotemporal control of neuronal excitability is fundamental to the inhibitory process. We now have a wealth of information about the active dendritic properties of cortical neurons including axonally generated sodium action potentials as well as local sodium spikelets generated in the dendrites, calcium plateau spikes, and NMDA spikes. All of these events have been shown to be highly modified by the spatiotemporal pattern of nearby inhibitory input which can drastically change the output firing mode of the neuron. This means that particular populations of interneurons embedded in the neocortical microcircuitry can more precisely control pyramidal cell output than has previously been thought. Furthermore, the output of any given neuron tends to feed back onto inhibitory circuits making the resultant network activity further dependent on inhibition. Network activity is therefore ultimately governed by the subcellular microcircuitry of the cortex and it is impossible to ignore the subcompartmentalization of inhibitory influence at the neuronal level in order to understand its effects at the network level. In this article, we summarize the inhibitory circuits that have been shown so far to act on specific dendritic compartments in vivo

Inhibition Controls Asynchronous States of Neuronal Networks

Computations in cortical circuits require action potentials from excitatory and inhibitory neurons. In this mini-review, I first provide a quick overview of findings that indicate that GABAergic neurons play a fundamental role in coordinating spikes and generating synchronized network activity. Next, I argue that these observations helped popularize the notion that network oscillations require a high degree of spike correlations among interneurons which, in turn, produce synchronous inhibition of the local microcircuit. The aim of this text is to discuss some recent experimental and computational findings that support a complementary view: one in which interneurons participate actively in producing asynchronous states in cortical networks. This requires a proper mixture of shared excitation and inhibition leading to asynchronous activity between neighboring cells. Such contribution from interneurons would be extremely important because it would tend to reduce the spike correlation between neighboring pyramidal cells, a drop in redundancy that could enhance the information-processing capacity of neural networks

Silences, Spikes and Bursts: Three-Part Knot of the Neural Code

When a neuron breaks silence, it can emit action potentials in a number of patterns. Some responses are so sudden and intense that electrophysiologists felt the need to single them out, labeling action potentials emitted at a particularly high frequency with a metonym -- bursts. Is there more to bursts than a figure of speech? After all, sudden bouts of high-frequency firing are expected to occur whenever inputs surge. The burst coding hypothesis advances that the neural code has three syllables: silences, spikes and bursts. We review evidence supporting this ternary code in terms of devoted mechanisms for burst generation, synaptic transmission and synaptic plasticity. We also review the learning and attention theories for which such a triad is beneficial.Comment: 15 pages, 4 figure

Active dendrites enable strong but sparse inputs to determine orientation selectivity

The dendrites of neocortical pyramidal neurons are excitable. However, it is unknown how synaptic inputs engage nonlinear dendritic mechanisms during sensory processing in vivo, and how they in turn influence action potential output. Here, we provide a quantitative account of the relationship between synaptic inputs, nonlinear dendritic events, and action potential output. We developed a detailed pyramidal neuron model constrained by in vivo dendritic recordings. We drive this model with realistic input patterns constrained by sensory responses measured in vivo and connectivity measured in vitro. We show mechanistically that under realistic conditions, dendritic Na+ and NMDA spikes are the major determinants of neuronal output in vivo. We demonstrate that these dendritic spikes can be triggered by a surprisingly small number of strong synaptic inputs, in some cases even by single synapses. We predict that dendritic excitability allows the 1% strongest synaptic inputs of a neuron to control the tuning of its output. Active dendrites therefore allow smaller subcircuits consisting of only a few strongly connected neurons to achieve selectivity for specific sensory features.</jats:p

Causal Evidence for the Role of Specific GABAergic Interneuron Types in Entorhinal Recruitment of Dentate Granule Cells

The dentate gyrus (DG) is the primary gate of the hippocampus and controls information flow from the cortex to the hippocampus proper. To maintain normal function, granule cells (GCs), the principal neurons in the DG, receive fine- tuned inhibition from local-circuit GABAergic inhibitory interneurons (INs). Abnormalities of GABAergic circuits in the DG are associated with several brain disorders, including epilepsy, autism, schizophrenia, and Alzheimer disease. Therefore, understanding the network mechanisms of inhibitory control of GCs is of functional and pathophysiological importance. GABAergic inhibitory INs are heterogeneous, but it is unclear how individual subtypes contribute to GC activity. Using cell-type-specific optogenetic perturbation, we investigated whether and how two major IN populations defined by parvalbumin (PV) and somatostatin (SST) expression, regulate GC input transformations. We showed that PV-expressing (PV+) INs, and not SST- expressing (SST+) INs, primarily suppress GC responses to single cortical stimulation. In addition, these two IN classes differentially regulate GC responses to θ and γ frequency inputs from the cortex. Notably, PV+ INs specifically control the onset of the spike series, whereas SST+ INs preferentially regulate the later spikes in the series. Together, PV+ and SST+ GABAergic INs engage differentially in GC input-output transformations in response to various activity patterns

Steep, Spatially Graded Recruitment of Feedback Inhibition by Sparse Dentate Granule Cell Activity

The dentate gyrus of the hippocampus is thought to subserve important physiological functions, such as 'pattern separation'. In chronic temporal lobe epilepsy, the dentate gyrus constitutes a strong inhibitory gate for the propagation of seizure activity into the hippocampus proper. Both examples are thought to depend critically on a steep recruitment of feedback inhibition by active dentate granule cells. Here, I used two complementary experimental approaches to quantitatively investigate the recruitment of feedback inhibition in the dentate gyrus. I showed that the activity of approximately 4% of granule cells suffices to recruit maximal feedback inhibition within the local circuit. Furthermore, the inhibition elicited by a local population of granule cells is distributed non-uniformly over the extent of the granule cell layer. Locally and remotely activated inhibition differ in several key aspects, namely their amplitude, recruitment, latency and kinetic properties. Finally, I show that net feedback inhibition facilitates during repetitive stimulation. Taken together, these data provide the first quantitative functional description of a canonical feedback inhibitory microcircuit motif. They establish that sparse granule cell activity, within the range observed in-vivo, steeply recruits spatially and temporally graded feedback inhibition

Sodium channel distribution in the apical dendrites of pyramidal cells vary in the hindbrain of Apteronotus leptorhynchus.

Apteronotid weakly electric fish heavily rely on their electrosensory system for behaviors like spatial navigation, communication and prey capture. Since the behaviorally important information about their environment is contained in the spatial and temporal modulations of the electrosensory signal, efficient mechanisms to process this information with great fidelity are of the utmost importance. Efficient sensory processing often involves having multiple parallel processing streams so that each stream can specialize to treat signals with different properties. This strategy requires the response properties and neural dynamic to be adjusted in each pathway to implement different neural coding strategies. One of the neural coding strategies employed by the primary electrosensory area is to use bursts of spikes in response to specific temporal features of the signal - a coding strategy described as feature-extraction. Burst generation relies on dendritic voltage-gated sodium channels (Nav channels) expressed on pyramidal cell apical dendrites to support the active backpropagation of somatic spikes and the generation of depolarizing after-potentials. The presence and role of these Nav channels is well documented but variation in their expression across processing stream has not been investigated. Considering that many of the other ion channels expressed in these cells show differences across pathways, we hypothesize that Nav expression varies across the 3 electrosensory lateral line segments (lateral, centro-lateral and centro-medial segments; LS, CLS, CMS respectively) representing different processing streams. We used immunocytochemistry and confocal imaging of hindbrain slices to quantify differences in density and distribution of Nav channels in the apical dendrites of pyramidal cells. The dendritic Nav channel distribution follows a mediolateral gradient with lateral segment of the ELL exhibiting the highest density. We also found that dendritic Nav channel densities remain fairly constant across the proximal and distal locations of the apical dendrites across maps with CMS showing slightly higher Nav density in distal regions. We argue that the differences we observed may contribute to shaping the response properties and the specialization of each processing stream thereby contributing to the efficiency of the sensory system

A laminar organization for selective cortico-cortical communication

The neocortex is central to mammalian cognitive ability, playing critical roles in sensory perception, motor skills and executive function. This thin, layered structure comprises distinct, functionally specialized areas that communicate with each other through the axons of pyramidal neurons. For the hundreds of such cortico-cortical pathways to underlie diverse functions, their cellular and synaptic architectures must differ so that they result in distinct computations at the target projection neurons. In what ways do these pathways differ? By originating and terminating in different laminae, and by selectively targeting specific populations of excitatory and inhibitory neurons, these “interareal” pathways can differentially control the timing and strength of synaptic inputs onto individual neurons, resulting in layer-specific computations. Due to the rapid development in transgenic techniques, the mouse has emerged as a powerful mammalian model for understanding the rules by which cortical circuits organize and function. Here we review our understanding of how cortical lamination constrains long-range communication in the mammalian brain, with an emphasis on the mouse visual cortical network. We discuss the laminar architecture underlying interareal communication, the role of neocortical layers in organizing the balance of excitatory and inhibitory actions, and highlight the structure and function of layer 1 in mouse visual cortex