A neuro-inspired system for online learning and recognition of parallel spike trains, based on spike latency and heterosynaptic STDP

Humans perform remarkably well in many cognitive tasks including pattern recognition. However, the neuronal mechanisms underlying this process are not well understood. Nevertheless, artificial neural networks, inspired in brain circuits, have been designed and used to tackle spatio-temporal pattern recognition tasks. In this paper we present a multineuronal spike pattern detection structure able to autonomously implement online learning and recognition of parallel spike sequences (i.e., sequences of pulses belonging to different neurons/neural ensembles). The operating principle of this structure is based on two spiking/synaptic neurocomputational characteristics: spike latency, that enables neurons to fire spikes with a certain delay and heterosynaptic plasticity, that allows the own regulation of synaptic weights. From the perspective of the information representation, the structure allows mapping a spatio-temporal stimulus into a multidimensional, temporal, feature space. In this space, the parameter coordinate and the time at which a neuron fires represent one specific feature. In this sense, each feature can be considered to span a single temporal axis. We applied our proposed scheme to experimental data obtained from a motor inhibitory cognitive task. The test exhibits good classification performance, indicating the adequateness of our approach. In addition to its effectiveness, its simplicity and low computational cost suggest a large scale implementation for real time recognition applications in several areas, such as brain computer interface, personal biometrics authentication or early detection of diseases.Comment: Submitted to Frontiers in Neuroscienc

Spatiotemporal Pattern Detection with Neuromorphic Circuits

In this dissertation, neuromorphic circuits are used to implement spiking neural networks in order to detect spatiotemporal patterns. Unsupervised training and detection-by-design techniques were used to attain the appropriate connectomes and perform pattern detection. Unsupervised training was performed by feeding random digital spikes with a repeating embedded spatiotemporal pattern to a spiking neural network composed of leaky integrate-and-fire neurons and memristor-R(t) element circuits which implement spike-timing-dependent plasticity learning rules. Detection-by-design was achieved using neuromporphic circuits and digital logic gates. When detection-by-design was achieved using both neuromorphic circuits and digital logic gates, a network was created of spatiotemporal pattern detector circuits, each of which was capable of detecting the three fundamental spatiotemporal patterns (NA-NA-Δt, NA-NB-Δt, and NA-NB-Coincidence), in order to detect combinations of two-spike features in the desired spatiotemporal pattern. The spatiotemporal pattern was detected when all of the two-spike features were detected. Similarly, when detection-by-design was achieved using only neuromorphic circuits, a Complex Pattern Detecting Network was was formed by combining Simple Pattern Detecting Networks, each of which was capable of detecting the three fundamental spatiotemporal patterns. The Complex Pattern Detector was used in a proof-of-concept to demonstrate a detect-and-generate spatiotemporal symbol computing paradigm

Neuromorphic Engineering Editors' Pick 2021

This collection showcases well-received spontaneous articles from the past couple of years, which have been specially handpicked by our Chief Editors, Profs. André van Schaik and Bernabé Linares-Barranco. The work presented here highlights the broad diversity of research performed across the section and aims to put a spotlight on the main areas of interest. All research presented here displays strong advances in theory, experiment, and methodology with applications to compelling problems. This collection aims to further support Frontiers’ strong community by recognizing highly deserving authors

Time-Warp–Invariant Neuronal Processing

A biophysical mechanism acting in auditory neurons allows the brain to process the high variability of speaking rates in natural speech in a time-warp-invariant manner

Deep Spiking Neural Network model for time-variant signals classification: a real-time speech recognition approach

Speech recognition has become an important task to improve the human-machine interface. Taking into account the limitations of current automatic speech recognition systems, like non-real time cloud-based solutions or power demand, recent interest for neural networks and bio-inspired systems has motivated the implementation of new techniques. Among them, a combination of spiking neural networks and neuromorphic auditory sensors offer an alternative to carry out the human-like speech processing task. In this approach, a spiking convolutional neural network model was implemented, in which the weights of connections were calculated by training a convolutional neural network with specific activation functions, using firing rate-based static images with the spiking information obtained from a neuromorphic cochlea. The system was trained and tested with a large dataset that contains ”left” and ”right” speech commands, achieving 89.90% accuracy. A novel spiking neural network model has been proposed to adapt the network that has been trained with static images to a non-static processing approach, making it possible to classify audio signals and time series in real time.Ministerio de Economía y Competitividad TEC2016-77785-

Somatodendritic consistency check for temporal feature segmentation

The brain identifies potentially salient features within continuous information streams to process hierarchical temporal events. This requires the compression of information streams, for which effective computational principles are yet to be explored. Backpropagating action potentials can induce synaptic plasticity in the dendrites of cortical pyramidal neurons. By analogy with this effect, we model a self-supervising process that increases the similarity between dendritic and somatic activities where the somatic activity is normalized by a running average. We further show that a family of networks composed of the two-compartment neurons performs a surprisingly wide variety of complex unsupervised learning tasks, including chunking of temporal sequences and the source separation of mixed correlated signals. Common methods applicable to these temporal feature analyses were previously unknown. Our results suggest the powerful ability of neural networks with dendrites to analyze temporal features. This simple neuron model may also be potentially useful in neural engineering applications

Temporal Coding and Learning in Spiking Neural Networks

Ph.DDOCTOR OF PHILOSOPH