Hardware implementation of a spiking neural network for fast synchronization

In this master thesis, we present two different hardware implementations of the Oscillatory Dynamic Link Matcher (ODLM). The ODLM is an algorithm which uses the synchronization in a network of spiking neurons to realize different signal processing tasks. The main objective of this work is to identify the key design choices leading to the efficient implementation of an embedded version of the ODLM. The resulting systems have been tested with image segmentation and image matching tasks. The first system is bit-slice and time-driven. The state of the whole network is updated at regular time intervals. The system uses a bit-slice architecture with a large number of processing elements. Each processing element, or slice, implements one neuron of the network and takes the form of a column on the hardware. The columns are placed side by side and they are locally connected to their 2 neighbors. This local hardware connection scheme makes the system scalable, which means that columns can be easily added to increase the capacity of the system. Each column consists of a weight vector, a synapse model unit and a membrane model unit. The system can implement any network topology, making it very flexible. The function governing the time evolution of the neurons' membrane potential is approximated by a piece-wise linear function to reduce the amount of logical resources required. With this system, a fully-connected network of 648 neurons can be implemented on a Virtex-5 Xilinx XC5VSX5OT FPGA clocked at 100 MHz. The system is designed to process simultaneous spikes in parallel, reaching a maximum processing speed of 6 Mspikes/s. It can segment a 23×23 pixel image in 2 seconds and match two pre-segmented 90×30 pixel images in 550 ms. The second system is event-driven. A single processing element sequentially processes the spikes. This processing element is a 5-stage pipeline which can process an average of 1 synapse per 7 clock cycles. The synaptic weights are not stored in memory in this system, they are computed on-the-fly as spikes are processed. The topology of the network is also resolved during operation, and the system supports various regular topologies like 8-neighbor and fully-connected. The membrane potential time evolution function is computed with high precision using a look-up table. On the Virtex-5 FPGA, a network of 65 536 neurons can be implemented and a 406×158 pixel image can be segmented in 200 ms. The FPGA can be clocked at 100 MHz. Most of the design choices made for the second system are well adapted to the hardware implementation of the ODLM. In the original ODLM, the weight values do not change over time and usually depend on a single variable. It is therefore beneficial to compute the weights on the fly rather than saving them in a huge memory bank. The event-driven approach is a very efficient strategy. It reduces the amount of computations required to run the network and the amount of data moved in and out of memory. Finally, the precise computation of the neurons' membrane potential increases the convergence speed of the network

Event management for large scale event-driven digital hardware spiking neural networks

Abstract : The interest in brain-like computation has led to the design of a plethora of innovative neuromorphic systems. Individually, spiking neural networks (SNNs), event-driven simulation and digital hardware neuromorphic systems get a lot of attention. Despite the popularity of event-driven SNNs in soft- ware, very few digital hardware architectures are found. This is because existing hardware solutions for event management scale badly with the number of events. This paper introduces the structured heap queue, a pipelined digital hardware data structure, and demonstrates its suitability for event management. The structured heap queue scales gracefully with the number of events, allowing the efficient implementation of large scale digital hardware event-driven SNNs. The scaling is linear for memory, logarithmic for logic resources and constant for processing time. The use of the structured heap queue is demonstrated on eld-programmable gate array (FPGA) with an image segmentation experiment and a SNN of 65 536 neurons and 513 184 synapses. Events can be processed at the rate of 1 every 7 clock cycles and a 406 x 158 pixel image is segmented in 200 ms

Brain at work : time, sparseness and superposition principles

Abstract : Many studies explored mechanisms through which the brain encodes sensory inputs allowing a coherent behavior. The brain could identify stimuli via a hierarchical stream of activity leading to a cardinal neuron responsive to one particular object. The opportunity to record from numerous neurons offered investigators the capability of examining simultaneously the functioning of many cells. These approaches suggested encoding processes that are parallel rather than serial. Binding the many features of a stimulus may be accomplished through an induced synchronization of cell’s action potentials. These interpretations are supported by experimental data and offer many advantages but also several shortcomings. We argue for a coding mechanism based on a sparse synchronization paradigm. We show that synchronization of spikes is a fast and efficient mode to encode the representation of objects based on feature bindings. We introduce the view that sparse synchronization coding presents an interesting venue in probing brain encoding mechanisms as it allows the functional establishment of multilayered and time-conditioned neuronal networks or multislice networks. We propose a model based on integrate-and-fire spiking neurons

A Survey of Spiking Neural Network Accelerator on FPGA

Due to the ability to implement customized topology, FPGA is increasingly used to deploy SNNs in both embedded and high-performance applications. In this paper, we survey state-of-the-art SNN implementations and their applications on FPGA. We collect the recent widely-used spiking neuron models, network structures, and signal encoding formats, followed by the enumeration of related hardware design schemes for FPGA-based SNN implementations. Compared with the previous surveys, this manuscript enumerates the application instances that applied the above-mentioned technical schemes in recent research. Based on that, we discuss the actual acceleration potential of implementing SNN on FPGA. According to our above discussion, the upcoming trends are discussed in this paper and give a guideline for further advancement in related subjects

New Trends in Biologically-Inspired Audio Coding

This book chapter deals with the generation of auditory-inspired spectro-temporal features aimed at audio coding. To do so, we first generate sparse audio representations we call spikegrams, using projections on gammatone or gammachirp kernels that generate neural spikes. Unlike Fourier-based representations, these representations are powerful at identifying auditory events, such as onsets, offsets, transients and harmonic structures. We show that the introduction of adaptiveness in the selection of gammachirp kernels enhances the compression rate compared to the case where the kernels are non-adaptive. We also integrate a masking model that helps reduce bitrate without loss of perceptible audio quality. We then quantize coding values using the genetic algorithm that is more optimal than uniform quantization for this framework. We finally propose a method to extract frequent auditory objects (patterns) in the aforementioned sparse representations. The extracted frequency-domain patterns (auditory objects) help us address spikes (auditory events) collectively rather than individually. When audio compression is needed, the different patterns are stored in a small codebook that can be used to efficiently encode audio materials in a lossless way. The approach is applied to different audio signals and results are discussed and compared. This work is a first step towards the design of a high-quality auditory-inspired \"object-based\" audio coder

Identification and Characterization of electrical patterns underlying stereotyped behaviours in the semi-intact leech

Neuroscience aims at understanding the mechanisms underlying perception, learning, memory, consciousness and acts. The present Ph.D. thesis aims to elucidate some principles controlling actions, which in a more scientific and technical language is referred to as motor control. This concept has been studied in a variety of preparations in vertebrate and invertebrate species. In this PhD thesis, the leech has been the subject of choice, because it is a well known preparation, highly suitable for relating functional and behavioural properties to the underlying neuronal networks. The semi-intact leech preparation (Kristan et al., 1974) has been the main methodological strategy performed in the experiments. Its importance lies in the fact that it gives the possibility to access the information from the leech\u2019s central nervous system (CNS) and compare simultaneously some stereotyped behaviours. Thus, entering in this work it is necessary to make a brief summary of the steps followed before arriving to the conclusions written ahead. The main objective followed in this work has been the analysis, identification and characterization of electrical patterns underlying different behaviours in Hirudo medicinalis. This main objective has been reached focusing the project on three particular objectives, which have been pursued during the author\u2019s Philosophical Doctorate course

Visual Cortex

The neurosciences have experienced tremendous and wonderful progress in many areas, and the spectrum encompassing the neurosciences is expansive. Suffice it to mention a few classical fields: electrophysiology, genetics, physics, computer sciences, and more recently, social and marketing neurosciences. Of course, this large growth resulted in the production of many books. Perhaps the visual system and the visual cortex were in the vanguard because most animals do not produce their own light and offer thus the invaluable advantage of allowing investigators to conduct experiments in full control of the stimulus. In addition, the fascinating evolution of scientific techniques, the immense productivity of recent research, and the ensuing literature make it virtually impossible to publish in a single volume all worthwhile work accomplished throughout the scientific world. The days when a single individual, as Diderot, could undertake the production of an encyclopedia are gone forever. Indeed most approaches to studying the nervous system are valid and neuroscientists produce an almost astronomical number of interesting data accompanied by extremely worthy hypotheses which in turn generate new ventures in search of brain functions. Yet, it is fully justified to make an encore and to publish a book dedicated to visual cortex and beyond. Many reasons validate a book assembling chapters written by active researchers. Each has the opportunity to bind together data and explore original ideas whose fate will not fall into the hands of uncompromising reviewers of traditional journals. This book focuses on the cerebral cortex with a large emphasis on vision. Yet it offers the reader diverse approaches employed to investigate the brain, for instance, computer simulation, cellular responses, or rivalry between various targets and goal directed actions. This volume thus covers a large spectrum of research even though it is impossible to include all topics in the extremely diverse field of neurosciences

Combined measures of oxygenation, haemodynamics and metabolism to understand neural responses in infants

fNIRS is an established research tool used to investigate typical and atypical brain development.Primarily, it provides measures of haemodynamic changes that are used to indirectly infer neural activity. Broadband NIRS provides a more direct marker of neuronal activation through measurement of changes in cytochrome-c-oxidase (CCO). As a cellular measure, CCO can be used as a bridge to improve our understanding of the link between neural and haemodynamic activity or “neurovascular coupling”. Study 1 demonstrated that changes in mitochondrial activity could be measured alongside haemodynamics during functional activation, over the temporal cortex, using a miniature system in four-to-six-month-old infants. In order to investigate the spatial specificity of CCO, its relation to haemodynamics and to build upon our understanding of neurovascular coupling mechanisms, multi-channel broadband NIRS was used alongside EEG in Study 2 where responses were measured over the visual cortex. Study 2 was performed in adults as the development of a concurrent NIRS and EEG protocol was methodologically challenging. Following this, Study 3 extended on experimental paradigms from Studies 1 and 2 to measure changes in metabolic activity and haemodynamics over the temporal and visual cortices, in four-to-seven-month-old infants. This study demonstrated simultaneous broadband NIRS and EEG use in infants for the first time. The results provided evidence of underdeveloped coupling of cerebral blood flow changes and mitochondrial activity in early infancy. Finally, Study 4 extended the protocol to investigate underlying biological mechanisms that may be altered in neurovascular coupling in autism, by studying infants at high familial risk for the disorder. The findings demonstrated that the combined protocol was not only feasible for use to study atypical brain development but also provided preliminary evidence of altered coupling between cerebral energy metabolism and haemodynamics.Taken together, this work illuminates hitherto undocumented evidence of neurovascular coupling during brain development and highlights the potential of using broadband NIRS with EEG for future neurodevelopmental research in typical and atypical populations

Radical Artificial Intelligence: A Postmodern Approach

The dynamic response of end-clamped monolithic beams and sandwich beams has been measured by loading the beams at mid-span using metal foam projectiles. The AISI 304 stainless-steel sandwich beams comprise two identical face sheets and either prismatic Y-frame or corrugated cores. The resistance to shock loading is quantified by the permanent transverse deflection at mid-span of the beams as a function of projectile momentum. The prismatic cores are aligned either longitudinally along the beam length or transversely. It is found that the sandwich beams with a longitudinal core orientation have a higher shock resistance than the monolithic beams of equal mass. In contrast, the performance of the sandwich beams with a transverse core orientation is very similar to that of the monolithic beams. Three-dimensional finite element (FE) simulations are in good agreement with the measured responses. The FE calculations indicate that strain concentrations in the sandwich beams occur at joints within the cores and between the core and face sheets; the level of maximum strain is similar for the Y-frame and corrugated core beams for a given value of projectile momentum. The experimental and FE results taken together reveal that Y-frame and corrugated core sandwich beams of equal mass have similar dynamic performances in terms of rear-face deflection, degree of core compression and level of strain within the beam