Neuro-memristive Circuits for Edge Computing: A review

The volume, veracity, variability, and velocity of data produced from the ever-increasing network of sensors connected to Internet pose challenges for power management, scalability, and sustainability of cloud computing infrastructure. Increasing the data processing capability of edge computing devices at lower power requirements can reduce several overheads for cloud computing solutions. This paper provides the review of neuromorphic CMOS-memristive architectures that can be integrated into edge computing devices. We discuss why the neuromorphic architectures are useful for edge devices and show the advantages, drawbacks and open problems in the field of neuro-memristive circuits for edge computing

On Real-Time AER 2-D Convolutions Hardware for Neuromorphic Spike-Based Cortical Processing

In this paper, a chip that performs real-time image convolutions with programmable kernels of arbitrary shape is presented. The chip is a first experimental prototype of reduced size to validate the implemented circuits and system level techniques. The convolution processing is based on the address–event-representation (AER) technique, which is a spike-based biologically inspired image and video representation technique that favors communication bandwidth for pixels with more information. As a first test prototype, a pixel array of 16x16 has been implemented with programmable kernel size of up to 16x16. The chip has been fabricated in a standard 0.35- m complimentary metal–oxide–semiconductor (CMOS) process. The technique also allows to process larger size images by assembling 2-D arrays of such chips. Pixel operation exploits low-power mixed analog–digital circuit techniques. Because of the low currents involved (down to nanoamperes or even picoamperes), an important amount of pixel area is devoted to mismatch calibration. The rest of the chip uses digital circuit techniques, both synchronous and asynchronous. The fabricated chip has been thoroughly tested, both at the pixel level and at the system level. Specific computer interfaces have been developed for generating AER streams from conventional computers and feeding them as inputs to the convolution chip, and for grabbing AER streams coming out of the convolution chip and storing and analyzing them on computers. Extensive experimental results are provided. At the end of this paper, we provide discussions and results on scaling up the approach for larger pixel arrays and multilayer cortical AER systems.Commission of the European Communities IST-2001-34124 (CAVIAR)Commission of the European Communities 216777 (NABAB)Ministerio de Educación y Ciencia TIC-2000-0406-P4Ministerio de Educación y Ciencia TIC-2003-08164-C03-01Ministerio de Educación y Ciencia TEC2006-11730-C03-01Junta de Andalucía TIC-141

Multilayer optical learning networks

A new approach to learning in a multilayer optical neural network based on holographically interconnected nonlinear devices is presented. The proposed network can learn the interconnections that form a distributed representation of a desired pattern transformation operation. The interconnections are formed in an adaptive and self-aligning fashioias volume holographic gratings in photorefractive crystals. Parallel arrays of globally space-integrated inner products diffracted by the interconnecting hologram illuminate arrays of nonlinear Fabry-Perot etalons for fast thresholding of the transformed patterns. A phase conjugated reference wave interferes with a backward propagating error signal to form holographic interference patterns which are time integrated in the volume of a photorefractive crystal to modify slowly and learn the appropriate self-aligning interconnections. This multilayer system performs an approximate implementation of the backpropagation learning procedure in a massively parallel high-speed nonlinear optical network

Estimation of real traffic radiated emissions from electric vehicles in terms of the driving profile using neural networks

The increment of the use of electric vehicles leads to a worry about measuring its principal source of environmental pollution: electromagnetic emissions. Given the complexity of directly measuring vehicular radiated emissions in real traffic, the main contribution of this PhD thesis is to propose an indirect solution to estimate such type of vehicular emissions. Relating the on-road vehicular radiated emissions with the driving profile is a complicated task. This is because it is not possible to directly measure the vehicular radiated interferences in real traffic due to potential interferences from another electromagnetic wave sources. This thesis presents a microscopic artificial intelligence model based on neural networks to estimate real traffic radiated emissions of electric vehicles in terms of the driving dynamics. Instantaneous values of measured speed and calculated acceleration have been used to characterize the driving profile. Experimental electromagnetic interference tests have been carried out with a Vectrix electric motorcycle as well as Twizy electric cars in semi-anechoic chambers. Both the motorcycle and the car have been subjected to different urban and interurban driving profiles. Time Domain measurement methodology of electromagnetic radiated emissions has been adopted in this work to save the overall measurement time. The relationship between the magnetic radiated emissions of the Twizy and the corresponding speed has been very noticeable. Maximum magnetic field levels have been observed during high speed cruising in extra-urban driving and acceleration in urban environments. A comparative study of the prediction performance between various static and dynamic neural models has been introduced. The Multilayer Perceptron feedforward neural network trained with Extreme Learning Machines has achieved the best estimation results of magnetic radiated disturbances as function of instantaneous speed and acceleration. In this way, on-road magnetic radiated interferences from an electric vehicle equipped with a Global Positioning System can be estimated. This research line will allow quantify the pollutant electromagnetic emissions of electric vehicles and study new policies to preserve the environment

Estimation of real traffic radiated emissions from electric vehicles in terms of the driving profile using neural networks

The increment of the use of electric vehicles leads to a worry about measuring its principal source of environmental pollution: electromagnetic emissions. Given the complexity of directly measuring vehicular radiated emissions in real traffic, the main contribution of this PhD thesis is to propose an indirect solution to estimate such type of vehicular emissions. Relating the on-road vehicular radiated emissions with the driving profile is a complicated task. This is because it is not possible to directly measure the vehicular radiated interferences in real traffic due to potential interferences from another electromagnetic wave sources. This thesis presents a microscopic artificial intelligence model based on neural networks to estimate real traffic radiated emissions of electric vehicles in terms of the driving dynamics. Instantaneous values of measured speed and calculated acceleration have been used to characterize the driving profile. Experimental electromagnetic interference tests have been carried out with a Vectrix electric motorcycle as well as Twizy electric cars in semi-anechoic chambers. Both the motorcycle and the car have been subjected to different urban and interurban driving profiles. Time Domain measurement methodology of electromagnetic radiated emissions has been adopted in this work to save the overall measurement time. The relationship between the magnetic radiated emissions of the Twizy and the corresponding speed has been very noticeable. Maximum magnetic field levels have been observed during high speed cruising in extra-urban driving and acceleration in urban environments. A comparative study of the prediction performance between various static and dynamic neural models has been introduced. The Multilayer Perceptron feedforward neural network trained with Extreme Learning Machines has achieved the best estimation results of magnetic radiated disturbances as function of instantaneous speed and acceleration. In this way, on-road magnetic radiated interferences from an electric vehicle equipped with a Global Positioning System can be estimated. This research line will allow quantify the pollutant electromagnetic emissions of electric vehicles and study new policies to preserve the environment

Investigation of Synapto-dendritic Kernel Adapting Neuron models and their use in spiking neuromorphic architectures

The motivation for this thesis is idea that abstract, adaptive, hardware efficient, inter-neuronal transfer functions (or kernels) which carry information in the form of postsynaptic membrane potentials, are the most important (and erstwhile missing) element in neuromorphic implementations of Spiking Neural Networks (SNN). In the absence of such abstract kernels, spiking neuromorphic systems must realize very large numbers of synapses and their associated connectivity. The resultant hardware and bandwidth limitations create difficult tradeoffs which diminish the usefulness of such systems. In this thesis a novel model of spiking neurons is proposed. The proposed Synapto-dendritic Kernel Adapting Neuron (SKAN) uses the adaptation of their synapto-dendritic kernels in conjunction with an adaptive threshold to perform unsupervised learning and inference on spatio-temporal spike patterns. The hardware and connectivity requirements of the neuron model are minimized through the use of simple accumulator-based kernels as well as through the use of timing information to perform a winner take all operation between the neurons. The learning and inference operations of SKAN are characterized and shown to be robust across a range of noise environments. Next, the SKAN model is augmented with a simplified hardware-efficient model of Spike Timing Dependent Plasticity (STDP). In biology STDP is the mechanism which allows neurons to learn spatio-temporal spike patterns. However when the proposed SKAN model is augmented with a simplified STDP rule, where the synaptic kernel is used as a binary flag that enable synaptic potentiation, the result is a synaptic encoding of afferent Signal to Noise Ratio (SNR). In this combined model the neuron not only learns the target spatio-temporal spike patterns but also weighs each channel independently according to its signal to noise ratio. Additionally a novel approach is presented to achieving homeostatic plasticity in digital hardware which reduces hardware cost by eliminating the need for multipliers. Finally the behavior and potential utility of this combined model is investigated in a range of noise conditions and the digital hardware resource utilization of SKAN and SKAN + STDP is detailed using Field Programmable Gate Arrays (FPGA)