Evolving spiking networks with variable resistive memories

Neuromorphic computing is a brainlike information processing paradigm that requires adaptive learning mechanisms. A spiking neuro-evolutionary system is used for this purpose; plastic resistive memories are implemented as synapses in spiking neural networks. The evolutionary design process exploits parameter self-adaptation and allows the topology and synaptic weights to be evolved for each network in an autonomous manner. Variable resistive memories are the focus of this research; each synapse has its own conductance profile which modifies the plastic behaviour of the device and may be altered during evolution. These variable resistive networks are evaluated on a noisy robotic dynamic-reward scenario against two static resistive memories and a system containing standard connections only. The results indicate that the extra behavioural degrees of freedom available to the networks incorporating variable resistive memories enable them to outperform the comparative synapse types. © 2014 by the Massachusetts Institute of Technology

Spiking memristor logic gates are a type of time-variant perceptron

Memristors are low-power memory-holding resistors thought to be useful for neuromophic computing, which can compute via spike-interactions mediated through the device's short-term memory. Using interacting spikes, it is possible to build an AND gate that computes OR at the same time, similarly a full adder can be built that computes the arithmetical sum of its inputs. Here we show how these gates can be understood by modelling the memristors as a novel type of perceptron: one which is sensitive to input order. The memristor's memory can change the input weights for later inputs, and thus the memristor gates cannot be accurately described by a single perceptron, requiring either a network of time-invarient perceptrons or a complex time-varying self-reprogrammable perceptron. This work demonstrates the high functionality of memristor logic gates, and also that the addition of theasholding could enable the creation of a standard perceptron in hardware, which may have use in building neural net chips.Comment: 8 pages, 3 figures. Poster presentation at a conferenc

Multi-objective evolutionary algorithms of spiking neural networks

Spiking neural network (SNN) is considered as the third generation of artificial neural networks. Although there are many models of SNN, Evolving Spiking Neural Network (ESNN) is widely used in many recent research works. Among the many important issues that need to be explored in ESNN are determining the optimal pre-synaptic neurons and parameters values for a given data set. Moreover, previous studies have not investigated the performance of the multi-objective approach with ESNN. In this study, the aim is to find the optimal pre-synaptic neurons and parameter values for ESNN simultaneously by proposing several integrations between ESNN and differential evolution (DE). The proposed algorithms applied to address these problems include DE with evolving spiking neural network (DE-ESNN) and DE for parameter tuning with evolving spiking neural network (DEPT-ESNN). This study also utilized the approach of multi-objective (MOO) with ESNN for better learning structure and classification accuracy. Harmony Search (HS) and memetic approach was used to improve the performance of MOO with ESNN. Consequently, Multi- Objective Differential Evolution with Evolving Spiking Neural Network (MODE-ESNN), Harmony Search Multi-Objective Differential Evolution with Evolving Spiking Neural Network (HSMODE-ESNN) and Memetic Harmony Search Multi-Objective Differential Evolution with Evolving Spiking Neural Network (MEHSMODE-ESNN) were applied to improve ESNN structure and accuracy rates. The hybrid methods were tested by using seven benchmark data sets from the machine learning repository. The performance was evaluated using different criteria such as accuracy (ACC), geometric mean (GM), sensitivity (SEN), specificity (SPE), positive predictive value (PPV), negative predictive value (NPV) and average site performance (ASP) using k-fold cross validation. Evaluation analysis shows that the proposed methods demonstrated better classification performance as compared to the standard ESNN especially in the case of imbalanced data sets. The findings revealed that the MEHSMODE-ESNN method statistically outperformed all the other methods using the different data sets and evaluation criteria. It is concluded that multi objective proposed methods have been evinced as the best proposed methods for most of the data sets used in this study. The findings have proven that the proposed algorithms attained the optimal presynaptic neurons and parameters values and MOO approach was applicable for the ESNN

Memristors

This Edited Volume Memristors - Circuits and Applications of Memristor Devices is a collection of reviewed and relevant research chapters, offering a comprehensive overview of recent developments in the field of Engineering. The book comprises single chapters authored by various researchers and edited by an expert active in the physical sciences, engineering, and technology research areas. All chapters are complete in itself but united under a common research study topic. This publication aims at providing a thorough overview of the latest research efforts by international authors on physical sciences, engineering, and technology,and open new possible research paths for further novel developments