Optoelectronic Reservoir Computing

Reservoir computing is a recently introduced, highly efficient bio-inspired approach for processing time dependent data. The basic scheme of reservoir computing consists of a non linear recurrent dynamical system coupled to a single input layer and a single output layer. Within these constraints many implementations are possible. Here we report an opto-electronic implementation of reservoir computing based on a recently proposed architecture consisting of a single non linear node and a delay line. Our implementation is sufficiently fast for real time information processing. We illustrate its performance on tasks of practical importance such as nonlinear channel equalization and speech recognition, and obtain results comparable to state of the art digital implementations.Comment: Contains main paper and two Supplementary Material

Modelling Reservoir Computing with the Discrete Nonlinear Schr\"odinger Equation

We formulate, using the discrete nonlinear Schroedinger equation (DNLS), a general approach to encode and process information based on reservoir computing. Reservoir computing is a promising avenue for realizing neuromorphic computing devices. In such computing systems, training is performed only at the output level, by adjusting the output from the reservoir with respect to a target signal. In our formulation, the reservoir can be an arbitrary physical system, driven out of thermal equilibrium by an external driving. The DNLS is a general oscillator model with broad application in physics and we argue that our approach is completely general and does not depend on the physical realisation of the reservoir. The driving, which encodes the object to be recognised, acts as a thermodynamical force, one for each node in the reservoir. Currents associated to these thermodynamical forces in turn encode the output signal from the reservoir. As an example, we consider numerically the problem of supervised learning for pattern recognition, using as reservoir a network of nonlinear oscillators.Comment: 5 pages, 4 figure

Optical signal processing with a network of semiconductor optical amplifiers in the context of photonic reservoir computing

Photonic reservoir computing is a hardware implementation of the concept of reservoir computing which comes from the field of machine learning and artificial neural networks. This concept is very useful for solving all kinds of classification and recognition problems. Examples are time series prediction, speech and image recognition. Reservoir computing often competes with the state-of-the-art. Dedicated photonic hardware would offer advantages in speed and power consumption. We show that a network of coupled semiconductor optical amplifiers can be used as a reservoir by using it on a benchmark isolated words recognition task. The results are comparable to existing software implementations and fabrication tolerances can actually improve the robustness

Practical approaches to exploiting body dynamics in robot motor control

Motor control systems in the brain of humans and mammals are hierarchically organised, with each level controlling increasingly complex motor actions. Each level is controlled by the higher levels and also receives sensory and/or proprioceptive feedback. Through learning, this hierarchical structure adapts to its body, its sensors and the way these interact with the environment. An even more integrated view is taken in morphological or embodied computation. On the one hand, there is both biological and mechanical (robotics) evidence that a properly chosen body morphology can drastically facilitate control when the body dynamics naturally generate low level motion primitives. On the other hand, several papers have used robot bodies as reservoirs in a reservoir computing setup. In some cases, reservoir computing was used as an easy way to obtain robust linear feedback controllers for locomotion. In other cases, the body dynamics of soft robots were shown to perform general computations in response to some input stimulation. In general, very specific highly compliant bodies were used. At Ghent University’s Reservoir Lab, we have previously used reservoir computing to generate locomotion on quite different robot platforms: the highly compliant tensegrity robot Recter and the far less compliant quadruped robot Oncilla and a new low cost modular quadruped puppy robot. In all cases, we succeeded in generating stable gaits. However, not surprisingly, not all robot bodies are equally suitable to help generating their own motor actuations. As a result, the reservoir computing principle alone was not always sufficient. We present an overview of our experience with these different robot platforms and give practical guidelines for applying physical reservoir computing to new robots. We finally discuss some perspectives on a more systematic evaluation between body morphology, compliance and the complexity of generating stable gaits for locomotion

A Comparative Study of Reservoir Computing for Temporal Signal Processing

Reservoir computing (RC) is a novel approach to time series prediction using recurrent neural networks. In RC, an input signal perturbs the intrinsic dynamics of a medium called a reservoir. A readout layer is then trained to reconstruct a target output from the reservoir's state. The multitude of RC architectures and evaluation metrics poses a challenge to both practitioners and theorists who study the task-solving performance and computational power of RC. In addition, in contrast to traditional computation models, the reservoir is a dynamical system in which computation and memory are inseparable, and therefore hard to analyze. Here, we compare echo state networks (ESN), a popular RC architecture, with tapped-delay lines (DL) and nonlinear autoregressive exogenous (NARX) networks, which we use to model systems with limited computation and limited memory respectively. We compare the performance of the three systems while computing three common benchmark time series: H{\'e}non Map, NARMA10, and NARMA20. We find that the role of the reservoir in the reservoir computing paradigm goes beyond providing a memory of the past inputs. The DL and the NARX network have higher memorization capability, but fall short of the generalization power of the ESN

Reservoir Computing Approach to Robust Computation using Unreliable Nanoscale Networks

As we approach the physical limits of CMOS technology, advances in materials science and nanotechnology are making available a variety of unconventional computing substrates that can potentially replace top-down-designed silicon-based computing devices. Inherent stochasticity in the fabrication process and nanometer scale of these substrates inevitably lead to design variations, defects, faults, and noise in the resulting devices. A key challenge is how to harness such devices to perform robust computation. We propose reservoir computing as a solution. In reservoir computing, computation takes place by translating the dynamics of an excited medium, called a reservoir, into a desired output. This approach eliminates the need for external control and redundancy, and the programming is done using a closed-form regression problem on the output, which also allows concurrent programming using a single device. Using a theoretical model, we show that both regular and irregular reservoirs are intrinsically robust to structural noise as they perform computation