35,917 research outputs found
Echo State Networks: analysis, training and predictive control
The goal of this paper is to investigate the theoretical properties, the
training algorithm, and the predictive control applications of Echo State
Networks (ESNs), a particular kind of Recurrent Neural Networks. First, a
condition guaranteeing incremetal global asymptotic stability is devised. Then,
a modified training algorithm allowing for dimensionality reduction of ESNs is
presented. Eventually, a model predictive controller is designed to solve the
tracking problem, relying on ESNs as the model of the system. Numerical results
concerning the predictive control of a nonlinear process for pH neutralization
confirm the effectiveness of the proposed algorithms for the identification,
dimensionality reduction, and the control design for ESNs.Comment: 6 pages,5 figures, submitted to European Control Conference (ECC
Deep learning for time series classification: a review
Time Series Classification (TSC) is an important and challenging problem in
data mining. With the increase of time series data availability, hundreds of
TSC algorithms have been proposed. Among these methods, only a few have
considered Deep Neural Networks (DNNs) to perform this task. This is surprising
as deep learning has seen very successful applications in the last years. DNNs
have indeed revolutionized the field of computer vision especially with the
advent of novel deeper architectures such as Residual and Convolutional Neural
Networks. Apart from images, sequential data such as text and audio can also be
processed with DNNs to reach state-of-the-art performance for document
classification and speech recognition. In this article, we study the current
state-of-the-art performance of deep learning algorithms for TSC by presenting
an empirical study of the most recent DNN architectures for TSC. We give an
overview of the most successful deep learning applications in various time
series domains under a unified taxonomy of DNNs for TSC. We also provide an
open source deep learning framework to the TSC community where we implemented
each of the compared approaches and evaluated them on a univariate TSC
benchmark (the UCR/UEA archive) and 12 multivariate time series datasets. By
training 8,730 deep learning models on 97 time series datasets, we propose the
most exhaustive study of DNNs for TSC to date.Comment: Accepted at Data Mining and Knowledge Discover
Nano-scale reservoir computing
This work describes preliminary steps towards nano-scale reservoir computing
using quantum dots. Our research has focused on the development of an
accumulator-based sensing system that reacts to changes in the environment, as
well as the development of a software simulation. The investigated systems
generate nonlinear responses to inputs that make them suitable for a physical
implementation of a neural network. This development will enable
miniaturisation of the neurons to the molecular level, leading to a range of
applications including monitoring of changes in materials or structures. The
system is based around the optical properties of quantum dots. The paper will
report on experimental work on systems using Cadmium Selenide (CdSe) quantum
dots and on the various methods to render the systems sensitive to pH, redox
potential or specific ion concentration. Once the quantum dot-based systems are
rendered sensitive to these triggers they can provide a distributed array that
can monitor and transmit information on changes within the material.Comment: 8 pages, 9 figures, accepted for publication in Nano Communication
Networks, http://www.journals.elsevier.com/nano-communication-networks/. An
earlier version was presented at the 3rd IEEE International Workshop on
Molecular and Nanoscale Communications (IEEE MoNaCom 2013
- …