6,243 research outputs found
Incremental construction of LSTM recurrent neural network
Long Short--Term Memory (LSTM) is a recurrent neural network that
uses structures called memory blocks to allow the net remember
significant events distant in the past input sequence in order to
solve long time lag tasks, where other RNN approaches fail.
Throughout this work we have performed experiments using LSTM
networks extended with growing abilities, which we call GLSTM.
Four methods of training growing LSTM has been compared. These
methods include cascade and fully connected hidden layers as well
as two different levels of freezing previous weights in the
cascade case. GLSTM has been applied to a forecasting problem in a biomedical domain, where the input/output behavior of five
controllers of the Central Nervous System control has to be
modelled. We have compared growing LSTM results against other
neural networks approaches, and our work applying conventional
LSTM to the task at hand.Postprint (published version
Modeling Financial Time Series with Artificial Neural Networks
Financial time series convey the decisions and actions of a population of human actors over time. Econometric and regressive models have been developed in the past decades for analyzing these time series. More recently, biologically inspired artificial neural network models have been shown to overcome some of the main challenges of traditional techniques by better exploiting the non-linear, non-stationary, and oscillatory nature of noisy, chaotic human interactions. This review paper explores the options, benefits, and weaknesses of the various forms of artificial neural networks as compared with regression techniques in the field of financial time series analysis.CELEST, a National Science Foundation Science of Learning Center (SBE-0354378); SyNAPSE program of the Defense Advanced Research Project Agency (HR001109-03-0001
How complex climate networks complement eigen techniques for the statistical analysis of climatological data
Eigen techniques such as empirical orthogonal function (EOF) or coupled
pattern (CP) / maximum covariance analysis have been frequently used for
detecting patterns in multivariate climatological data sets. Recently,
statistical methods originating from the theory of complex networks have been
employed for the very same purpose of spatio-temporal analysis. This climate
network (CN) analysis is usually based on the same set of similarity matrices
as is used in classical EOF or CP analysis, e.g., the correlation matrix of a
single climatological field or the cross-correlation matrix between two
distinct climatological fields. In this study, formal relationships as well as
conceptual differences between both eigen and network approaches are derived
and illustrated using exemplary global precipitation, evaporation and surface
air temperature data sets. These results allow to pinpoint that CN analysis can
complement classical eigen techniques and provides additional information on
the higher-order structure of statistical interrelationships in climatological
data. Hence, CNs are a valuable supplement to the statistical toolbox of the
climatologist, particularly for making sense out of very large data sets such
as those generated by satellite observations and climate model intercomparison
exercises.Comment: 18 pages, 11 figure
Impact of noise on a dynamical system: prediction and uncertainties from a swarm-optimized neural network
In this study, an artificial neural network (ANN) based on particle swarm
optimization (PSO) was developed for the time series prediction. The hybrid
ANN+PSO algorithm was applied on Mackey--Glass chaotic time series in the
short-term . The performance prediction was evaluated and compared with
another studies available in the literature. Also, we presented properties of
the dynamical system via the study of chaotic behaviour obtained from the
predicted time series. Next, the hybrid ANN+PSO algorithm was complemented with
a Gaussian stochastic procedure (called {\it stochastic} hybrid ANN+PSO) in
order to obtain a new estimator of the predictions, which also allowed us to
compute uncertainties of predictions for noisy Mackey--Glass chaotic time
series. Thus, we studied the impact of noise for several cases with a white
noise level () from 0.01 to 0.1.Comment: 11 pages, 8 figure
- …