A study on the ability of support vector regression and neural networks to forecast basic time series patterns

Recently, novel learning algorithms such as Support Vector Regression (SVR) and Neural Networks (NN) have received increasing attention in forecasting and time series prediction, offering attractive theoretical properties and successful applications in several real world problem domains. Commonly, time series are composed of the combination of regular and irregular patterns such as trends and cycles, seasonal variations, level shifts, outliers or pulses and structural breaks, among others. Conventional parametric statistical methods are capable of forecasting a particular combination of patterns through ex ante selection of an adequate model form and specific data preprocessing. Thus, the capability of semi-parametric methods from computational intelligence to predict basic time series patterns without model selection and preprocessing is of particular relevance in evaluating their contribution to forecasting. This paper proposes an empirical comparison between NN and SVR models using radial basis function (RBF) and linear kernel functions, by analyzing their predictive power on five artificial time series: stationary, additive seasonality, linear trend, linear trend with additive seasonality, and linear trend with multiplicative seasonality. Results obtained show that RBF SVR models have problems in extrapolating trends, while NN and linear SVR models without data preprocessing provide robust accuracy across all patterns and clearly outperform the commonly used RBF SVR on trended time series.IFIP International Conference on Artificial Intelligence in Theory and Practice - Neural NetsRed de Universidades con Carreras en Informática (RedUNCI

Modeling Financial Time Series with Artificial Neural Networks

Financial time series convey the decisions and actions of a population of human actors over time. Econometric and regressive models have been developed in the past decades for analyzing these time series. More recently, biologically inspired artificial neural network models have been shown to overcome some of the main challenges of traditional techniques by better exploiting the non-linear, non-stationary, and oscillatory nature of noisy, chaotic human interactions. This review paper explores the options, benefits, and weaknesses of the various forms of artificial neural networks as compared with regression techniques in the field of financial time series analysis.CELEST, a National Science Foundation Science of Learning Center (SBE-0354378); SyNAPSE program of the Defense Advanced Research Project Agency (HR001109-03-0001

PSO based Neural Networks vs. Traditional Statistical Models for Seasonal Time Series Forecasting

Seasonality is a distinctive characteristic which is often observed in many practical time series. Artificial Neural Networks (ANNs) are a class of promising models for efficiently recognizing and forecasting seasonal patterns. In this paper, the Particle Swarm Optimization (PSO) approach is used to enhance the forecasting strengths of feedforward ANN (FANN) as well as Elman ANN (EANN) models for seasonal data. Three widely popular versions of the basic PSO algorithm, viz. Trelea-I, Trelea-II and Clerc-Type1 are considered here. The empirical analysis is conducted on three real-world seasonal time series. Results clearly show that each version of the PSO algorithm achieves notably better forecasting accuracies than the standard Backpropagation (BP) training method for both FANN and EANN models. The neural network forecasting results are also compared with those from the three traditional statistical models, viz. Seasonal Autoregressive Integrated Moving Average (SARIMA), Holt-Winters (HW) and Support Vector Machine (SVM). The comparison demonstrates that both PSO and BP based neural networks outperform SARIMA, HW and SVM models for all three time series datasets. The forecasting performances of ANNs are further improved through combining the outputs from the three PSO based models.Comment: 4 figures, 4 tables, 31 references, conference proceeding

Comparison of modelling techniques for milk-production forecasting

peer-reviewedThe objective of this study was to assess the suitability of 3 different modeling techniques for the prediction of total daily herd milk yield from a herd of 140 lactating pasture-based dairy cows over varying forecast horizons. A nonlinear auto-regressive model with exogenous input, a static artificial neural network, and a multiple linear regression model were developed using 3 yr of historical milk-production data. The models predicted the total daily herd milk yield over a full season using a 305-d forecast horizon and 50-, 30-, and 10-d moving piecewise horizons to test the accuracy of the models over long- and short-term periods. All 3 models predicted the daily production levels for a full lactation of 305 d with a percentage root mean square error (RMSE) of ≤12.03%. However, the nonlinear auto-regressive model with exogenous input was capable of increasing its prediction accuracy as the horizon was shortened from 305 to 50, 30, and 10 d [RMSE (%) = 8.59, 8.1, 6.77, 5.84], whereas the static artificial neural network [RMSE (%) = 12.03, 12.15, 11.74, 10.7] and the multiple linear regression model [RMSE (%) = 10.62, 10.68, 10.62, 10.54] were not able to reduce their forecast error over the same horizons to the same extent. For this particular application the nonlinear auto-regressive model with exogenous input can be presented as a more accurate alternative to conventional regression modeling techniques, especially for short-term milk-yield predictions