Forecasting Long-Term Government Bond Yields: An Application of Statistical and AI Models

This paper evaluates several artificial intelligence and classical algorithms on their ability of forecasting the monthly yield of the US 10-year Treasury bonds from a set of four economic indicators. Due to the complexity of the prediction problem, the task represents a challenging test for the algorithms under evaluation. At the same time, the study is of particular significance for the important and paradigmatic role played by the US market in the world economy. Four data-driven artificial intelligence approaches are considered, namely, a manually built fuzzy logic model, a machine learned fuzzy logic model, a self-organising map model and a multi-layer perceptron model. Their performance is compared with the performance of two classical approaches, namely, a statistical ARIMA model and an econometric error correction model. The algorithms are evaluated on a complete series of end-month US 10-year Treasury bonds yields and economic indicators from 1986:1 to 2004:12. In terms of prediction accuracy and reliability of the modelling procedure, the best results are obtained by the three parametric regression algorithms, namely the econometric, the statistical and the multi-layer perceptron model. Due to the sparseness of the learning data samples, the manual and the automatic fuzzy logic approaches fail to follow with adequate precision the range of variations of the US 10-year Treasury bonds. For similar reasons, the self-organising map model gives an unsatisfactory performance. Analysis of the results indicates that the econometric model has a slight edge over the statistical and the multi-layer perceptron models. This suggests that pure data-driven induction may not fully capture the complicated mechanisms ruling the changes in interest rates. Overall, the prediction accuracy of the best models is only marginally better than the prediction accuracy of a basic one-step lag predictor. This result highlights the difficulty of the modelling task and, in general, the difficulty of building reliable predictors for financial markets.interest rates; forecasting; neural networks; fuzzy logic.

Forecasting long-term government bond yields: an application of statistical and ai models

This paper evaluates several artificial intelligence and classical algorithms on their ability of forecasting the monthly yield of the US 10-year Treasury bonds from a set of four economic indicators. Due to the complexity of the prediction problem, the task represents a challenging test for the algorithms under evaluation. At the same time, the study is of particular significance for the important and paradigmatic role played by the US market in the world economy. Four data-driven artificial intelligence approaches are considered, namely, a manually built fuzzy logic model, a machine learned fuzzy logic model, a self-organising map model and a multi-layer perceptron model. Their performance is compared with the performance of two classical approaches, namely, a statistical ARIMA model and an econometric error correction model. The algorithms are evaluated on a complete series of end-month US 10-year Treasury bonds yields and economic indicators from 1986:1 to 2004:12. In terms of prediction accuracy and reliability of the modelling procedure, the best results are obtained by the three parametric regression algorithms, namely the econometric, the statistical and the multi-layer perceptron model. Due to the sparseness of the learning data samples, the manual and the automatic fuzzy logic approaches fail to follow with adequate precision the range of variations of the US 10-year Treasury bonds. For similar reasons, the self-organising map model gives an unsatisfactory performance. Analysis of the results indicates that the econometric model has a slight edge over the statistical and the multi-layer perceptron models. This suggests that pure data-driven induction may not fully capture the complicated mechanisms ruling the changes in interest rates. Overall, the prediction accuracy of the best models is only marginally better than the prediction accuracy of a basic one-step lag predictor. This result highlights the difficulty of the modelling task and, in general, the difficulty of building reliable predictors for financial markets

This time it is different! Or not?

We employ a simple method based on logistic weighted least squares to diagnose which past data are less or more useful for predicting the future course of a variable. A simulation experiment shows its merits. An illustration for monthly industrial production series for 17 countries suggests that earlier data are useful, for the prediction in a crisis period (2006-2011) and for the period after the crisis (201

A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning

We present a tutorial on Bayesian optimization, a method of finding the maximum of expensive cost functions. Bayesian optimization employs the Bayesian technique of setting a prior over the objective function and combining it with evidence to get a posterior function. This permits a utility-based selection of the next observation to make on the objective function, which must take into account both exploration (sampling from areas of high uncertainty) and exploitation (sampling areas likely to offer improvement over the current best observation). We also present two detailed extensions of Bayesian optimization, with experiments---active user modelling with preferences, and hierarchical reinforcement learning---and a discussion of the pros and cons of Bayesian optimization based on our experiences

Forecasting stock price movements using neural networks

Includes bibliographical references (p. 99-101).The prediction of security prices has shown to be one of the most important but most difficult tasks in financial operations. Linear approaches failed to model the non-linear behaviour of markets and non-linear approaches turned out to posses too many constraints. Neural networks seem to be a suitable method to overcome these problems since they provide algorithms which process large sets of data from a non-linear context and yield thorough results. The first problem addressed by this research paper is the applicability of neural networks with respect to markets as a tool for pattern recognition. It will be shown that markets posses the necessary requirements for the use of neural networks, i.e. markets show patterns which are exploitable

Online learning in financial time series

We wish to understand if additional learning forms can be combined with sequential optimisation to provide superior benefit over batch learning in various tasks operating in financial time series. In chapter 4, Online learning with radial basis function networks, we provide multi-horizon forecasts on the returns of financial time series. Our sequentially optimised radial basis function network (RBFNet) outperforms a random-walk baseline and several powerful supervised learners. Our RBFNets naturally measure the similarity between test samples and prototypes that capture the characteristics of the feature space. In chapter 5, Reinforcement learning for systematic FX trading, we perform feature representation transfer from an RBFNet to a direct, recurrent reinforcement learning (DRL) agent. Earlier academic work saw mixed results. We use better features, second-order optimisation methods and adapt our model parameters sequentially. As a result, our DRL agents cope better with statistical changes to the data distribution, achieving higher risk-adjusted returns than a funding and a momentum baseline. In chapter 6, The recurrent reinforcement learning crypto agent, we construct a digital assets trading agent that performs feature space representation transfer from an echo state network to a DRL agent. The agent learns to trade the XBTUSD perpetual swap contract on BitMEX. Our meta-model can process data as a stream and learn sequentially; this helps it cope with the nonstationary environment. In chapter 7, Sequential asset ranking in nonstationary time series, we create an online learning long/short portfolio selection algorithm that can detect the best and worst performing portfolio constituents that change over time; in particular, we successfully handle the higher transaction costs associated with using daily-sampled data, and achieve higher total and risk-adjusted returns than the long-only holding of the S&P 500 index with hindsight

Stock market predictions based on quantified intermarket influences

This research investigated the feasibility and capability of neural network-based approaches for predicting the direction of the Australian Stock market index (the target market). It includes several aspects: univariate feature selection from the historical time series of the target market, inter-market analysis for finding the most relevant influential markets, investigations of the effect of time cycles on the target market and the discovery of the optimal neural network architectures. Previous research on US stock markets and other international markets have shown that the neural network approach is one of most powerful techniques for predicting stock market behaviour. Neural networks are capable of capturing the non-linear stochastic and chaotic patterns in the stock market time series data. This study discovered that the relative return series of the Open, High, Low and Close prices of the target market, show 6-day cycles during the studied period of about 14 years. Multi-layer feedforward neural networks trained with a backpropagation algorithm were used for the experiments. Two major testing methods: testing with randomly selected test data and forward testing, were examined and compared. The best neural network developed in this study has achieved 87%, 81% 83% and 81% accuracy respectively in predicting the next-day direction of the relative return of the Open, High, Low and Close prices of the target market. The architecture of this network consists of 33 input features, one hidden layer with 3 neurons and 4 output neurons. The best input features set includes the relative returns from 1 to 6 days in the past of the Open, High, Low and Close prices of the target market, the day of the week, and the previous day’s relative return of the Close prices of the US S&P 500 Index, US Dow Jones Industrial Average Index, US Gold/Silver Index, and the US Oil Index.Doctor of Philosoph

Forecasting carbon prices in the Shenzhen market, China:The role of mixed-frequency factors

In this study, the hybrid of combination-mixed data sampling regression model and back propagation neural network (combination-MIDAS-BP) is proposed to perform real-time forecasting of weekly carbon prices in China's Shenzhen carbon market. In addition to daily energy, economy and weather conditions, environmental factor is introduced into predictive indicators. The empirical results show that the carbon price is more sensitive to coal, temperature and AQI (air quality index) than to other factors. It is also shown that the forecast accuracy of the proposed model is approximately 30% and 40% higher than that of combination-MIDAS models and benchmark models, respectively. Given these forecast results, China's government and enterprises can effectively manage nonlinear, nonstationary, and irregular carbon prices, providing a better investing and managing tool from behavioural economics. (C) 2019 Elsevier Ltd. All rights reserved