Online learning in financial time series

We wish to understand if additional learning forms can be combined with sequential optimisation to provide superior benefit over batch learning in various tasks operating in financial time series. In chapter 4, Online learning with radial basis function networks, we provide multi-horizon forecasts on the returns of financial time series. Our sequentially optimised radial basis function network (RBFNet) outperforms a random-walk baseline and several powerful supervised learners. Our RBFNets naturally measure the similarity between test samples and prototypes that capture the characteristics of the feature space. In chapter 5, Reinforcement learning for systematic FX trading, we perform feature representation transfer from an RBFNet to a direct, recurrent reinforcement learning (DRL) agent. Earlier academic work saw mixed results. We use better features, second-order optimisation methods and adapt our model parameters sequentially. As a result, our DRL agents cope better with statistical changes to the data distribution, achieving higher risk-adjusted returns than a funding and a momentum baseline. In chapter 6, The recurrent reinforcement learning crypto agent, we construct a digital assets trading agent that performs feature space representation transfer from an echo state network to a DRL agent. The agent learns to trade the XBTUSD perpetual swap contract on BitMEX. Our meta-model can process data as a stream and learn sequentially; this helps it cope with the nonstationary environment. In chapter 7, Sequential asset ranking in nonstationary time series, we create an online learning long/short portfolio selection algorithm that can detect the best and worst performing portfolio constituents that change over time; in particular, we successfully handle the higher transaction costs associated with using daily-sampled data, and achieve higher total and risk-adjusted returns than the long-only holding of the S&P 500 index with hindsight

A forecasting of indices and corresponding investment decision making application

Student Number : 9702018F - MSc(Eng) Dissertation - School of Electrical and Information Engineering - Faculty of Engineering and the Built EnvironmentDue to the volatile nature of the world economies, investing is crucial in ensuring an individual is prepared for future financial necessities. This research proposes an application, which employs computational intelligent methods that could assist investors in making financial decisions. This system consists of 2 components. The Forecasting Component (FC) is employed to predict the closing index price performance. Based on these predictions, the Stock Quantity Selection Component (SQSC) recommends the investor to purchase stocks, hold the current investment position or sell stocks in possession. The development of the FC module involved the creation of Multi-Layer Perceptron (MLP) as well as Radial Basis Function (RBF) neural network classifiers. TCategorizes that these networks classify are based on a profitable trading strategy that outperforms the long-term “Buy and hold” trading strategy. The Dow Jones Industrial Average, Johannesburg Stock Exchange (JSE) All Share, Nasdaq 100 and the Nikkei 225 Stock Average indices are considered. TIt has been determined that the MLP neural network architecture is particularly suited in the prediction of closing index price performance. Accuracies of 72%, 68%, 69% and 64% were obtained for the prediction of closing price performance of the Dow Jones Industrial Average, JSE All Share, Nasdaq 100 and Nikkei 225 Stock Average indices, respectively. TThree designs of the Stock Quantity Selection Component were implemented and compared in terms of their complexity as well as scalability. TComplexity is defined as the number of classifiers employed by the design. Scalability is defined as the ability of the design to accommodate the classification of additional investment recommendations. TDesigns that utilized 1, 4 and 16 classifiers, respectively, were developed. These designs were implemented using MLP neural networks, RBF neural networks, Fuzzy Inference Systems as well as Adaptive Neuro-Fuzzy Inference Systems. The design that employed 4 classifiers achieved low complexity and high scalability. As a result, this design is most appropriate for the application of concern. It has also been determined that the neural network architecture as well as the Fuzzy Inference System implementation of this design performed equally well

On the predictability of U.S. stock market using machine learning and deep learning techniques

Conventional market theories are considered to be inconsistent approach in modern financial analysis. This thesis focuses mainly on the application of sophisticated machine learning and deep learning techniques in stock market statistical predictability and economic significance over the benchmark conventional efficient market hypothesis and econometric models. Five chapters and three publishable papers were proposed altogether, and each chapter is developed to solve specific identifiable problem(s). Chapter one gives the general introduction of the thesis. It presents the statement of the research problems identified in the relevant literature, the objective of the study and the significance of the study. Chapter two applies a plethora of machine learning techniques to forecast the direction of the U.S. stock market. The notable sophisticated techniques such as regularization, discriminant analysis, classification trees, Bayesian and neural networks were employed. The empirical findings revealed that the discriminant analysis classifiers, classification trees, Bayesian classifiers and penalized binary probit models demonstrate significant outperformance over the binary probit models both statistically and economically, proving significant alternatives to portfolio managers. Chapter three focuses mainly on the application of regression training (RT) techniques to forecast the U.S. equity premium. The RT models demonstrate significant evidence of equity premium predictability both statistically and economically relative to the benchmark historical average, delivering significant utility gains. Chapter four investigates the statistical predictive power and economic significance of financial stock market data by deep learning techniques. Chapter five give the summary, conclusion and present area(s) of further research. The techniques are proven to be robust both statistically and economically when forecasting the equity premium out-of-sample using recursive window method. Overall, the deep learning techniques produced the best result in this thesis. They seek to provide meaningful economic information on mean-variance portfolio investment for investors who are timing the market to earn future gains at minimal risk

Experimental Designs, Meta-Modeling, and Meta-learning for Mixed-Factor Systems with Large Decision Spaces

Many Air Force studies require a design and analysis process that can accommodate for the computational challenges associated with complex systems, simulations, and real-world decisions. For systems with large decision spaces and a mixture of continuous, discrete, and categorical factors, nearly orthogonal-and-balanced (NOAB) designs can be used as efficient, representative subsets of all possible design points for system evaluation, where meta-models are then fitted to act as surrogates to system outputs. The mixed-integer linear programming (MILP) formulations used to construct first-order NOAB designs are extended to solve for low correlation between second-order model terms (i.e., two-way interactions and quadratics). The resulting second-order approaches are shown to improve design performance measures for second-order model parameter estimation and prediction variance as well as for protection from bias due to model misspecification with respect to second-order terms. Further extensions are developed to construct batch sequential NOAB designs, giving experimenters more flexibility by creating multiple stages of design points using different NOAB approaches, where simultaneous construction of stages is shown to outperform design augmentation overall. To reduce cost and add analytical rigor, meta-learning frameworks are developed for accurate and efficient selection of first-order NOAB designs as well as of meta-models that approximate mixed-factor systems

Hybrid Learning Algorithm of Radial Basis Function Networks for Reliability Analysis

With the wide application of industrial robots in the field of precision machining, reliability analysis of positioning accuracy becomes increasingly important for industrial robots. Since the industrial robot is a complex nonlinear system, the traditional approximate reliability methods often produce unreliable results in analyzing its positioning accuracy. In order to study the positioning accuracy reliability of industrial robot more efficiently and accurately, a radial basis function network is used to construct the mapping relationship between the uncertain parameters and the position coordinates of the end-effector. Combining with the Monte Carlo simulation method, the positioning accuracy reliability is then evaluated. A novel hybrid learning algorithm for training radial basis function network, which integrates the clustering learning algorithm and the orthogonal least squares learning algorithm, is proposed in this article. Examples are presented to illustrate the high proficiency and reliability of the proposed method

An empirical study on the various stock market prediction methods

Investment in the stock market is one of the much-admired investment actions. However, prediction of the stock market has remained a hard task because of the non-linearity exhibited. The non-linearity is due to multiple affecting factors such as global economy, political situations, sector performance, economic numbers, foreign institution investment, domestic institution investment, and so on. A proper set of such representative factors must be analyzed to make an efficient prediction model. Marginal improvement of prediction accuracy can be gainful for investors. This review provides a detailed analysis of research papers presenting stock market prediction techniques. These techniques are assessed in the time series analysis and sentiment analysis section. A detailed discussion on research gaps and issues is presented. The reviewed articles are analyzed based on the use of prediction techniques, optimization algorithms, feature selection methods, datasets, toolset, evaluation matrices, and input parameters. The techniques are further investigated to analyze relations of prediction methods with feature selection algorithm, datasets, feature selection methods, and input parameters. In addition, major problems raised in the present techniques are also discussed. This survey will provide researchers with deeper insight into various aspects of current stock market prediction methods

Integrated computational intelligence and Japanese candlestick method for short-term financial forecasting

This research presents a study of intelligent stock price forecasting systems using interval type-2 fuzzy logic for analyzing Japanese candlestick techniques. Many intelligent financial forecasting models have been developed to predict stock prices, but many of them do not perform well under unstable market conditions. One reason for poor performance is that stock price forecasting is very complex, and many factors are involved in stock price movement. In this environment, two kinds of information exist, including quantitative data, such as actual stock prices, and qualitative data, such as stock traders\u27 opinions and expertise. Japanese candlestick techniques have been proven to be effective methods for describing the market psychology. This study is motivated by the challenges of implementing Japanese candlestick techniques to computational intelligent systems to forecast stock prices. The quantitative information, Japanese candlestick definitions, is managed by type-2 fuzzy logic systems. The qualitative data sets for the stock market are handled by a hybrid type of dynamic committee machine architecture. Inside this committee machine, generalized regression neural network-based experts handle actual stock prices for monitoring price movements. Neural network architecture is an effective tool for function approximation problems such as forecasting. Few studies have explored integrating intelligent systems and Japanese candlestick methods for stock price forecasting. The proposed model shows promising results. This research, derived from the interval type-2 fuzzy logic system, contributes to the understanding of Japanese candlestick techniques and becomes a potential resource for future financial market forecasting studies --Abstract, page iii

Seismic vulnerability of above-ground storage tanks with unanchored support conditions for Na-tech risks based on Gaussian process regression

AbstractThis paper aims to investigate the seismic vulnerability of an existing unanchored steel storage tank ideally installed in a refinery in Sicily (Italy), along the lines of performance-based earthquake engineering. Tank performance is estimated by means of component-level fragility curves for specific limit states. The assessment is based on a framework that relies on a three-dimensional finite element (3D FE) model and a low-fidelity demand model based on Gaussian process regression, which allows for cheaper simulations. Moreover, to approximate the system response corresponding to the random variation of both peak ground acceleration and liquid filling level, a second-order design of experiments method is adopted. Hence, a parametric investigation is conducted on a specific existing unanchored steel storage tank. The relevant 3D FE model is validated with an experimental campaign carried out on a shaking table test. Special attention is paid to the base uplift due to significant inelastic deformations that occur at the baseplate close to the welded baseplate-to-wall connection, offering extensive information on both capacity and demand. As a result, the tank performance is estimated by means of component-level fragility curves for the aforementioned limit state which are derived through Monte Carlo simulations. The flexibility of the proposed framework allows fragility curves to be derived considering both deterministic and random filling levels. The comparison of the seismic vulnerability of the tank obtained with probabilistic and deterministic mechanical models demonstrates the conservatism of the latter. The same trend is also exhibited in terms of risk assessment

Using international diversification to enhance predicted equity index performance: a South African perspective

In the weak form, the Efficient Market Hypothesis (EMH) states that it is not possible to forecast the future price of an asset based on the information contained in the historical prices of that same asset. Under this assumption, the market behaves as a random walk and as a result, price forecasting is impossible. Furthermore, financial forecasting is a difficult task due to the intrinsic complexities of any financial system. The purpose of this study is to examine the potential of developing an international investment strategy using future index price predictions and offsetting predicted price declines by investing in negatively correlated international markets. Therefore, the first objective of this study was to examine the feasibility and accuracy of using a machine learning technique to model and predict the future price of stock market indices of South Africa (All Share Index) and a variety of other developed and developing international markets, which included South Africa, Brazil, Russia, India and China of the BRIC countries and Italy, France, Netherlands, Switzerland, Germany, Nigeria, Australia, Hong Kong, Saudi Arabia, Japan, the U.S., Turkey and the U.K., which were identified as South Africa’s major trading partners. Secondly, an analysis of market correlation between each country’s equity index and South Africa’s ALSI was conducted to determine which of these international indices were positively and negatively correlated to the South African ALSI. This allowed an extrapolation of potential international diversification opportunities. By using machine learning to predict future price trends of the South African All Share Index (ALSI) within a specified time period, the market correlation aspect of this study was able to suggest possible negatively correlated safe haven markets to invest in to offset predicted losses in an expected declining local market. The study’s major limitations include a single method for regression analysis (GARCH(1, 1)) and a limited number of variables in the feature space when predicting future prices. Additional parameters could prove a more robust modelling technique. The data used was a series of past closing prices of each country’s major index. The data was split into five periods, where each period was assigned an overarching theme based on the prevailing market conditions at the time. The ALSI data set was subjected to a unit root test and found to be non-stationary. The analysis thereafter followed a two-step test, with the first being the determination of market correlation of the South African equity market with other markets, using a generalised autoregressive conditional heteroskedasticity (GARCH (1: 1)) approach given the non-stationary nature of the ALSI historic data. The results showed strong positive market correlations between South Africa and China, India, Nigeria, Russia and Saudi Arabia, and strong negative correlation between South Africa and Australia, Germany, the Netherlands, and the United Kingdom. Secondly, the specific area of machine learning employed in this study was support vector machines, as implemented using Python programming. The results compare the actual index price with those predicted by the model and showed that this technique has the ability to predict the future price of the Index within an acceptable accuracy. The accuracy measure used was the mean relative error which in most cases was calculated to be between 95 and 98 which is considered relatively high. However, the results of the investment approach described above was considered to be too inconsistent to consider this diversification strategy viable. From a South African perspective, this approach has not been documented previously