Making Good on LSTMs' Unfulfilled Promise

LSTMs promise much to financial time-series analysis, temporal and cross-sectional inference, but we find that they do not deliver in a real-world financial management task. We examine an alternative called Continual Learning (CL), a memory-augmented approach, which can provide transparent explanations, i.e. which memory did what and when. This work has implications for many financial applications including credit, time-varying fairness in decision making and more. We make three important new observations. Firstly, as well as being more explainable, time-series CL approaches outperform LSTMs as well as a simple sliding window learner using feed-forward neural networks (FFNN). Secondly, we show that CL based on a sliding window learner (FFNN) is more effective than CL based on a sequential learner (LSTM). Thirdly, we examine how real-world, time-series noise impacts several similarity approaches used in CL memory addressing. We provide these insights using an approach called Continual Learning Augmentation (CLA) tested on a complex real-world problem, emerging market equities investment decision making. CLA provides a test-bed as it can be based on different types of time-series learners, allowing testing of LSTM and FFNN learners side by side. CLA is also used to test several distance approaches used in a memory recall-gate: Euclidean distance (ED), dynamic time warping (DTW), auto-encoders (AE) and a novel hybrid approach, warp-AE. We find that ED under-performs DTW and AE but warp-AE shows the best overall performance in a real-world financial task

Four essays on quantitative economics applications to volatility analysis in Emerging Markets and renewable energy projects

[ES]Las decisiones financieras se pueden dividir en decisiones de inversión y decisiones de financiación. En lo que respecta a las decisiones de inversión, la incertidumbre acerca de la dinámica futura de las variables económicas y de las financieras tiene un rol fundamental. Eso, se explica porque los retornos esperados por las empresas y por los inversionistas se pueden ver afectados por los movimientos adversos en los mercados financieros y por los altos niveles de volatilidad. Como consecuencia, resulta crucial realizar un adecuado análisis y modelación de la volatilidad para el proceso de toma de decisiones financieras, por parte de las empresas y el diseño de estrategias de inversión y cobertura por parte de los inversionistas. En este sentido, el estudio de la volatilidad se ha convertido en uno de los temas más interesantes de la investigación en finanzas. Lo anterior ha cobrado mayor relevancia en los últimos años, teniendo en cuenta el escenario de alta volatilidad e incertidumbre que afrontan los mercados a nivel global. Este documento tiene como objetivo abordar cuatro cuestiones centrales, las cuales están relacionadas con la volatilidad financiera como campo de investigación. Esas cuestiones son, la transmisión y spillovers de volatilidad en mercados emergentes, la calibración de la superficie de volatilidad para proyectos de energía renovable y el pronóstico de los rendimientos de activos energéticos y spillovers de volatilidad a través de técnicas de machine learning. En el primer capítulo del documento, se examinan los efectos de transmisión de volatilidad entre un índice de energía y un índice financiero para los Mercados Emergentes. En consecuencia, mediante el uso de un modelo DCC, se muestra que los efectos de transmisión de volatilidad entre los índices empleados para la crisis subprime y la crisis del COVID-19 fueron diferentes. Lo anteriormente dicho, considerando que la primera crisis se originó en el sector financiero y luego se extendió al resto de la economía, mientras que la segunda se originó en el sector real y posteriormente afectó al resto de la economía. Teniendo en cuenta que la relación entre la volatilidad de los mercados es cambiante en el tiempo, en el segundo capítulo se llevó a cabo un análisis dinámico de los spillovers de volatilidad entre materias primas, Bitcoin y un índice de Mercados Emergentes. Así, empleando la metodología propuesta por Diebold y Yilmaz (2012), se concluyó que los efectos de los spillovers de volatilidad entre los activos analizados no son constantes en dirección e intensidad a través del tiempo. En particular, para períodos de crisis como el de la pandemia del COVID-19, hay reversiones en la dirección de los spillovers de volatilidad debido al sector en el que se originó la crisis. Además, en este capítulo se explota la naturaleza dinámica de los spillovers de volatilidad. Por lo tanto, se planteó que el índice de spillovers de volatilidad propuesto por Diebold y Yilmaz puede ser usado como una medida para pronosticar periodos de alta turbulencia. Lo anterior se desarrolló a través de modelos econométricos tradicionales y de técnicas de machine learning. En el tercer capítulo del documento, se propone un modelo que predice los retornos de los precios del carbono y del petróleo. En este sentido, se desarrolló un modelo híbrido, el cual combina las proyecciones obtenidas a partir de diferentes técnicas de machine learning y modelos econométricos tradicionales, obteniéndose resultados los cuales muestran las ventajas de emplear modelos híbridos que incorporan técnicas de machine learning, exclusivamente, para pronosticar variables financieras. Finalmente, en el capítulo cuatro, se presenta una metodología para la estimación de la volatilidad en la valoración de proyectos de energías renovables mediante opciones reales. En esta metodología, la cual es una extensión del enfoque de volatilidad implícita empleada para las opciones financieras, la volatilidad de un proyecto es la volatilidad implícita obtenida a partir de la superficie de la volatilidad de empresas comparables, según una determinada fecha de valoración y dada la relación deuda-capital de un proyecto de energía renovable. En este análisis, se utilizó el modelo estocástico 'alfa-beta-rho' para calibrar la superficie de la volatilidad para la valoración mediante opciones reales. Por último, al final del documento se presentan las conclusiones derivadas de los capítulos mencionados, así como algunas recomendaciones para las futuras investigaciones. [EN]Financial decisions can be divided in investment and financing decisions. Concerning investment decisions, the uncertainty about the future dynamics of financial and economic variables has a central role, considering that the returns expected by firms and investors can be affected by the adverse movements in financial markets and their high volatility. In consequence, the adequate volatility analysis and modeling is crucial for the firm’s financial decision-making process and the design of investing and hedging strategies by investors. In this regard, the study of volatility has become one of the most interesting topics in finance research. The foregoing has become more relevant in recent years considering the scenario of high volatility and uncertainty faced by markets globally. This document aims to address four central issues related to financial volatility as a research area. These are, volatility transmission and spillovers in Emerging Markets, the calibration of the volatility surface for renewable energy projects and the forecast of energy assets returns and volatility spillovers through machine learning techniques. In the first chapter of the document, the volatility transmission effects between an energy index and a financial index for Emerging Markets are examined. Then, by using a DCC model, it is shown that the volatility transmission effects between the employed indices for the subprime crisis and the COVID-19 pandemic were different. This, considering that the former crisis originated in the financial sector and spread to the rest of the economy, while the second originated in the real sector and trasmitted to the rest of the economy posteriorly. Considering that the relationship between markets volatility is time-varying, in the second chapter, a dynamic analysis of volatility spillovers between commodities, Bitcoin and an Emerging Markets index is developed. Employing the methodology proposed by Diebold and Yilmaz (2012), it is concluded that the volatility spillovers effects between the analyzed assets is not constant in direction and intensity over time. In particular, for periods of crisis such as the COVID-19 pandemics, there are reversals in the direction of volatility spillovers due to the sector in which the crises originate. In addition, in this chapter the dynamic nature of volatility spillovers is exploited. Hence, the volatility spillover index proposed by Diebold and Yilmaz is forecasted to be used as a measure to anticipate high turbulence periods. This, through both traditional econometric models and machine learning techniques. In the third chapter, a model for the prediction of carbon and oil prices is proposed. In this sense, a hybrid model that ensembles the forecasts obtained from different machine learning techniques and traditional econometric models is developed, obtaining results that show the advantages of employing hybrid models which combine machine learning techniques, exclusively, to forecast financial variables. In Chapter four, a methodology for the estimation of volatility in renewable energy projects valuation through real options is presented. In this methodology, which is an extension of the implied volatility approach employed for financial options, the volatility of the project is the implied volatility obtained from the volatility surface of comparable firms for a certain valuation date and given debt-to-equity relation of a renewable energy project. In this analysis, the stochastic ‘alpha-beta-rho’ model is utilized to calibrate the volatility surface for real option valuation purposes. Finally, the conclusions derived from the mentioned chapters are presented at the end of the document as well as some recommendations for future research

A holistic auto-configurable ensemble machine learning strategy for financial trading

Financial markets forecasting represents a challenging task for a series of reasons, such as the irregularity, high fluctuation, noise of the involved data, and the peculiar high unpredictability of the financial domain. Moreover, literature does not offer a proper methodology to systematically identify intrinsic and hyper-parameters, input features, and base algorithms of a forecasting strategy in order to automatically adapt itself to the chosen market. To tackle these issues, this paper introduces a fully automated optimized ensemble approach, where an optimized feature selection process has been combined with an automatic ensemble machine learning strategy, created by a set of classifiers with intrinsic and hyper-parameters learned in each marked under consideration. A series of experiments performed on different real-world futures markets demonstrate the effectiveness of such an approach with regard to both to the Buy and Hold baseline strategy and to several canonical state-of-the-art solutions

Prediction of Spot Price of Iron Ore Based on PSR-WA-LSSVM Combined Model

Aiming at the problems that the existing single time series models are not accurate and robust enough when it comes to forecasting the iron ore prices and the parameters of the traditional LSSVM model are difficult to determine, we propose a combined model based on Phase Space Reconstruction (PSR), wavelet transform and LSSVM (PSR-WA-LSSVM) to tackle these issues. ARIMA model, LSTM model, PSR-LSSVM model, and PSR-WA-LSSVM models were used for contrast simulation to forecast the spot price data of 61.5%PB powder from January 30, 2019, to February 1, 2021, in Ningbo Zhoushan port. The experimental results show that the PSR-WA-LSSVM combination model achieves better prediction results. At the same time, the model has a good performance in the multistep prediction of the iron ore price

Multi-Scale Simulation of Complex Systems: A Perspective of Integrating Knowledge and Data

Complex system simulation has been playing an irreplaceable role in understanding, predicting, and controlling diverse complex systems. In the past few decades, the multi-scale simulation technique has drawn increasing attention for its remarkable ability to overcome the challenges of complex system simulation with unknown mechanisms and expensive computational costs. In this survey, we will systematically review the literature on multi-scale simulation of complex systems from the perspective of knowledge and data. Firstly, we will present background knowledge about simulating complex system simulation and the scales in complex systems. Then, we divide the main objectives of multi-scale modeling and simulation into five categories by considering scenarios with clear scale and scenarios with unclear scale, respectively. After summarizing the general methods for multi-scale simulation based on the clues of knowledge and data, we introduce the adopted methods to achieve different objectives. Finally, we introduce the applications of multi-scale simulation in typical matter systems and social systems

Volatility Modeling for Currency Pairs and Stock Indices by Means of Complex Networks

 Financial markets are complex systems. Network analysis is an innovative method for improving data sharing and knowledge discovery in financial data. Oriented weighted networks were created for the Shanghai Composite, S&P500, DAX30, CAC40, Nikkei225, FTSE100, IBEX35 indexes, for CNY-JPY, EUR-USD, GBP-EUR, RUB-CNY and for cryptocurrency BTC-USD. We considered data since January 6, 2006 to September 6, 2019. The complex networks had a similar structure for both types of markets, which was divided into the central part (core) and the outer one (loops). The emergence of such a structure reflects the fact that, for the most part, the stock and currency markets develop around some significant state of volatility, but occasionally anomalies occur when the states of volatility deviate from the core. Comparing the topology of evolutionary networks and the differences found for the stock and currency markets networks, we can conclude that stock markets are characterized by a greater variety of volatility patterns than currency ones. At the same time, the cryptocurrency market network showed a special mechanism of volatility evolution compared to the currency and stock market networks