Aplicación de la Descomposición Empírica en Modo a la Predicción del Mercado Bursátil con los Modelos de ARIMA-ARCH y Redes Neuronales Artificiales Evolutivas

Tesis de Maestría donde se propone un modelo de Ensembles de Redes Neuronales Artificiales para predecir series de tiempo financiaeras de MéxicoEl mercado bursátil es un sistema dinámico que se caracteriza por su complejidad, volatilidad, no estacionariedad, irregularidad, pero sobre todo por las repentinas y pronunciadas caídas en los precios. Dadas estas características, y con el fin de contrarrestar las fluctuaciones aparentemente aleatorias, la inherente no linealidad en los datos financieros, y puesto que en muchos de los enfoques tradicionales que abordan la predicción del mercado bursátil en periodos de crisis, estos por lo regular no son capaces de capturar de manera fiable los rasgos distintivos del fenómeno. En esta investigación, se propone como primer paso, descomponer a los indicadores que representan al mercado accionario de los Estados Unidos y México en periodos de crisis, mediante la herramienta llamada Descomposición Empírica en Modos (DEM) que se encarga de descomponer la serie original de los índices accionarios en un número finito de descomposiciones llamadas Funciones de Modo Intrínseco (FMIs) y un elemento residual. A continuación, cada una de las FMIs y el residuo, son pronosticadas individualmente, utilizando por un lado, un modelo paramétrico (Autorregresivo Integrado de Media Móvil-Modelo de Volatilidad Condicional Heterocedástico (ARIMA-ARCH)) y por otro lado, por un modelo no paramétrico Redes Neuronales Artificiales (RNAs), este último es configurado por medio de un algoritmo evolutivo llamado Selección de Características de Programación Evolutiva de Redes Neuronales Artificiales (FS- EPNet). Posteriormente, se adquiere la predicción del modelo paramétrico, mediante la suma de las predicciones resultantes de cada FMI y del residuo, de igual forma se realiza el mismo procedimiento para obtener la predicción final del modelo no paramétrico. Finalmente, las predicciones de los modelos paramétrico y no paramétrico son combinadas mediante un promedio ponderado, para producir una combinación de pronósticos, estas predicciones a su vez son comparadas. Los resultados empíricos obtenidos demuestran que los modelos que colaboraron en conjunción con la técnica de descomposición de señales DEM, tienen una predicción más precisa de la crisis bursátil, a diferencia de los modelos que confeccionaron su pronóstico de manera aislada.COMECyT, CONACy

Advancing evolution of artifcial neural networks through behavioral adaptation

Diese Dissertation betrifft das Lernen in künstlichen neuronalen Netzen und präsentiert einen neuen evolutionären Algorithmus (Network-Weight-based Evolutionary Algorithm, NWEA), der zusätzliche Mechanismen der Natur in Computational Evolution involviert. NWEA ist eine Lernstrategie, die Information über die Position des Individuums im Suchraum, seine Güte und ANN Topologie in dem Modifikationsmechanismus enthält. Der Grundgedanke von NWEA war eine Verhaltensadaptation neben der strukturellen Adaptation durchzuführen und damit die Verbindung zwischen Individuen und Umwelt zu ermöglichen. Der NWEA Modifikationsstrategie nutzt sowohl Genotyp als auch Phänotyp Information im Evolutionsprozess. Genotyp Information ist durch den Ausgabefehler des Netzes dargestellt. Phänotyp Information ist in der Komponente network weight integriert, die die Struktur des Netzes beschreibt und von der Gesamtzahl der verbogenen Schichten und der durchschnittlichen Anzahl der verbogenen Neuronen abhängig ist

Predicción del IPC mexicano combinado modelos econométricos e inteligencia artificial

Artículo en revista indizada publicado en la Revista Mexicana de Economía y Finanzas (REMEF)El objetivo de este trabajo es descomponer los factores de comportamiento del Índice de Precios y Cotizaciones (IPC) mexicano para ser pronosticado mediante modelos econométricos y redes neuronales artificiales evolutivas. La metodología empleada consiste en reducir la complejidad de análisis y eliminar el ruido en los datos del IPC mediante la descomposición empírica en modos (DEM), combinando las funciones de modo intrínseco (FMIs) resultantes con las variantes de los modelos autorregresivo integrado de promedio móvil (ARIMA) y autorregresivo con heterocedasticidad condicional (ARCH), y el algoritmo de selección de características de programación evolutiva de redes (FS-EPNet) para pronosticar su comportamiento. La configuración experimental y resultados se presentan y analizan mediante tres fases de predicción del IPC. Las limitaciones son que el IPC mexicano no es estacionario, implicando que algunas FMIs tampoco lo sean. La originalidad consiste en la combinación de la DEM con el algoritmo FS-EPNet para analizar la evolución del mercado bursátil mexicano a través de su IPC, con lo cual se demuestra y concluye que genera una mejor predicción que la obtenida a partir de los datos originales

Predicción del IPC mexicano combinando modelos econométricos e inteligencia artificial

El objetivo de este trabajo es descomponer los factores de comportamiento del Índice de Precios y Cotizaciones (IPC) mexicano para ser pronosticado mediante modelos econométricos y redes neuronales artificiales evolutivas. La metodología empleada consiste en reducir la complejidad de análisis y eliminar el ruido en los datos del IPC mediante la descomposición empírica en modos (DEM), combinando las funciones de modo intrínseco (FMIs) resultantes con las variantes de los modelos autorregresivo integrado de promedio móvil (ARIMA) y autorregresivo con heterocedasticidad condicional (ARCH), y el algoritmo de selección de características de programación evolutiva de redes (FS-EPNet) para pronosticar su comportamiento. La configuración experimental y resultados se presentan y analizan mediante tres fases de predicción del IPC. Las limitaciones son que el IPC mexicano no es estacionario, implicando que algunas FMIs tampoco lo sean. La originalidad consiste en la combinación de la DEM con el algoritmo FS-EPNet para analizar la evolución del mercado bursátil mexicano a través de su IPC, con lo cual se demuestra y concluye que genera una mejor predicción que la obtenida a partir de los datos originales.(Mexican IPC Prediction Combining Econometric Models and Artificial Intelligence)The purpose of this paper is to decompose the behavioral factors of the Mexican Price and Quotation Index (IPC for its acronym in Spanish) to be forecast using econometric models and evolutionary artificial neural networks. The methodology used consists on reducing the analysis complexity and eliminating the noise in the IPC data through empirical mode decomposition (EMD), combining the intrinsic mode functions (IMFs) resulting with the variants of the autoregressive integrated mobile average (ARIMA) and autoregressive conditional heteroskedasticity (ARCH) models, as well as the algorithm for selection of characteristics of evolutionary network programing (FS-EPNet) to forecast its behavior. The experimental configuration and results are shown and are analyzed using three prediction phases of the IPC. The limitations are that the Mexican IPC is not stationary, which implies that some IMFs are also not stationary. The originality of this consists on the combination of DEM with the FS-EPNet algorithm to analyze the evolution of the Mexican Stock Exchange through its IPC, which is used to show and conclude that it generates a better prediction than that obtained from the original data

Biologically inspired evolutionary temporal neural circuits

Biological neural networks have always motivated creation of new artificial neural networks, and in this case a new autonomous temporal neural network system. Among the more challenging problems of temporal neural networks are the design and incorporation of short and long-term memories as well as the choice of network topology and training mechanism. In general, delayed copies of network signals can form short-term memory (STM), providing a limited temporal history of events similar to FIR filters, whereas the synaptic connection strengths as well as delayed feedback loops (ER circuits) can constitute longer-term memories (LTM). This dissertation introduces a new general evolutionary temporal neural network framework (GETnet) through automatic design of arbitrary neural networks with STM and LTM. GETnet is a step towards realization of general intelligent systems that need minimum or no human intervention and can be applied to a broad range of problems. GETnet utilizes nonlinear moving average/autoregressive nodes and sub-circuits that are trained by enhanced gradient descent and evolutionary search in terms of architecture, synaptic delay, and synaptic weight spaces. The mixture of Lamarckian and Darwinian evolutionary mechanisms facilitates the Baldwin effect and speeds up the hybrid training. The ability to evolve arbitrary adaptive time-delay connections enables GETnet to find novel answers to many classification and system identification tasks expressed in the general form of desired multidimensional input and output signals. Simulations using Mackey-Glass chaotic time series and fingerprint perspiration-induced temporal variations are given to demonstrate the above stated capabilities of GETnet

Automatic inference of cross-modal connection topologies for X-CNNs

This paper introduces a way to learn cross-modal convolutional neural network (X-CNN) architectures from a base convolutional network (CNN) and the training data to reduce the design cost and enable applying cross-modal networks in sparse data environments. Two approaches for building X-CNNs are presented. The base approach learns the topology in a data-driven manner, by using measurements performed on the base CNN and supplied data. The iterative approach performs further optimisation of the topology through a combined learning procedure, simultaneously learning the topology and training the network. The approaches were evaluated agains examples of hand-designed X-CNNs and their base variants, showing superior performance and, in some cases, gaining an additional 9% of accuracy. From further considerations, we conclude that the presented methodology takes less time than any manual approach would, whilst also significantly reducing the design complexity. The application of the methods is fully automated and implemented in Xsertion library

Automatic Inference of Cross-modal Connection Topologies for X-CNNs

This paper introduces a way to learn cross-modal convolutional neural network (X-CNN) architectures from a base convolutional network (CNN) and the training data to reduce the design cost and enable applying cross-modal networks in sparse data environments. Two approaches for building X-CNNs are presented. The base approach learns the topology in a data-driven manner, by using measurements performed on the base CNN and supplied data. The iterative approach performs further optimisation of the topology through a combined learning procedure, simultaneously learning the topology and training the network. The approaches were evaluated agains examples of hand-designed X-CNNs and their base variants, showing superior performance and, in some cases, gaining an additional 9% of accuracy. From further considerations, we conclude that the presented methodology takes less time than any manual approach would, whilst also significantly reducing the design complexity. The application of the methods is fully automated and implemented in Xsertion library.Comment: 10 pages, 3 figures, 2 tables, to appear in ISNN 201

Ensemble of heterogeneous flexible neural trees using multiobjective genetic programming

Machine learning algorithms are inherently multiobjective in nature, where approximation error minimization and model's complexity simplification are two conflicting objectives. We proposed a multiobjective genetic programming (MOGP) for creating a heterogeneous flexible neural tree (HFNT), tree-like flexible feedforward neural network model. The functional heterogeneity in neural tree nodes was introduced to capture a better insight of data during learning because each input in a dataset possess different features. MOGP guided an initial HFNT population towards Pareto-optimal solutions, where the final population was used for making an ensemble system. A diversity index measure along with approximation error and complexity was introduced to maintain diversity among the candidates in the population. Hence, the ensemble was created by using accurate, structurally simple, and diverse candidates from MOGP final population. Differential evolution algorithm was applied to fine-tune the underlying parameters of the selected candidates. A comprehensive test over classification, regression, and time-series datasets proved the efficiency of the proposed algorithm over other available prediction methods. Moreover, the heterogeneous creation of HFNT proved to be efficient in making ensemble system from the final population

Time series forecasting for dynamic environments: The DyFor Genetic Program model

Copyright © 2007 IEEESeveral studies have applied genetic programming (GP) to the task of forecasting with favorable results. However, these studies, like those applying other techniques, have assumed a static environment, making them unsuitable for many real-world time series which are generated by varying processes. This study investigates the development of a new ldquodynamicrdquo GP model that is specifically tailored for forecasting in nonstatic environments. This dynamic forecasting genetic program (DyFor GP) model incorporates features that allow it to adapt to changing environments automatically as well as retain knowledge learned from previously encountered environments. The DyFor GP model is tested for forecasting efficacy on both simulated and actual time series including the U.S. Gross Domestic Product and Consumer Price Index Inflation. Results show that the performance of the DyFor GP model improves upon that of benchmark models for all experiments. These findings highlight the DyFor GP's potential as an adaptive, nonlinear model for real-world forecasting applications and suggest further investigations.Neal Wagner, Zbigniew Michalewicz, Moutaz Khouja, and Rob Roy McGrego