An empirical study on the various stock market prediction methods

Investment in the stock market is one of the much-admired investment actions. However, prediction of the stock market has remained a hard task because of the non-linearity exhibited. The non-linearity is due to multiple affecting factors such as global economy, political situations, sector performance, economic numbers, foreign institution investment, domestic institution investment, and so on. A proper set of such representative factors must be analyzed to make an efficient prediction model. Marginal improvement of prediction accuracy can be gainful for investors. This review provides a detailed analysis of research papers presenting stock market prediction techniques. These techniques are assessed in the time series analysis and sentiment analysis section. A detailed discussion on research gaps and issues is presented. The reviewed articles are analyzed based on the use of prediction techniques, optimization algorithms, feature selection methods, datasets, toolset, evaluation matrices, and input parameters. The techniques are further investigated to analyze relations of prediction methods with feature selection algorithm, datasets, feature selection methods, and input parameters. In addition, major problems raised in the present techniques are also discussed. This survey will provide researchers with deeper insight into various aspects of current stock market prediction methods

Tendencias líderes de investigación sobre estrategias de trading

[EN] Trading strategies have attracted the attention of academic researchers and practitioners for a long time, but most specially in recent years due to the explosion of high-quality databases and computation capacity. Numerous studies are devoted to the analysis and proposal of trading strategies which cover aspects such as trend prediction, variables selection, technical analysis, pattern recognition etc. and apply many di erent methodologies. This paper conducts a meta-literature review which covers 1187 research articles from 1984 to 2020. The aim of this paper is to show the increasing importance of the topic and present a systematic study of the leading research areas, countries, institutions and authors contributing to this field. Moreover, a network analysis to identify the main research streams and future research opportunities is conducted.[ES] La creación de estrategias de inversión siempre ha atraído la atención de los académicos y de los inversores profesionales, pero, indudablemente, esta popularidad ha aumentado en los últimos años, con la aparición de bases de datos más completas y mayor potencia de cálculo de las computadoras. Son numerosos los estudios que analizan y proponen estrategias de inversión y que tratan aspectos como la predicción de la tendencia, la selección de variables, el análisis técnico, el reconocimiento de patrones etc. aplicando diferentes metodologías. En este trabajo se realiza un estudio bibliográfico que abarca 1187 artículos de investigación desde 1984 hasta 2020. El objetivo es mostrar la creciente importancia de este campo de investigación y presentar un análisis sistemático de los países, instituciones y autores que más están contribuyendo al avance del conocimiento. Además, se realiza un análisis de redes para identificar las principales áreas de investigación y las tendencias futuras.Oliver-Muncharaz, J.; García García, F. (2020). Leading research trends on trading strategies. Finance, Markets and Valuation. 6(2):27-54. https://doi.org/10.46503/LHTP1113S27546

Iberian Energy Market: Spot Price Forecast by Modelling Market Offers

Electricity is a very special commodity since it is economically non-storable, and thus requiring a constant balance between production and consumption. At the corporate level, electricity price forecasts have become a fundamental input to energy companies’ decision making mechanisms [22, 45]. Electric utilities are higly vulnerable to economical crisis, since they generally cannot pass their excess costs on the wholesale market to the retail consumers [77] and, since the price depends on variables like weather (temperature, wind speed, precipitation, etc.) and the intensity of business and everyday activities (on-peak vs. off-peak hours, weekdays vs. weekends, holidays and near-holidays, etc.) it shows specific dynamics not observed in any other market, exhibiting seasonality at the daily, weekly and annual levels, and abrupt, short-lived and generally unanticipated price spikes. These extreme price volatility make price forecasts from a few hours to a few months ahead to become of particular interest to power portfolio managers. An utility company or large industrial consumer who is able to accurately forecast the wholesale prices and it’s volatility, can adjust its bidding strategy and its own production/consumption schedule in order to reduce the risk or maximize the profits in day-ahead trading. In this work I discuss the dynamics of the Iberian electricity day-ahead market (OMIE), review the state-of-the-art forecasting techniques and introduce a new approach to Electricity Price Forecasting, by forecasting the underlying dynamics, the market demand/supply curves. With this method it is possible to predict not only the electricity prices for the next hours, but also the market curves, which can then be used for risk management and a more accurate schedule of generation units. I analyze the model results and benchmark them against other models in the industry.A eletricidade é uma commodity muito especial, uma vez que não é possível armazená-la, e por isso, requer um constante equilíbrio entre a produção e consumo. ao nível empresarial, a previsão de preços de eletricidade tornou-se um input fundamental para os mecanismos de tomada de decisão das companhias [22, 45]. As empresas de eletricidade são altamente vulneráveis a crises económicas, uma vez que, em geral, não conseguem passar os seus custos excessivos para o mercado retalhista [77] e, uma vez que o preço depende de variáveis como meteorologia (temperatura, velocidade do vento, precipitação, etc.) e da intensidade de negócio e das atividades do dia-a-dia (pico vs vazio, dias da semana vs fim-de-semana, feriados e pontes, etc.) apresenta uma dinâmica que não é observada em mais nenhum mercado, com sazonalidade diária, semanal e anual, e com picos de preço abruptos de pouca duração e, em termos gerais, impossíveis de antecipar. Esta volatilidade de preços torna a previsão de preços particularmente interessante para gestores de portfólio, seja a curto ou a longo prazo. Uma companhia de eletricidade ou grande consumidor industrial que seja capaz de prever corretamente os preços do mercado grossista e a sua volatilidade, pode ajustar a estratégia de oferta da sua produção/seu consumo de maneira a reduzir o risco ou maximizar os ganhos no mercado à vista. Neste trabalho abordo a dinâmica do mercado de eletricidade ibérico (Operador de Mercado Iberico - Polo Español (OMIE)), revendo o estado da arte dos métodos de previsão de preços de eletricidade, e introduzo uma nova técnica de previsão de preços de eletricidade, através da previsão da sua dinâmica subjacente, as curvas de mercado da procura e oferta. Com este método é possível prever, não só o preço de eletricidade para as próximas horas, mas também as próprias curvas de oferta, o que pode ser utilizado na gestão de risco ao melhor a capacidade de programar as suas unidades de geração.Os resultados do modelo são analisados e comparados com outros modelos já utilizados na industria

Energy Management of Prosumer Communities

The penetration of distributed generation, energy storages and smart loads has resulted in the emergence of prosumers: entities capable of adjusting their electricity production and consumption in order to meet environmental goals and to participate profitably in the available electricity markets. Significant untapped potential remains in the exploitation and coordination of small and medium-sized distributed energy resources. However, such resources usually have a primary purpose, which imposes constraints on the exploitation of the resource; for example, the primary purpose of an electric vehicle battery is for driving, so the battery could be used as temporary storage for excess photovoltaic energy only if the vehicle is available for driving when the owner expects it to be. The aggregation of several distributed energy resources is a solution for coping with the unavailability of one resource. Solutions are needed for managing the electricity production and consumption characteristics of diverse distributed energy resources in order to obtain prosumers with more generic capabilities and services for electricity production, storage, and consumption. This collection of articles studies such prosumers and the emergence of prosumer communities. Demand response-capable smart loads, battery storages and photovoltaic generation resources are forecasted and optimized to ensure energy-efficient and, in some cases, profitable operation of the resources

A novel hybrid ensemble model to predict FTSE100 index by combining neural network and EEMD

Prediction stock price is considered the most challenging and important financial topic. Thus, its complexity, nonlinearity and much other characteristic, single method could not optimize a good result. Hence, this paper proposes a hybrid ensemble model based on BP neural network and EEMD to predict FTSE100 closing price. In this paper there are five hybrid prediction models, EEMD-NN, EEMD-Bagging-NN, EEMD-Cross validation-NN, EEMD-CV-Bagging-NN and EEMD-NN-Proposed method. Experimental result shows that EEMD-Bagging-NN, EEMD-Cross validation-NN and EEMD-CV-Bagging-NN models performance are a notch above EEMD-NN and significantly higher than the single-NN model. In addition, EEMD-NN-Proposed method prediction performance superiority is demonstrated comparing with the all presented model in this paper, and was feasible and effective in prediction FTSE100 closing price. As a result of the significant performance of the proposed method, the method can be utilized to predict other financial time series data

Machine Learning for Load Profile Data Analytics and Short-term Load Forecasting

Short-term load forecasting (STLF) is a key issue for the operation and dispatch of day ahead energy market. It is a prerequisite for the economic operation of power systems and the basis of dispatching and making startup-shutdown plans, which plays a key role in the automatic control of power systems. Accurate power load forecasting not only help users choose a more appropriate electricity consumption scheme and reduces a lot of electric cost expenditure but also is conducive to optimizing the resources of power systems. This advantage helps while improving equipment utilization for reducing the production cost and improving the economic benefit, and improving power supply capability. Therefore, ultimately achieving the aim of efficient demand response program. This thesis outlines some machine learning based data driven models for STLF in smart grid. It also presents different policies and current statuses as well as future research direction for developing new STLF models. This thesis outlines three projects for load profile data analytics and machine learning based STLF models. First project is, load profile classification and determining load demand variability with the aim to estimate the load demand of a customer. In this project load profile data collected from smart meter are classified using recently developed extended nearest neighbor (ENN) algorithm. Here we have calculated generalized class wise statistics which will give the idea of load demand variability of a customer. Finally the load demand of a particular customer is estimated based on generalized class wise statistics, maximum load demand and minimum load demand. In the second project, a composite ENN model is proposed for STLF. The ENN model is proposed to improve the performance of k-nearest neighbor (kNN) algorithm based STLF models. In this project we have developed three individual models to process weather data i.e., temperature, social variables, and load demand data. The load demand is predicted separately for different input variables. Finally the load demand is forecasted from the weighted average of three models. The weights are determined based on the change in generalized class wise statistics. This projects provides a significant improvement in the performance of load forecasting accuracy compared to kNN based models. In the third project, an advanced data driven model is developed. Here, we have proposed a novel hybrid load forecasting model based on novel signal decomposition and correlation analysis. The hybrid model consists of improved empirical mode decomposition, T-Copula based correlation analysis. Finally we have employed deep belief network for making load demand forecasting. The results are compared with previous studies and it is evident that there is a significant improvement in mean absolute percentage error (MAPE) and root mean square error (RMSE)

Crude oil risk forecasting : new evidence from multiscale analysis approach

Fluctuations in the crude oil price allied to risk have increased significantly over the last decade frequently varying at different risk levels. Although existing models partially predict such variations, so far, they have been unable to predict oil prices accurately in this highly volatile market. The development of an effective, predictive model has therefore become a prime objective of research in this field. Our approach, albeit based in part on previous research, develops an original methodology, in that we have created a risk forecasting model with the ability to predict oil price fluctuations caused by changes in both fundamental and transient risk factors. We achieve this by disintegrating the multi-scale risk-structure of the crude oil market using Variational Mode Decomposition. Normal and transient risk factors are then extracted from the crude oil price using Variational Mode Decomposition and modelled separately using the Quantile Regression Neural Network (QRNN) model. Both risk factors are integrated and ensembled to produce the risk estimates. We then apply our proposed risk forecasting model to predicting future downside risk level in three major crude oil markets, namely the West Taxes Intermediate (WTI), the Brent Market, and the OPEC market. The results demonstrate that our model has the ability to capture downside risk estimates with significantly improved precision, thus reducing estimation errors and increasing forecasting reliability

Enhancing statistical wind speed forecasting models : a thesis presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Engineering at Massey University, Manawatū Campus, New Zealand

In recent years, wind speed forecasting models have seen significant development and growth. In particular, hybrid models have been emerging since the last decade. Hybrid models combine two or more techniques from several categories, with each model utilizing its distinct strengths. Mainly, data-driven models that include statistical and Artificial Intelligence/Machine Learning (AI/ML) models are deployed in hybrid models for shorter forecasting time horizons (< 6hrs). Literature studies show that machine learning models have gained enormous potential owing to their accuracy and robustness. On the other hand, only a handful of studies are available on the performance enhancement of statistical models, despite the fact that hybrid models are incomplete without statistical models. To address the knowledge gap, this thesis identified the shortcomings of traditional statistical models while enhancing prediction accuracy. Three statistical models are considered for analyses: Grey Model [GM(1,1)], Markov Chain, and Holt’s Double Exponential Smoothing models. Initially, the problems that limit the forecasting models' applicability are highlighted. Such issues include negative wind speed predictions, failure of predetermined accuracy levels, non-optimal estimates, and additional computational cost with limited performance. To address these concerns, improved forecasting models are proposed considering wind speed data of Palmerston North, New Zealand. Several methodologies have been developed to improve the model performance and fulfill the necessary and sufficient conditions. These approaches include adjusting dynamic moving window, self-adaptive state categorization algorithm, a similar approach to the leave-one-out method, and mixed initialization method. Keeping in view the application of the hybrid methods, novel MODWT-ARIMA-Markov and AGO-HDES models are further proposed as secondary objectives. Also, a comprehensive analysis is presented by comparing sixteen models from three categories, each for four case studies, three rolling windows, and three forecasting horizons. Overall, the improved models showed higher accuracy than their counter traditional models. Finally, the future directions are highlighted that need subsequent research to improve forecasting performance further