Techniques for Stock Market Prediction: A Review

Stock market forecasting has long been viewed as a vital real-life topic in economics world. There are many challenges in stock market prediction systems such as the Efficient Market Hypothesis (EMH), Nonlinearity, complex, diverse datasets, and parameter optimization. A stock's value on the stock market fluctuates due to many factors like previous trends of the stock, the current news, twitter feeds, any online customer feedbacks etc. In this paper, the literature is critically analysed on approaches used for stock market prediction in terms of stock datasets, features used, evaluation metrics used, statistical, machine learning and deep learning techniques along with the directions for the future. The focus of this review is on trend and value prediction for stocks. Overall, 68 research papers have been considered for review from years 1998-2023. From the review, Indian stock market datasets are found to be most frequently used datasets. Evaluation metrics used commonly are accuracy and Mean Absolute Percentage Error. ARIMA is reported as the most used frequently statistical technique for stick market prediction. Long-Short Term Memory and Support Vector Machine are the commonly used algorithms in stock market prediction. The advantages and disadvantages of frequently used evaluation metrics, machine learning, deep learning and statistical approaches are also included in this survey

Technical and Fundamental Features Analysis for Stock Market Prediction with Data Mining Methods

Predicting stock prices is an essential objective in the financial world. Forecasting stock returns and their risk represents one of the most critical concerns of market decision makers. This thesis investigates the stock price forecasting with three approaches from the data mining concept and shows how different elements in the stock price can help to enhance the accuracy of our prediction. For this reason, the first and second approaches capture many fundamental indicators from the stocks and implement them as explanatory variables to do stock price classification and forecasting. In the third approach, technical features from the candlestick representation of the share prices are extracted and used to enhance the accuracy of the forecasting. In each approach, different tools and techniques from data mining and machine learning are employed to justify why the forecasting is working. Furthermore, since the idea is to evaluate the potential of features in the stock trend forecasting, therefore we diversify our experiments using both technical and fundamental features. Therefore, in the first approach, a three-stage methodology is developed while in the first step, a comprehensive investigation of all possible features which can be effective on stocks risk and return are identified. Then, in the next stage, risk and return are predicted by applying data mining techniques for the given features. Finally, we develop a hybrid algorithm, based on some filters and function-based clustering; and re-predicted the risk and return of stocks. In the second approach, instead of using single classifiers, a fusion model is proposed based on the use of multiple diverse base classifiers that operate on a common input and a meta-classifier that learns from base classifiers’ outputs to obtain a more precise stock return and risk predictions. A set of diversity methods, including Bagging, Boosting, and AdaBoost, is applied to create diversity in classifier combinations. Moreover, the number and procedure for selecting base classifiers for fusion schemes are determined using a methodology based on dataset clustering and candidate classifiers’ accuracy. Finally, in the third approach, a novel forecasting model for stock markets based on the wrapper ANFIS (Adaptive Neural Fuzzy Inference System) – ICA (Imperialist Competitive Algorithm) and technical analysis of Japanese Candlestick is presented. Two approaches of Raw-based and Signal-based are devised to extract the model’s input variables and buy and sell signals are considered as output variables. To illustrate the methodologies, for the first and second approaches, Tehran Stock Exchange (TSE) data for the period from 2002 to 2012 are applied, while for the third approach, we used General Motors and Dow Jones indexes.Predicting stock prices is an essential objective in the financial world. Forecasting stock returns and their risk represents one of the most critical concerns of market decision makers. This thesis investigates the stock price forecasting with three approaches from the data mining concept and shows how different elements in the stock price can help to enhance the accuracy of our prediction. For this reason, the first and second approaches capture many fundamental indicators from the stocks and implement them as explanatory variables to do stock price classification and forecasting. In the third approach, technical features from the candlestick representation of the share prices are extracted and used to enhance the accuracy of the forecasting. In each approach, different tools and techniques from data mining and machine learning are employed to justify why the forecasting is working. Furthermore, since the idea is to evaluate the potential of features in the stock trend forecasting, therefore we diversify our experiments using both technical and fundamental features. Therefore, in the first approach, a three-stage methodology is developed while in the first step, a comprehensive investigation of all possible features which can be effective on stocks risk and return are identified. Then, in the next stage, risk and return are predicted by applying data mining techniques for the given features. Finally, we develop a hybrid algorithm, based on some filters and function-based clustering; and re-predicted the risk and return of stocks. In the second approach, instead of using single classifiers, a fusion model is proposed based on the use of multiple diverse base classifiers that operate on a common input and a meta-classifier that learns from base classifiers’ outputs to obtain a more precise stock return and risk predictions. A set of diversity methods, including Bagging, Boosting, and AdaBoost, is applied to create diversity in classifier combinations. Moreover, the number and procedure for selecting base classifiers for fusion schemes are determined using a methodology based on dataset clustering and candidate classifiers’ accuracy. Finally, in the third approach, a novel forecasting model for stock markets based on the wrapper ANFIS (Adaptive Neural Fuzzy Inference System) – ICA (Imperialist Competitive Algorithm) and technical analysis of Japanese Candlestick is presented. Two approaches of Raw-based and Signal-based are devised to extract the model’s input variables and buy and sell signals are considered as output variables. To illustrate the methodologies, for the first and second approaches, Tehran Stock Exchange (TSE) data for the period from 2002 to 2012 are applied, while for the third approach, we used General Motors and Dow Jones indexes.154 - Katedra financívyhově

Forecasting Crude Oil Price with Multiscale Denoising Ensemble Model

Crude oil price becomes more volatile and sensitive to increasingly diversified influencing factors with higher level of deregulations worldwide. Current methodologies are being challenged as they have been constrained by traditional approaches assuming homogeneous time horizons and investment strategies. Approximations they provided over the long term time horizon no longer satisfy the accuracy requirement at shorter term and more microlevels. This paper proposes a novel crude oil price forecasting model based on the wavelet denoising ARMA models ensemble by least square support vector regression with the reduced forecasting matrix dimensions by independent component analysis. The proposed methodology combines the multi resolution analysis and nonlinear ensemble framework. The wavelet denoising based algorithm is introduced to separate and extract the underlying data components with distinct features, corresponding to investors with different investment scales, which are modeled with time series models of different specifications and parameters. Then least square support vector regression is introduced to nonlinearly ensemble results based on different wavelet families to further reduce the estimation biases and improve the forecasting generalizability. Empirical studies show the significant performance improvement when the proposed model is tested against the bench-mark models

Big Data and the Internet of Things

Advances in sensing and computing capabilities are making it possible to embed increasing computing power in small devices. This has enabled the sensing devices not just to passively capture data at very high resolution but also to take sophisticated actions in response. Combined with advances in communication, this is resulting in an ecosystem of highly interconnected devices referred to as the Internet of Things - IoT. In conjunction, the advances in machine learning have allowed building models on this ever increasing amounts of data. Consequently, devices all the way from heavy assets such as aircraft engines to wearables such as health monitors can all now not only generate massive amounts of data but can draw back on aggregate analytics to "improve" their performance over time. Big data analytics has been identified as a key enabler for the IoT. In this chapter, we discuss various avenues of the IoT where big data analytics either is already making a significant impact or is on the cusp of doing so. We also discuss social implications and areas of concern.Comment: 33 pages. draft of upcoming book chapter in Japkowicz and Stefanowski (eds.) Big Data Analysis: New algorithms for a new society, Springer Series on Studies in Big Data, to appea

Forex Trading Signal Extraction with Deep Learning Models

The rise of AI technology has popularized deep learning models for financial trading prediction, promising substantial profits with minimal risk. Institutions like Westpac, Commonwealth Bank of Australia, Macquarie Bank, and Bloomberg invest heavily in this transformative technology. Researchers have also explored AI's potential in the exchange rate market. This thesis focuses on developing advanced deep learning models for accurate forex market prediction and AI-powered trading strategies. Three deep learning models are introduced: an event-driven LSTM model, an Attention-based VGG16 model named MHATTN-VGG16, and a pre-trained model called TradingBERT. These models aim to enhance signal extraction and price forecasting in forex trading, offering valuable insights for decision-making. The first model, an LSTM, predicts retracement points crucial for identifying trend reversals. It outperforms baseline models like GRU and RNN, thanks to noise reduction in the training data. Experiments determine the optimal number of timesteps for trend identification, showing promise for building a robotic trading platform. The second model, MHATTN-VGG16, predicts maximum and minimum price movements in forex chart images. It combines VGG16 with multi-head attention and positional encoding to effectively classify financial chart images. The third model utilizes a pre-trained BERT architecture to transform trading price data into normalized embeddings, enabling meaningful signal extraction from financial data. This study pioneers the use of pre-trained models in financial trading and introduces a method for converting continuous price data into categorized elements, leveraging the success of BERT. This thesis contributes innovative approaches to deep learning in algorithmic trading, offering traders and investors precision and confidence in navigating financial markets

Smart Sensor Monitoring in Machining of Difficult-to-cut Materials

The research activities presented in this thesis are focused on the development of smart sensor monitoring procedures applied to diverse machining processes with particular reference to the machining of difficult-to-cut materials. This work will describe the whole smart sensor monitoring procedure starting from the configuration of the multiple sensor monitoring system for each specific application and proceeding with the methodologies for sensor signal detection and analysis aimed at the extraction of signal features to feed to intelligent decision-making systems based on artificial neural networks. The final aim is to perform tool condition monitoring in advanced machining processes in terms of tool wear diagnosis and forecast, in the perspective of zero defect manufacturing and green technologies. The work has been addressed within the framework of the national MIUR PON research project CAPRI, acronym for “Carrello per atterraggio con attuazione intelligente” (Landing Gear with Intelligent Actuation), and the research project STEP FAR, acronym for “Sviluppo di materiali e Tecnologie Ecocompatibili, di Processi di Foratura, taglio e di Assemblaggio Robotizzato” (Development of eco-compatible materials and technologies for robotised drilling and assembly processes). Both projects are sponsored by DAC, the Campania Technological Aerospace District, and involve two aerospace industries, Magnaghi Aeronautica S.p.A. and Leonardo S.p.A., respectively. Due to the industrial framework in which the projects were developed and taking advantage of the support from the industrial partners, the project activities have been carried out with the aim to contribute to the scientific research in the field of machining process monitoring as well as to promote the industrial applicability of the results. The thesis was structured in order to illustrate all the methodologies, the experimental tests and the results obtained from the research activities. It begins with an introduction to “Sensor monitoring of machining processes” (Chapter 2) with particular attention to the main sensor monitoring applications and the types of sensors which are employed in machining. The key methods for advanced sensor signal processing, including the implementation of sensor fusion technology, are discussed in details as they represent the basic input for cognitive decision-making systems construction. The chapter finally presents a brief discussion on cloud-based manufacturing which will represent one of the future developments of this research work. Chapters 3 and 4 illustrate the case studies of machining process sensor monitoring investigated in the research work. Within the CAPRI project, the feasibility of the dry turning process of Ti6Al4V alloy (Chapter 3) was studied with particular attention to the optimization of the machining parameters avoiding the use of coolant fluids. Since very rapid tool wear is experienced during dry machining of Titanium alloys, the multiple sensor monitoring system was used in order to develop a methodology based on a smart system for on line tool wear detection in terms of maximum flank wear land. Within the STEP FAR project, the drilling process of carbon fibre reinforced (CFRP) composite materials was studied using diverse experimental set-ups. Regarding the tools, three different types of drill bit were employed, including traditional as well as innovative geometry ones. Concerning the investigated materials, two different types of stack configurations were employed, namely CFRP/CFRP stacks and hybrid Al/CFRP stacks. Consequently, the machining parameters for each experimental campaign were varied, and also the methods for signal analysis were changed to verify the performance of the different methodologies. Finally, for each case different neural network configurations were investigated for cognitive-based decision making. First of all, the applicability of the system was tested in order to perform tool wear diagnosis and forecast. Then, the discussion proceeds with a further aim of the research work, which is the reduction of the number of selected sensor signal features, in order to improve the performance of the cognitive decision-making system, simplify modelling and facilitate the implementation of these methodologies in a cloud manufacturing approach to tool condition monitoring. Sensor fusion methodologies were applied to the extracted and selected sensor signal features in the perspective of feature reduction with the purpose to implement these procedures for big data analytics within the Industry 4.0 framework. In conclusion, the positive impact of the proposed tool condition monitoring methodologies based on multiple sensor signal acquisition and processing is illustrated, with particular reference to the reliable assessment of tool state in order to avoid too early or too late cutting tool substitution that negatively affect machining time and cost