Technical and Fundamental Features Analysis for Stock Market Prediction with Data Mining Methods

Predicting stock prices is an essential objective in the financial world. Forecasting stock returns and their risk represents one of the most critical concerns of market decision makers. This thesis investigates the stock price forecasting with three approaches from the data mining concept and shows how different elements in the stock price can help to enhance the accuracy of our prediction. For this reason, the first and second approaches capture many fundamental indicators from the stocks and implement them as explanatory variables to do stock price classification and forecasting. In the third approach, technical features from the candlestick representation of the share prices are extracted and used to enhance the accuracy of the forecasting. In each approach, different tools and techniques from data mining and machine learning are employed to justify why the forecasting is working. Furthermore, since the idea is to evaluate the potential of features in the stock trend forecasting, therefore we diversify our experiments using both technical and fundamental features. Therefore, in the first approach, a three-stage methodology is developed while in the first step, a comprehensive investigation of all possible features which can be effective on stocks risk and return are identified. Then, in the next stage, risk and return are predicted by applying data mining techniques for the given features. Finally, we develop a hybrid algorithm, based on some filters and function-based clustering; and re-predicted the risk and return of stocks. In the second approach, instead of using single classifiers, a fusion model is proposed based on the use of multiple diverse base classifiers that operate on a common input and a meta-classifier that learns from base classifiers’ outputs to obtain a more precise stock return and risk predictions. A set of diversity methods, including Bagging, Boosting, and AdaBoost, is applied to create diversity in classifier combinations. Moreover, the number and procedure for selecting base classifiers for fusion schemes are determined using a methodology based on dataset clustering and candidate classifiers’ accuracy. Finally, in the third approach, a novel forecasting model for stock markets based on the wrapper ANFIS (Adaptive Neural Fuzzy Inference System) – ICA (Imperialist Competitive Algorithm) and technical analysis of Japanese Candlestick is presented. Two approaches of Raw-based and Signal-based are devised to extract the model’s input variables and buy and sell signals are considered as output variables. To illustrate the methodologies, for the first and second approaches, Tehran Stock Exchange (TSE) data for the period from 2002 to 2012 are applied, while for the third approach, we used General Motors and Dow Jones indexes.Predicting stock prices is an essential objective in the financial world. Forecasting stock returns and their risk represents one of the most critical concerns of market decision makers. This thesis investigates the stock price forecasting with three approaches from the data mining concept and shows how different elements in the stock price can help to enhance the accuracy of our prediction. For this reason, the first and second approaches capture many fundamental indicators from the stocks and implement them as explanatory variables to do stock price classification and forecasting. In the third approach, technical features from the candlestick representation of the share prices are extracted and used to enhance the accuracy of the forecasting. In each approach, different tools and techniques from data mining and machine learning are employed to justify why the forecasting is working. Furthermore, since the idea is to evaluate the potential of features in the stock trend forecasting, therefore we diversify our experiments using both technical and fundamental features. Therefore, in the first approach, a three-stage methodology is developed while in the first step, a comprehensive investigation of all possible features which can be effective on stocks risk and return are identified. Then, in the next stage, risk and return are predicted by applying data mining techniques for the given features. Finally, we develop a hybrid algorithm, based on some filters and function-based clustering; and re-predicted the risk and return of stocks. In the second approach, instead of using single classifiers, a fusion model is proposed based on the use of multiple diverse base classifiers that operate on a common input and a meta-classifier that learns from base classifiers’ outputs to obtain a more precise stock return and risk predictions. A set of diversity methods, including Bagging, Boosting, and AdaBoost, is applied to create diversity in classifier combinations. Moreover, the number and procedure for selecting base classifiers for fusion schemes are determined using a methodology based on dataset clustering and candidate classifiers’ accuracy. Finally, in the third approach, a novel forecasting model for stock markets based on the wrapper ANFIS (Adaptive Neural Fuzzy Inference System) – ICA (Imperialist Competitive Algorithm) and technical analysis of Japanese Candlestick is presented. Two approaches of Raw-based and Signal-based are devised to extract the model’s input variables and buy and sell signals are considered as output variables. To illustrate the methodologies, for the first and second approaches, Tehran Stock Exchange (TSE) data for the period from 2002 to 2012 are applied, while for the third approach, we used General Motors and Dow Jones indexes.154 - Katedra financívyhově

The Use of Intelligent Systems for Planning and Scheduling of Product Development Projects

AbstractThe paper investigates the use of intelligent systems to identify the factors that significantly influence the duration of new product development. These factors are identified on the basis of an internal database of a production enterprise and further used to estimate the duration of phases in product development projects. In the paper, some models and methodologies of the knowledge discovery process are compared and a method of knowledge acquisition from an internal database is proposed. The presented approach is dedicated to industrial enterprises that develop modifications of previous products and are interested in obtaining more precise estimates for project planning and scheduling. The example contains four stages of the knowledge discovery process including data selection, data transformation, data mining, and interpretation of patterns. The example also presents a performance comparison of intelligent systems in the context of variable reduction and preprocessing. Among data mining techniques, artificial neural networks and the fuzzy neural system are chosen to seek relationships between the duration of project phase and other data stored in the information system of an enterprise

Neuro-fuzzy inference systems approach to decision support system for economic order quantity

Supply chain management (SCM) has a dynamic structure involving the constant flow of information, product, and funds among different participants. SCM is a complex process and most often characterized by uncertainty. Many values are stochastic and cannot be precisely determined and described by classical mathematical methods. Therefore, in solving real and complex problems individual methods of artificial intelligence are increasingly used, or their combination in the form of hybrid methods. This paper has proposed the decision support system for determining economic order quantity and order implementation based on Adaptive neuro-fuzzy inference systems - ANFIS. A combination of two concepts of artificial intelligence in the form of hybrid neuro-fuzzy method has been applied into the decision support system in order to exploit the individual advantages of both methods. This method can deal with complexity and uncertainty in SCM better than classical methods because they it stems from experts’ opinions. The proposed decision support system showed good results for determining the amount of economic order and it is presented as a successful tool for planning in SCM. Sensitivity analysis has been applied, which indicates that the decision sup- port system gives valid results. The proposed system is flexible and can be applied to various types of goods in SC

Design and Modeling of Stock Market Forecasting Using Hybrid Optimization Techniques

In this paper, an artificial neural network-based stock market prediction model was developed. Today, a lot of individuals are making predictions about the direction of the bond, currency, equity, and stock markets. Forecasting fluctuations in stock market values is quite difficult for businesspeople and industries. Forecasting future value changes on the stock markets is exceedingly difficult since there are so many different economic, political, and psychological factors at play. Stock market forecasting is also a difficult endeavour since it depends on so many various known and unknown variables. There are several ways used to try to anticipate the share price, including technical analysis, fundamental analysis, time series analysis, and statistical analysis; however, none of these approaches has been shown to be a consistently reliable prediction tool. We built three alternative Adaptive Neuro-Fuzzy Inference System (ANFIS) models to compare the outcomes. The average of the tuned models is used to create an ensemble model. Although comparable applications have been attempted in the literature, the data set is extremely difficult to work with because it only contains sharp peaks and falls with no seasonality. In this study, fuzzy c-means clustering, subtractive clustering, and grid partitioning are all used. The experiments we ran were designed to assess the effectiveness of various construction techniques used to our ANFIS models. When evaluating the outcomes, the metrics of R-squared and mean standard error are mostly taken into consideration. In the experiments, R-squared values of over.90 are attained

A comprehensive model of demand prediction based on hybrid artificial intelligence and metaheuristic algorithms: A case study in dairy industry

This paper presents a multi-stage model for accurate prediction of demand for dairy products (DDP) by the use of artificial intelligence tools including Multi- Layer Perceptron (MLP), Adaptive-Neural-based Fuzzy Inference System (ANFIS), and Support Vector Regression (SVR). The innovation of this work is the improvement of artificial intelligence tools with various meta-heuristic algorithms including Particle Swarm Optimization (PSO), Genetic Algorithm (GA), Invasive Weed Optimization (IWO), and Cultural Algorithm (CA). First, the best combination of factors with can affect the DDP is determined by solving a feature selection optimization problem. Then, the artificial intelligent tools are improved with the goal of making a prediction with minimal error. The results indicate that demographic behavior and inflation rate have the greatest impact on dairy consumption in Iran. Moreover, PSO still exhibits a better performance in feature selection in compare of newcomer meta-heuristic algorithms such as IWO and CA. However, IWO shows the best performance in improving the prediction tools by achieving an error of 0.008 and a coefficient of determination of 95%. The final analysis demonstrates the validity and reliability of the results of the proposed model, as it supports the simultaneous analysis and comparison of the outputs of different tools and methods

Unveiling the impact of managerial traits on investor decision prediction

Investment decisions are influenced by various factors, including personal characteristics and managerial issues. In this research, we aimed to investigate the impact of managerial traits on investment decisions by using adaptive neuro-fuzzy inference system (ANFIS) to develop a personalized investment recommendation system. We collected data from potential investors through a survey, which included questions on investment-types, investment habits, and managerial traits. The survey data were used to create an ANFIS model, which is a hybrid model that combines the strengths of both artificial neural networks and fuzzy logic systems. The ANFIS model was trained using 1542 survey data pairs, and the model's performance was evaluated using a validation set. The results of the ANFIS model showed that the model had a minimal training root mean square error of 0.837341. The ANFIS model was able to effectively capture the relationship between managerial traits and investment decisions and was able to make personalized investment recommendations based on the input data. The results of this research provide valuable insights into the impact of managerial traits on investment decisions and demonstrate the potential of ANFIS in developing personalized investment recommendation systems. In conclusion, this research aimed to investigate the impact of managerial traits on investment decisions using ANFIS. The results of this study demonstrate the potential of ANFIS to personalize investment recommendations based on the input data. This research can be used as a foundation for future research in the field of investment recommendations and can be helpful to investors to take their decision-making

An integrated approach to value chain analysis of end of life aircraft treatment

Dans cette thèse, on propose une approche holistique pour l’analyse, la modélisation et l’optimisation des performances de la chaîne de valeur pour le traitement des avions en fin de vie (FdV). Les recherches réalisées ont débouché sur onze importantes contributions. Dans la première contribution, on traite du contexte, de la complexité, de la diversité et des défis du recyclage d’avions en FdV. La seconde contribution traite du problème de la prédiction du nombre de retraits d’avions et propose une approche intégrée pour l’estimation de ce nombre de retraits. Le troisième et le quatrième articles visent à identifier les parties prenantes, les valeurs perçues par chaque partenaire et indiquent comment cette valeur peut affecter les décisions au stade de la conception. Les considérations relatives à la conception et à la fabrication ont donné lieu à quatre contributions importantes. La cinquième contribution traite des défis et opportunités pouvant résulter de l’application des concepts de la chaîne logistique verte, pour les manufacturiers d’avions. Dans la sixième contribution, un outil d’aide à la décision a été développé pour choisir la stratégie verte qui optimise les performances globales de de toute la chaîne de valeur en tenant compte des priorités et contraintes de chaque partenaire. Dans la septième contribution, un modèle mathématique est proposé pour analyser le choix stratégique des manufacturiers en réponse aux directives en matière de FdV de produits comme le résultat des interactions des compétiteurs dans le marché. La huitième contribution porte sur les travaux réalisés dans le cadre d’un stage chez le constructeur d’avions, Bombardier. Cette dernière traite de l’apport de « l’analyse du cycle de vie » au stade de la conception d’avions. La neuvième contribution introduit une méthodologie d’analyse de la chaîne de valeur dans un contexte de développement durable. Finalement, les dixième et onzième contributions proposent une approche holistique pour le traitement des avions en FdV en intégrant les concepts du « lean », du développement durable et des contraintes et opportunités inhérentes à la mondialisation des affaires. Un modèle d’optimisation intégrant les modèles d’affaires, les stratégies de désassemblage et les structures du réseau qui influencent l’efficacité, la stabilité et l’agilité du réseau de récupération est proposé. Les données requises pour exploiter le modèle sont indiquées dans l’article. Mots-clés: Fin de vie des avions, analyse de la chaîne de valeurs, développement durable, intervenants.The number of aircrafts at the end of life (EOL) is continuously increasing. Dealing with retired aircrafts considering the environmental, social and economic impacts is becoming an emerging problem in the aviation industry in near future. This thesis seeks to develop a holistic approach in order to analyze the value chain of EOL aircraft treatment in the context of sustainable development. The performed researches have led to eleven main contributions. In the first contribution, the complexity and diversity of the EOL aircraft recycling including the challenges and problem context are discussed. The second contribution addresses the challenges for estimation of retired aircrafts and proposes an integrated approach for prediction of EOL aircrafts. The third and fourth contributions aim to identify the players involved in EOL recycling context, values perceived by different shareholders and formulate that how such value can affect design decisions. Design stage consideration and manufacture’s issues are discussed and have led to four main contributions. The fifth contribution addresses the opportunities and challenges of applying green supply chain for aircraft manufacturers. In the sixth contribution, a decision tool is developed to aid manufactures in early stage of design for their green strategy choices. In the seventh contribution, a mathematical model is developed in order to analyze the strategic choice of manufacturers in response to EOL directives as the result of the interaction of competitors in the market. An internship project has been also performed in Bombardier and led to the eighth contribution, which addresses life cycle approach and incorporating the sustainability in early stage of design of aircraft. The ninth contribution introduces a methodology for analyzing the value chain in the context of sustainable development. Finally, the tenth and eleventh contributions propose a holistic approach to EOL aircraft treatment considering lean principals, sustainable development, and global business environment. An optimization model is developed to support decision making in both strategic and managerial level. The analytical approaches, decision tools and step by step guidelines proposed in this thesis will aid decision makers to identify appropriate strategies for the EOL aircraft treatment in the sustainable development context. Keywords: End of life aircraft, value chain analysis, sustainable development, stakeholders

Neuro-Fuzzy Based Intelligent Approaches to Nonlinear System Identification and Forecasting

Nearly three decades back nonlinear system identification consisted of several ad-hoc approaches, which were restricted to a very limited class of systems. However, with the advent of the various soft computing methodologies like neural networks and the fuzzy logic combined with optimization techniques, a wider class of systems can be handled at present. Complex systems may be of diverse characteristics and nature. These systems may be linear or nonlinear, continuous or discrete, time varying or time invariant, static or dynamic, short term or long term, central or distributed, predictable or unpredictable, ill or well defined. Neurofuzzy hybrid modelling approaches have been developed as an ideal technique for utilising linguistic values and numerical data. This Thesis is focused on the development of advanced neurofuzzy modelling architectures and their application to real case studies. Three potential requirements have been identified as desirable characteristics for such design: A model needs to have minimum number of rules; a model needs to be generic acting either as Multi-Input-Single-Output (MISO) or Multi-Input-Multi-Output (MIMO) identification model; a model needs to have a versatile nonlinear membership function. Initially, a MIMO Adaptive Fuzzy Logic System (AFLS) model which incorporates a prototype defuzzification scheme, while utilising an efficient, compared to the Takagi–Sugeno–Kang (TSK) based systems, fuzzification layer has been developed for the detection of meat spoilage using Fourier transform infrared (FTIR) spectroscopy. The identification strategy involved not only the classification of beef fillet samples in their respective quality class (i.e. fresh, semi-fresh and spoiled), but also the simultaneous prediction of their associated microbiological population directly from FTIR spectra. In the case of AFLS, the number of memberships for each input variable was directly associated to the number of rules, hence, the “curse of dimensionality” problem was significantly reduced. Results confirmed the advantage of the proposed scheme against Adaptive Neurofuzzy Inference System (ANFIS), Multilayer Perceptron (MLP) and Partial Least Squares (PLS) techniques used in the same case study. In the case of MISO systems, the TSK based structure, has been utilized in many neurofuzzy systems, like ANFIS. At the next stage of research, an Adaptive Fuzzy Inference Neural Network (AFINN) has been developed for the monitoring the spoilage of minced beef utilising multispectral imaging information. This model, which follows the TSK structure, incorporates a clustering pre-processing stage for the definition of fuzzy rules, while its final fuzzy rule base is determined by competitive learning. In this specific case study, AFINN model was also able to predict for the first time in the literature, the beef’s temperature directly from imaging information. Results again proved the superiority of the adopted model. By extending the line of research and adopting specific design concepts from the previous case studies, the Asymmetric Gaussian Fuzzy Inference Neural Network (AGFINN) architecture has been developed. This architecture has been designed based on the above design principles. A clustering preprocessing scheme has been applied to minimise the number of fuzzy rules. AGFINN incorporates features from the AFLS concept, by having the same number of rules as well as fuzzy memberships. In spite of the extensive use of the standard symmetric Gaussian membership functions, AGFINN utilizes an asymmetric function acting as input linguistic node. Since the asymmetric Gaussian membership function’s variability and flexibility are higher than the traditional one, it can partition the input space more effectively. AGFINN can be built either as an MISO or as an MIMO system. In the MISO case, a TSK defuzzification scheme has been implemented, while two different learning algorithms have been implemented. AGFINN has been tested on real datasets related to electricity price forecasting for the ISO New England Power Distribution System. Its performance was compared against a number of alternative models, including ANFIS, AFLS, MLP and Wavelet Neural Network (WNN), and proved to be superior. The concept of asymmetric functions proved to be a valid hypothesis and certainly it can find application to other architectures, such as in Fuzzy Wavelet Neural Network models, by designing a suitable flexible wavelet membership function. AGFINN’s MIMO characteristics also make the proposed architecture suitable for a larger range of applications/problems

Gene expression programming for Efficient Time-series Financial Forecasting

Stock market prediction is of immense interest to trading companies and buyers due to high profit margins. The majority of successful buying or selling activities occur close to stock price turning trends. This makes the prediction of stock indices and analysis a crucial factor in the determination that whether the stocks will increase or decrease the next day. Additionally, precise prediction of the measure of increase or decrease of stock prices also plays an important role in buying/selling activities. This research presents two core aspects of stock-market prediction. Firstly, it presents a Networkbased Fuzzy Inference System (ANFIS) methodology to integrate the capabilities of neural networks with that of fuzzy logic. A specialised extension to this technique is known as the genetic programming (GP) and gene expression programming (GEP) to explore and investigate the outcome of the GEP criteria on the stock market price prediction. The research presented in this thesis aims at the modelling and prediction of short-tomedium term stock value fluctuations in the market via genetically tuned stock market parameters. The technique uses hierarchically defined GP and gene-expressionprogramming (GEP) techniques to tune algebraic functions representing the fittest equation for stock market activities. The technology achieves novelty by proposing a fractional adaptive mutation rate Elitism (GEP-FAMR) technique to initiate a balance between varied mutation rates between varied-fitness chromosomes thereby improving prediction accuracy and fitness improvement rate. The methodology is evaluated against five stock market companies with each having its own trading circumstances during the past 20+ years. The proposed GEP/GP methodologies were evaluated based on variable window/population sizes, selection methods, and Elitism, Rank and Roulette selection methods. The Elitism-based approach showed promising results with a low error-rate in the resultant pattern matching with an overall accuracy of 95.96% for short-term 5-day and 95.35% for medium-term 56-day trading periods. The contribution of this research to theory is that it presented a novel evolutionary methodology with modified selection operators for the prediction of stock exchange data via Gene expression programming. The methodology dynamically adapts the mutation rate of different fitness groups in each generation to ensure a diversification II balance between high and low fitness solutions. The GEP-FAMR approach was preferred to Neural and Fuzzy approaches because it can address well-reported problems of over-fitting, algorithmic black-boxing, and data-snooping issues via GP and GEP algorithmsSaudi Cultural Burea