AI and OR in management of operations: history and trends

The last decade has seen a considerable growth in the use of Artificial Intelligence (AI) for operations management with the aim of finding solutions to problems that are increasing in complexity and scale. This paper begins by setting the context for the survey through a historical perspective of OR and AI. An extensive survey of applications of AI techniques for operations management, covering a total of over 1200 papers published from 1995 to 2004 is then presented. The survey utilizes Elsevier's ScienceDirect database as a source. Hence, the survey may not cover all the relevant journals but includes a sufficiently wide range of publications to make it representative of the research in the field. The papers are categorized into four areas of operations management: (a) design, (b) scheduling, (c) process planning and control and (d) quality, maintenance and fault diagnosis. Each of the four areas is categorized in terms of the AI techniques used: genetic algorithms, case-based reasoning, knowledge-based systems, fuzzy logic and hybrid techniques. The trends over the last decade are identified, discussed with respect to expected trends and directions for future work suggested

Meta-Learning Evolutionary Artificial Neural Networks

In this paper, we present MLEANN (Meta-Learning Evolutionary Artificial Neural Network), an automatic computational framework for the adaptive optimization of artificial neural networks wherein the neural network architecture, activation function, connection weights; learning algorithm and its parameters are adapted according to the problem. We explored the performance of MLEANN and conventionally designed artificial neural networks for function approximation problems. To evaluate the comparative performance, we used three different well-known chaotic time series. We also present the state of the art popular neural network learning algorithms and some experimentation results related to convergence speed and generalization performance. We explored the performance of backpropagation algorithm; conjugate gradient algorithm, quasi-Newton algorithm and Levenberg-Marquardt algorithm for the three chaotic time series. Performances of the different learning algorithms were evaluated when the activation functions and architecture were changed. We further present the theoretical background, algorithm, design strategy and further demonstrate how effective and inevitable is the proposed MLEANN framework to design a neural network, which is smaller, faster and with a better generalization performance

NARX-based nonlinear system identification using orthogonal least squares basis hunting

An orthogonal least squares technique for basis hunting (OLS-BH) is proposed to construct sparse radial basis function (RBF) models for NARX-type nonlinear systems. Unlike most of the existing RBF or kernel modelling methods, whichplaces the RBF or kernel centers at the training input data points and use a fixed common variance for all the regressors, the proposed OLS-BH technique tunes the RBF center and diagonal covariance matrix of individual regressor by minimizing the training mean square error. An efficient optimization method isadopted for this basis hunting to select regressors in an orthogonal forward selection procedure. Experimental results obtained using this OLS-BH technique demonstrate that it offers a state-of-the-art method for constructing parsimonious RBF models with excellent generalization performance

Data-driven Soft Sensors in the Process Industry

In the last two decades Soft Sensors established themselves as a valuable alternative to the traditional means for the acquisition of critical process variables, process monitoring and other tasks which are related to process control. This paper discusses characteristics of the process industry data which are critical for the development of data-driven Soft Sensors. These characteristics are common to a large number of process industry fields, like the chemical industry, bioprocess industry, steel industry, etc. The focus of this work is put on the data-driven Soft Sensors because of their growing popularity, already demonstrated usefulness and huge, though yet not completely realised, potential. A comprehensive selection of case studies covering the three most important Soft Sensor application fields, a general introduction to the most popular Soft Sensor modelling techniques as well as a discussion of some open issues in the Soft Sensor development and maintenance and their possible solutions are the main contributions of this work

Energy consumption modelling using deep learning technique — a case study of EAF

Energy consumption is a global issue which government is taking measures to reduce. Steel plant can have a better energy management once its energy consumption can be modelled and predicted. The purpose of this study is to establish an energy value prediction model for electric arc furnace (EAF) through a data-driven approach using a large amount of real-world data collected from the melt shop in an established steel plant. The data pre-processing and feature selection are carried out. Several data mining algorithms are used separately to build the prediction model. The result shows the predicting performance of the deep learning model is better than the conventional machine learning models, e.g., linear regression, support vector machine and decision tree

Using the modified k-mean algorithm with an improved teaching-learning-based optimization algorithm for feedforward neural network training

In this paper we proposed a novel procedure for training a feedforward neural network. The accuracy of artificial neural network outputs after determining the proper structure for each problem depends on choosing the appropriate method for determining the best weights, which is the appropriate training algorithm. If the training algorithm starts from a good starting point, it is several steps closer to achieving global optimization. In this paper, we present an optimization strategy for selecting the initial population and determining the optimal weights with the aim of minimizing neural network error. Teaching-learning-based optimization (TLBO) is a less parametric algorithm rather than other evolutionary algorithms, so it is easier to implement. We have improved this algorithm to increase efficiency and balance between global and local search. The improved teaching-learning-based optimization (ITLBO) algorithm has added the concept of neighborhood to the basic algorithm, which improves the ability of global search. Using an initial population that includes the best cluster centers after clustering with the modified k-mean algorithm also helps the algorithm to achieve global optimum. The results are promising, close to optimal, and better than other approach which we compared our proposed algorithm with them

Pre-bcc: a novel integrated machine learning framework for predicting mechanical and durability properties of blended cement concrete

Partially replacing ordinary Portland cement (OPC) with low-carbon supplementary cementitious materials (SCMs) in blended cement concrete (BCC) is perceived as the most promising route for sustainable concrete production. Despite having a lower environmental impact, BCC could exhibit performance inferior to OPC in design-governing functional properties. Hence, concrete manufacturers and scientists have been seeking methods to predict the performance of BCC mixes in order to reduce the cost and time of experimentally testing all alternatives. Machine learning algorithms have been proven in other fields for treating large amounts of data drawing meaningful relationships between data accurately. However, the existing prediction models in the literature come short in covering a wide range of SCMs and/or functional properties. Considering this, in this study, a non-linear multi-layered machine learning regression model was created to predict the performance of a BCC mix for slump, strength, and resistance to carbonation and chloride ingress based on any of five prominent SCMs: fly ash, ground granulated blast furnace slag, silica fume, lime powder and calcined clay. A database from>150 peer-reviewed sources containing>1650 data points was created to train and test the model. The statistical performance was found to be comparable to that of existing models (R = 0.94–0.97). For the first time, the model, Pre-bcc, was also made available online for users to conduct their own prediction studies.Peer ReviewedPostprint (published version