Prediction of blast-induced air overpressure using a hybrid machine learning model and gene expression programming (GEP) : a case study from an iron ore mine

Mine blasting can have a destructive effect on the environment. Among these effects, air overpressure (AOp) is a major concern. Therefore, a careful assessment of the AOp intensity should be conducted before any blasting operation in order to minimize the associated environmental detriment. Several empirical models have been established to predict and control AOp. However, the current empirical methods have many limitations, including low accuracy, poor generalizability, consideration only of linear relationships among influencing parameters, and investigation of only a few influencing parameters. Thus, the current research presents a hybrid model which combines an extreme gradient boosting algorithm (XGB) with grey wolf optimization (GWO) for accurately predicting AOp. Furthermore, an empirical model and gene expression programming (GEP) were used to assess the validity of the hybrid model (XGB-GWO). An analysis of 66 blastings with their corresponding AOp values and influential parameters was conducted to achieve the goals of this research. The efficiency of AOp prediction methods was evaluated in terms of mean absolute error (MAE), coefficient of determination (R 2 ), and root mean square error (RMSE). Based on the calculations, the XGB-GWO model has performed as well as the empirical and GEP models. Next, the most significant parameters for predicting AOp were determined using a sensitivity analysis. Based on the analysis results, stemming length and rock quality designation (RQD) were identified as two variables with the greatest influence. This study showed that the proposed XGB-GWO method was robust and applicable for predicting AOp driven by blasting operations

A combination of expert-based system and advanced decision-tree algorithms to predict air-overpressure resulting from quarry blasting

This study combined a fuzzy Delphi method (FDM) and two advanced decision-tree algorithms to predict air-overpressure (AOp) caused by mine blasting. The FDM was used for input selection. Thus, the panel of experts selected four inputs, including powder factor, max charge per delay, stemming length, and distance from the blast face. Once the input selection was completed, two decision-tree algorithms, namely extreme gradient boosting tree (XGBoost-tree) and random forest (RF), were applied using the inputs selected by the experts. The models are evaluated with the following criteria: correlation coefficient, mean absolute error, gains chart, and Taylor diagram. The applied models were compared with the XGBoost-tree and RF models using the full set of data without input selection results. The results of hybridization showed that the XGBoost-tree model outperformed the RF model. Concerning the gains, the XGBoost-tree again outperformed the RF model. In comparison with the single decision-tree models, the single models had slightly better correlation coefficients; however, the hybridized models were simpler and easier to understand, analyze and implement. In addition, the Taylor diagram showed that the models applied outperformed some other conventional machine learning models, including support vector machine, k-nearest neighbors, and artificial neural network. Overall, the findings of this study suggest that combining expert opinion and advanced decision-tree algorithms can result in accurate and easy to understand predictions of AOp resulting from blasting in quarry sites. © 2020, International Association for Mathematical Geosciences

Prediction of blast-induced ground vibration at a limestone quarry : an artificial intelligence approach

Ground vibration is one of the most unfavourable environmental effects of blasting activities, which can cause serious damage to neighboring homes and structures. As a result, effective forecasting of their severity is critical to controlling and reducing their recurrence. There are several conventional vibration predictor equations available proposed by different researchers but most of them are based on only two parameters, i.e., explosive charge used per delay and distance between blast face to the monitoring point. It is a well-known fact that blasting results are influenced by a number of blast design parameters, such as burden, spacing, powder factor, etc. but these are not being considered in any of the available conventional predictors and due to that they show a high error in predicting blast vibrations. Nowadays, artificial intelligence has been widely used in blast engineering. Thus, three artificial intelligence approaches, namely Gaussian process regression (GPR), extreme learning machine (ELM) and backpropagation neural network (BPNN) were used in this study to estimate ground vibration caused by blasting in Shree Cement Ras Limestone Mine in India. To achieve that aim, 101 blasting datasets with powder factor, average depth, distance, spacing, burden, charge weight, and stemming length as input parameters were collected from the mine site. For comparison purposes, a simple multivariate regression analysis (MVRA) model as well as, a nonparametric regression-based technique known as multivariate adaptive regression splines (MARS) was also constructed using the same datasets. This study serves as a foundational study for the comparison of GPR, BPNN, ELM, MARS and MVRA to ascertain their respective predictive performances. Eighty-one (81) datasets representing 80% of the total blasting datasets were used to construct and train the various predictive models while 20 data samples (20%) were utilized for evaluating the predictive capabilities of the developed predictive models. Using the testing datasets, major indicators of performance, namely mean squared error (MSE), variance accounted for (VAF), correlation coefficient (R) and coefficient of determination (R2) were compared as statistical evaluators of model performance. This study revealed that the GPR model exhibited superior predictive capability in comparison to the MARS, BPNN, ELM and MVRA. The GPR model showed the highest VAF, R and R2 values of 99.1728%, 0.9985 and 0.9971 respectively and the lowest MSE of 0.0903. As a result, the blast engineer can employ GPR as an effective and appropriate method for forecasting blast-induced ground vibration. © 2022 by the authors

메타 휴리스틱 최적화를 이용한 기계학습 기반 선박 건조 공정 리드 타임 예측

학위논문(석사) -- 서울대학교대학원 : 공과대학 조선해양공학과, 2021.8. 하오유주.In the shipbuilding industry, each production process has a respective lead time; that is, the duration between start and finish times. Lead time is basic data that is necessary for high-efficiency production planning and systematic production management. Therefore, lead time must be accurate. However, the traditional method of lead time management is not scientific because it mostly makes the plan by calculating the average lead times derived from historical data. Therefore, to understand the complex relationship between lead time and other influencing factors, this study proposes to use machine learning (ML) algorithms, support vector machine (SVM) and artificial neural network (ANN), which are frequently applied in prediction fields. Moreover, to improve prediction accuracy, this study proposes to apply meta-heuristic algorithms to optimize the parameters of the ML models. This thesis builds hybrid models, including meta-heuristic-ANN, meta-heuristic-SVM models. In addition, this study compares model’s performance with each other. In searching for the ML model’s parameters, the results point out that the new self-organizing hierarchical particle swarm optimization (PSO) with jumping time-varying acceleration coefficients (NHPSO-JTVAC) algorithm is superior in terms of performance. More importantly, the test results demonstrate that the integrated models, based on NHPSO-JTVAC, have the smallest mean absolute percentage error (MAPE) test error in the three shipyard block process data sets, 11.79%, 16.03% and 16.45%, respectively. The results also demonstrate that the built models based on NHPSO-JTVAC can achieve further meaningful enhancements in terms of prediction accuracy. Overall, the NHPSO–JTVAC-SVM, NHPSO–JTVAC-ANN models are feasible for predicting the lead time in shipbuilding.조선 산업에서 각 공정은 리드 타임을 가진다. 리드 타임이란 공정 시작과 종료 간에 시간으로, 고효율의 생산계획과 체계적 생산관리를 위해 매우 중요한 지표이다. 특히, 생산 계획 단계에서 정확한 리드타임 예측은 납기 준수를 위한 계획 수립을 위해 매우 중요하다. 그러나 기존의 예측 방법은 과거 데이터의 평균값을 사용했기 때문에 정확도가 매우 떨어졌다. 따라서 본 연구에서는 리드 타임과 다른 영향 요인 간의 복잡한 관계를 이해하기 위해 예측 분야에서 자주 적용되는 머신 러닝 (ML) 모델인 서포트 벡터 머신 (SVM) 및 인공 신경망 (ANN) 적용을 제안한다. 또한, 기계학습 모델 예측 정확도를 향상시키기 위해 메타 휴리스틱 알고리즘을 적용하여 모델의 파라미터를 최적화하고자 한다. 본 연구는 meta-heuristics-ANN, meta-heuristics-SVM 모델을 포함하는 하이브리드 모델을 구축한다. 더불어, 본 연구는 메타 휴리스틱 알고리즘 기반으로 최적화된 기계학습 모델의 성능을 서로 비교한다. 연구 결과를 통해, ML 모델의 파라미터를 탐색하는 과정에서 particle swam optimization (PSO)의 enhanced 버전인 NHPSO-JTVAC 알고리즘이 탐색 성능 면에서 다른 알고리즘보다 우수하다는 것을 알 수 있다. 뿐만 아니라 테스트 결과를 살펴보면 NHPSO-JTVAC에 기반한 하이브리드 모델이 조선소 세 개의 블록 공정 데이터에서 (각각 11.79%, 16.03% 및 16.45%) 가장 작은 MAPE 테스트 오차임을 알 수 있다. 이것은 NHPSO-JTVAC를 기반으로 구축된 모델이 예측 정확도 측면에서 의미 있는 향상을 더 달성할 수 있음을 보여준다. 전반적으로 NHPSO-JTVAC-SVM, NHPSO-JTVAC-ANN 모델은 조선소 블록 공정의 리드 타임을 예측하는 데 적합하다는 것을 확인할 수 있다.Chapter 1 Introduction 1 1.1 Background and Motivation 1 1.2 Related Works 3 1.2.1 Related Works for Lead Time Prediction 3 1.2.2 Related Works for Hybrid Predictive Model 4 1.3 Thesis Organization 6 Chapter 2 Machine Learning 7 2.1 Support Vector Machine 7 2.1.1 Support Vector Machine Algorithm 7 2.1.2 Hyperparameter Optimization for SVM 10 2.2 Artificial Neural Network 11 2.2.1 Artificial Neural Network Algorithm 11 2.2.2 Hyperparameter Optimization for ANN 15 Chapter 3 Meta-heuristic Optimization Algorithms 17 3.1 Particle Swarm Optimization 17 3.2 NHPSO-JTVAC: An Advanced Version of PSO 18 3.3 Bat Algorithm 19 3.4 Firefly Algorithm 21 3.5 Grasshopper Optimization Algorithm 22 3.6 Moth Search Algorithm 24 Chapter 4 Hybrid Artificial Intelligence Models 27 4.1 Hybrid Meta-heuristic-SVM Models 27 4.1.1 Hybrid PSO-SVM Model 29 4.1.2 Hybrid NHPSO-JTVAC-SVM Model 30 4.1.3 Hybrid BA-SVM Model 31 4.1.4 Hybrid FA-SVM Model 33 4.1.5 Hybrid GOA-SVM Model 34 4.1.6 Hybrid MSA-SVM Model 35 4.2 Hybrid Meta-heuristic-ANN Models 36 4.2.1 Hybrid PSO-ANN Model 38 4.2.2 Hybrid NHPSO-JTVAC-ANN Model 39 4.2.3 Hybrid BA-ANN Model 40 4.2.4 Hybrid FA-ANN Model 41 4.2.5 Hybrid GOA-ANN Model 42 4.2.6 Hybrid MSA-ANN Model 43 Chapter 5 Lead Time Prediction Based on Hybrid AI Models 44 5.1 Data and Preparation 44 5.1.1 Data Normalization 45 5.1.2 Feature Selection 45 5.2 Lead Time Prediction 46 5.3 Performance Metrics 47 Chapter 6 Experimental Results 49 6.1 Results Based on Hybrid SVM-based Models 49 6.2 Results Based on Hybrid ANN-based Models 55 6.3 Overall Results 60 Chapter 7 Conclusions and Future Works 62 Bibliography 63 Appendix A 68 Abstract in Korean 69석

Advances in Computational Intelligence Applications in the Mining Industry

This book captures advancements in the applications of computational intelligence (artificial intelligence, machine learning, etc.) to problems in the mineral and mining industries. The papers present the state of the art in four broad categories: mine operations, mine planning, mine safety, and advances in the sciences, primarily in image processing applications. Authors in the book include both researchers and industry practitioners

An advanced computational intelligent framework to predict shear sonic velocity with application to mechanical rock classification

Shear sonic wave velocity (Vs) has a wide variety of implications, from reservoir management and development to geomechanical and geophysical studies. In the current study, two approaches were adopted to predict shear sonic wave velocities (Vs) from several petrophysical well logs, including gamma ray (GR), density (RHOB), neutron (NPHI), and compressional sonic wave velocity (Vp). For this purpose, five intelligent models of random forest (RF), extra tree (ET), Gaussian process regression (GPR), and the integration of adaptive neuro fuzzy inference system (ANFIS) with differential evolution (DE) and imperialist competitive algorithm (ICA) optimizers were implemented. In the first approach, the target was estimated based only on Vp, and the second scenario predicted Vs from the integration of Vp, GR, RHOB, and NPHI inputs. In each scenario, 8061 data points belonging to an oilfield located in the southwest of Iran were investigated. The ET model showed a lower average absolute percent relative error (AAPRE) compared to other models for both approaches. Considering the first approach in which the Vp was the only input, the obtained AAPRE values for RF, ET, GPR, ANFIS + DE, and ANFIS + ICA models are 1.54%, 1.34%, 1.54%, 1.56%, and 1.57%, respectively. In the second scenario, the achieved AAPRE values for RF, ET, GPR, ANFIS + DE, and ANFIS + ICA models are 1.25%, 1.03%, 1.16%, 1.63%, and 1.49%, respectively. The Williams plot proved the validity of both one-input and four-inputs ET model. Regarding the ET model constructed based on only one variable,Williams plot interestingly showed that all 8061 data points are valid data. Also, the outcome of the Leverage approach for the ET model designed with four inputs highlighted that there are only 240 "out of leverage" data sets. In addition, only 169 data are suspected. Also, the sensitivity analysis results typified that the Vp has a higher effect on the target parameter (Vs) than other implemented inputs. Overall, the second scenario demonstrated more satisfactory Vs predictions due to the lower obtained errors of its developed models. Finally, the two ET models with the linear regression model, which is of high interest to the industry, were applied to diagnose candidate layers along the formation for hydraulic fracturing. While the linear regression model fails to accurately trace variations of rock properties, the intelligent models successfully detect brittle intervals consistent with field measurements

Machine-learning-based prediction of oil recovery factor for experimental CO2-Foam chemical EOR: Implications for carbon utilization projects 2023/9/1

Enhanced oil recovery (EOR) using CO2 injection is promising with economic and environmental benefits as an active climate-change mitigation approach. Nevertheless, the low sweep efficiency of CO2 injection remains a challenge. CO2-foam injection has been proposed as a remedy, but its laboratory screening for specific reservoirs is costly and time-consuming. In this study, machine-learning models are employed to predict oil recovery factor (ORF) during CO2-foam flooding cost-effectively and accurately. Four models, including general regression neural network (GRNN), cascade forward neural network with Levenberg–Marquardt optimization (CFNN-LM), cascade forward neural network with Bayesian regularization (CFNN-BR), and extreme gradient boosting (XGBoost), are evaluated based on experimental data from previous studies. Results demonstrate that the GRNN model outperforms the others, with an overall mean absolute error of 0.059 and an R2 of 0.9999. The GRNN model's applicability domain is verified using a Williams plot, and an uncertainty analysis for CO2-foam flooding projects is conducted. The novelty of this study lies in developing a machine-learning-based approach that provides an accurate and cost-effective prediction of ORF in CO2-foam experiments. This approach has the potential to significantly reduce screening costs and time required for CO2-foam injection, making it a more viable carbon utilization and EOR strategy

Multi-Objective and Multi-Attribute Optimisation for Sustainable Development Decision Aiding

Optimization is considered as a decision-making process for getting the most out of available resources for the best attainable results. Many real-world problems are multi-objective or multi-attribute problems that naturally involve several competing objectives that need to be optimized simultaneously, while respecting some constraints or involving selection among feasible discrete alternatives. In this Reprint of the Special Issue, 19 research papers co-authored by 88 researchers from 14 different countries explore aspects of multi-objective or multi-attribute modeling and optimization in crisp or uncertain environments by suggesting multiple-attribute decision-making (MADM) and multi-objective decision-making (MODM) approaches. The papers elaborate upon the approaches of state-of-the-art case studies in selected areas of applications related to sustainable development decision aiding in engineering and management, including construction, transportation, infrastructure development, production, and organization management

Naval Research Program 2019 Annual Report

NPS NRP Annual ReportThe Naval Postgraduate School (NPS) Naval Research Program (NRP) is funded by the Chief of Naval Operations and supports research projects for the Navy and Marine Corps. The NPS NRP serves as a launch-point for new initiatives which posture naval forces to meet current and future operational warfighter challenges. NRP research projects are led by individual research teams that conduct research and through which NPS expertise is developed and maintained. The primary mechanism for obtaining NPS NRP support is through participation at NPS Naval Research Working Group (NRWG) meetings that bring together fleet topic sponsors, NPS faculty members, and students to discuss potential research topics and initiatives.Chief of Naval Operations (CNO)This research is supported by funding from the Naval Postgraduate School, Naval Research Program (PE 0605853N/2098). https://nps.edu/nrpChief of Naval Operations (CNO)Approved for public release. Distribution is unlimited.

Lithosphere 2021 : Eleventh symposium on structure, composition and evolution of the lithosphere

Programme and extended abstract