Adaptive machine learning-based surrogate modeling to accelerate PDE-constrained optimization in enhanced oil recovery

In this contribution, we develop an efficient surrogate modeling framework for simulation-based optimization of enhanced oil recovery, where we particularly focus on polymer flooding. The computational approach is based on an adaptive training procedure of a neural network that directly approximates an input-output map of the underlying PDE-constrained optimization problem. The training process thereby focuses on the construction of an accurate surrogate model solely related to the optimization path of an outer iterative optimization loop. True evaluations of the objective function are used to finally obtain certified results. Numerical experiments are given to evaluate the accuracy and efficiency of the approach for a heterogeneous five-spot benchmark problem.publishedVersio

Meta-heuristic algorithms in car engine design: a literature survey

Meta-heuristic algorithms are often inspired by natural phenomena, including the evolution of species in Darwinian natural selection theory, ant behaviors in biology, flock behaviors of some birds, and annealing in metallurgy. Due to their great potential in solving difficult optimization problems, meta-heuristic algorithms have found their way into automobile engine design. There are different optimization problems arising in different areas of car engine management including calibration, control system, fault diagnosis, and modeling. In this paper we review the state-of-the-art applications of different meta-heuristic algorithms in engine management systems. The review covers a wide range of research, including the application of meta-heuristic algorithms in engine calibration, optimizing engine control systems, engine fault diagnosis, and optimizing different parts of engines and modeling. The meta-heuristic algorithms reviewed in this paper include evolutionary algorithms, evolution strategy, evolutionary programming, genetic programming, differential evolution, estimation of distribution algorithm, ant colony optimization, particle swarm optimization, memetic algorithms, and artificial immune system

Modelling of Libyan crude oil using artificial neural networks

The preparation and analysis of input and model data was carried out. The importance of the correct technique of data filtering was highlighted with particular focus being emphasised on the removal of outliers in raw data. An important process in the use of Artificial Neural Network (ANN) models was identified as being the selection of the right input variables.A comparison between using factor analysis and statistical analysis in the selection of inputs and it was observed that the former gave significantly better results. The training and testing phase of Artificial Neural Network (ANN) model development was shown to be an important step in Artificial Neural Network (ANN) model development. If this phase was wrongly done then the ANN model would not be accurate in its predictions. Optimisation of the ANN model architecture was carried out with the amount of hidden layers, amount of neurons in the hidden layers, the transfer function used and the learning rate identified as key elements in obtaining an Artificial Neural Network (ANN) architecture that gave fast and accurate predictions. Fresh water addition and demulsifier addition were identified as key parameters in the economic performance of the desalting process. Due to a scarcity of water and the high cost of the demulsifier chemical it was important to try and optimise these two input variables thus reducing the cost of operations

Exploring the adoption of a conceptual data analytics framework for subsurface energy production systems: a study of predictive maintenance, multi-phase flow estimation, and production optimization

Als die Technologie weiter fortschreitet und immer stärker in der Öl- und Gasindustrie integriert wird, steht eine enorme Menge an Daten in verschiedenen Wissenschaftsdisziplinen zur Verfügung, die neue Möglichkeiten bieten, informationsreiche und handlungsorientierte Informationen zu gewinnen. Die Konvergenz der digitalen Transformation mit der Physik des Flüssigkeitsflusses durch poröse Medien und Pipeline hat die Entwicklung und Anwendung von maschinellem Lernen (ML) vorangetrieben, um weiteren Mehrwert aus diesen Daten zu gewinnen. Als Folge hat sich die digitale Transformation und ihre zugehörigen maschinellen Lernanwendungen zu einem neuen Forschungsgebiet entwickelt. Die Transformation von Brownfields in digitale Ölfelder kann bei der Energieproduktion helfen, indem verschiedene Ziele erreicht werden, einschließlich erhöhter betrieblicher Effizienz, Produktionsoptimierung, Zusammenarbeit, Datenintegration, Entscheidungsunterstützung und Workflow-Automatisierung. Diese Arbeit zielt darauf ab, ein Rahmenwerk für diese Anwendungen zu präsentieren, insbesondere durch die Implementierung virtueller Sensoren, Vorhersageanalytik mithilfe von Vorhersagewartung für die Produktionshydraulik-Systeme (mit dem Schwerpunkt auf elektrischen Unterwasserpumpen) und präskriptiven Analytik für die Produktionsoptimierung in Dampf- und Wasserflutprojekten. In Bezug auf virtuelle Messungen ist eine genaue Schätzung von Mehrphasenströmen für die Überwachung und Verbesserung von Produktionsprozessen entscheidend. Diese Studie präsentiert einen datengetriebenen Ansatz zur Berechnung von Mehrphasenströmen mithilfe von Sensormessungen in elektrischen untergetauchten Pumpbrunnen. Es wird eine ausführliche exploratorische Datenanalyse durchgeführt, einschließlich einer Ein Variablen Studie der Zielausgänge (Flüssigkeitsrate und Wasseranteil), einer Mehrvariablen-Studie der Beziehungen zwischen Eingaben und Ausgaben sowie einer Datengruppierung basierend auf Hauptkomponentenprojektionen und Clusteralgorithmen. Feature Priorisierungsexperimente werden durchgeführt, um die einflussreichsten Parameter in der Vorhersage von Fließraten zu identifizieren. Die Modellvergleich erfolgt anhand des mittleren absoluten Fehlers, des mittleren quadratischen Fehlers und des Bestimmtheitskoeffizienten. Die Ergebnisse zeigen, dass die CNN-LSTM-Netzwerkarchitektur besonders effektiv bei der Zeitreihenanalyse von ESP-Sensordaten ist, da die 1D-CNN-Schichten automatisch Merkmale extrahieren und informative Darstellungen von Zeitreihendaten erzeugen können. Anschließend wird in dieser Studie eine Methodik zur Umsetzung von Vorhersagewartungen für künstliche Hebesysteme, insbesondere bei der Wartung von Elektrischen Untergetauchten Pumpen (ESP), vorgestellt. Conventional maintenance practices for ESPs require extensive resources and manpower, and are often initiated through reactive monitoring of multivariate sensor data. Um dieses Problem zu lösen, wird die Verwendung von Hauptkomponentenanalyse (PCA) und Extreme Gradient Boosting Trees (XGBoost) zur Analyse von Echtzeitsensordaten und Vorhersage möglicher Ausfälle in ESPs eingesetzt. PCA wird als unsupervised technique eingesetzt und sein Ausgang wird weiter vom XGBoost-Modell für die Vorhersage des Systemstatus verarbeitet. Das resultierende Vorhersagemodell hat gezeigt, dass es Signale von möglichen Ausfällen bis zu sieben Tagen im Voraus bereitstellen kann, mit einer F1-Bewertung größer als 0,71 im Testset. Diese Studie integriert auch Model-Free Reinforcement Learning (RL) Algorithmen zur Unterstützung bei Entscheidungen im Rahmen der Produktionsoptimierung. Die Aufgabe, die optimalen Injektionsstrategien zu bestimmen, stellt Herausforderungen aufgrund der Komplexität der zugrundeliegenden Dynamik, einschließlich nichtlinearer Formulierung, zeitlicher Variationen und Reservoirstrukturheterogenität. Um diese Herausforderungen zu bewältigen, wurde das Problem als Markov-Entscheidungsprozess reformuliert und RL-Algorithmen wurden eingesetzt, um Handlungen zu bestimmen, die die Produktion optimieren. Die Ergebnisse zeigen, dass der RL-Agent in der Lage war, den Netto-Barwert (NPV) durch kontinuierliche Interaktion mit der Umgebung und iterative Verfeinerung des dynamischen Prozesses über mehrere Episoden signifikant zu verbessern. Dies zeigt das Potenzial von RL-Algorithmen, effektive und effiziente Lösungen für komplexe Optimierungsprobleme im Produktionsbereich zu bieten.As technology continues to advance and become more integrated in the oil and gas industry, a vast amount of data is now prevalent across various scientific disciplines, providing new opportunities to gain insightful and actionable information. The convergence of digital transformation with the physics of fluid flow through porous media and pipelines has driven the advancement and application of machine learning (ML) techniques to extract further value from this data. As a result, digital transformation and its associated machine-learning applications have become a new area of scientific investigation. The transformation of brownfields into digital oilfields can aid in energy production by accomplishing various objectives, including increased operational efficiency, production optimization, collaboration, data integration, decision support, and workflow automation. This work aims to present a framework of these applications, specifically through the implementation of virtual sensing, predictive analytics using predictive maintenance on production hydraulic systems (with a focus on electrical submersible pumps), and prescriptive analytics for production optimization in steam and waterflooding projects. In terms of virtual sensing, the accurate estimation of multi-phase flow rates is crucial for monitoring and improving production processes. This study presents a data-driven approach for calculating multi-phase flow rates using sensor measurements located in electrical submersible pumped wells. An exhaustive exploratory data analysis is conducted, including a univariate study of the target outputs (liquid rate and water cut), a multivariate study of the relationships between inputs and outputs, and data grouping based on principal component projections and clustering algorithms. Feature prioritization experiments are performed to identify the most influential parameters in the prediction of flow rates. Model comparison is done using the mean absolute error, mean squared error and coefficient of determination. The results indicate that the CNN-LSTM network architecture is particularly effective in time series analysis for ESP sensor data, as the 1D-CNN layers are capable of extracting features and generating informative representations of time series data automatically. Subsequently, the study presented herein a methodology for implementing predictive maintenance on artificial lift systems, specifically regarding the maintenance of Electrical Submersible Pumps (ESPs). Conventional maintenance practices for ESPs require extensive resources and manpower and are often initiated through reactive monitoring of multivariate sensor data. To address this issue, the study employs the use of principal component analysis (PCA) and extreme gradient boosting trees (XGBoost) to analyze real-time sensor data and predict potential failures in ESPs. PCA is utilized as an unsupervised technique and its output is further processed by the XGBoost model for prediction of system status. The resulting predictive model has been shown to provide signals of potential failures up to seven days in advance, with an F1 score greater than 0.71 on the test set. In addition to the data-driven modeling approach, The present study also in- corporates model-free reinforcement learning (RL) algorithms to aid in decision-making in production optimization. The task of determining the optimal injection strategy poses challenges due to the complexity of the underlying dynamics, including nonlinear formulation, temporal variations, and reservoir heterogeneity. To tackle these challenges, the problem was reformulated as a Markov decision process and RL algorithms were employed to determine actions that maximize production yield. The results of the study demonstrate that the RL agent was able to significantly enhance the net present value (NPV) by continuously interacting with the environment and iteratively refining the dynamic process through multiple episodes. This showcases the potential for RL algorithms to provide effective and efficient solutions for complex optimization problems in the production domain. In conclusion, this study represents an original contribution to the field of data-driven applications in subsurface energy systems. It proposes a data-driven method for determining multi-phase flow rates in electrical submersible pumped (ESP) wells utilizing sensor measurements. The methodology includes conducting exploratory data analysis, conducting experiments to prioritize features, and evaluating models based on mean absolute error, mean squared error, and coefficient of determination. The findings indicate that a convolutional neural network-long short-term memory (CNN-LSTM) network is an effective approach for time series analysis in ESPs. In addition, the study implements principal component analysis (PCA) and extreme gradient boosting trees (XGBoost) to perform predictive maintenance on ESPs and anticipate potential failures up to a seven-day horizon. Furthermore, the study applies model-free reinforcement learning (RL) algorithms to aid decision-making in production optimization and enhance net present value (NPV)

Efficient Optimization and Robust Value Quantification of Enhanced Oil Recovery Strategies

With an increasing demand for hydrocarbon reservoir produces such as oil, etc., and difficulties in finding green oil fields, the use of Enhanced Oil Recovery (EOR) methods such as polymer, Smart water, and solvent flooding for further development of existing fields can not be overemphasized. For reservoir profitability and reduced environmental impact, it is crucial to consider appropriate well control settings of EOR methods for given reservoir characterization. Moreover, finding appropriate well settings requires solving a constrained optimization problem with suitable numerical solution methods. Conventionally, the solution method requires many iterations involving several computationally demanding function evaluations before convergence to the appropriate near optimum. The major subject of this thesis is to develop an efficient and accurate solution method for constrained optimization problems associated with EOR methods for their value quantifications and ranking in the face of reservoir uncertainties. The first contribution of the thesis develops a solution method based on the inexact line search method (with Ensemble Based Optimization (EnOpt) for approximate gradient computation) for robust constrained optimization problems associated with polymer, Smart water, and solvent flooding. Here, the objective function is the expectation of the Net Present Value (NPV) function over given geological realizations. For a given set of well settings, the NPV function is defined based on the EOR simulation model, which follows from an appropriate extension of the black-oil model. The developed solution method is used to find the economic benefits and also the ranking of EOR methods for different oil reservoirs developed to mimic North Sea reservoirs. Performing the entire optimization routine in a transformed domain along with truncations has been a common practice for handling simple linear constraints in reservoir optimization. Aside from the fact that this method has a negative impact on the quality of gradient computation, it is complicated to use for non-linear constraints. The second contribution of this thesis proposes a technique based on the exterior penalty method for handling general linear and non-linear constraints in reservoir optimization problems to improve gradient computation quality by the EnOpt method for efficient and improved optimization algorithm. Because of the computationally expensive NPV function due to the costly reservoir simulation of EOR methods, the solution method for the underlying EOR optimization problem becomes inefficient, especially for large reservoir problems. To speedup the overall computation of the solution method, this thesis introduces a novel full order model (FOM)-based certified adaptive machine learning optimization procedures to locally approximate the expensive NPV function. A supervised feedforward deep neural network (DNN) algorithm is employed to locally create surrogate model. In the FOM-based optimization algorithm of this study, several FOM NPV function evaluations are required by the EnOpt method to approximate the gradient function at each (outer) iteration until convergence. To limit the number FOM-based evaluations, we consider building surrogate models locally to replace the FOM based NPV function at each outer iteration and proceed with an inner optimization routine until convergence. We adapt the surrogate model using some FOM-based criterion where necessary until convergence. The demonstration of methodology for polymer optimization problem on a benchmark model results in an improved optimum and found to be more efficient compared to using the full order model optimization procedures

Leveraging Artificial Intelligence and Geomechanical Data for Accurate Shear Stress Prediction in CO2 Sequestration within Saline Aquifers (Smart Proxy Modeling)

This research builds upon the success of a previous project that used a Smart Proxy Model (SPM) to predict pressure and saturation in Carbon Capture and Storage (CCS) operations into saline aquifers. The Smart Proxy Model is a data-driven machine learning model that can replicate the output of a sophisticated numerical simulation model for each time step in a short amount of time, using Artificial Intelligence (AI) and large volumes of subsurface data. This study aims to develop the Smart Proxy Model further by incorporating geomechanical datadriven techniques to predict shear stress by using a neural network, specifically through supervised learning, to construct Smart Proxy Models, which are critical to ensuring the safety and effectiveness of Carbon Capture and Storage operations. By training the Smart Proxy Model with reservoir simulations that incorporate varying geological properties and geomechanical data, we will be able to predict the distribution of shear stress. The ability to accurately predict shear stress is crucial to mitigating the potential risks associated with Carbon Capture and Storage operations. The development of a geomechanical Smart Proxy Model will enable more efficient and reliable subsurface modeling decisions in Carbon Capture and Storage operations, ultimately contributing to the safe and effective storage of CO2 and the global effort to combat climate change

Integracija "big data" analize i inženjerskog načina razmišljanja s ciljem upravljanja i kontroliranja inteligentnog opremanja i umjetnog načina podizanja nafte i plina za odabranu bušotinu s područja Hrvatske : diplomski rad

In order to reach more complex reservoir and increase ultimate recovery, engineers are searching for new technologies. One of these is intelligent completion which provides system monitoring, fluid production or injection control, and optimization. Operator can make decisions about managing completion based on real-time data coming from the downhole sensors. In addition, machine learning is becoming more popular in the oil industry. It finds application in automatization of processes and reducing time and error in decision making process. The aim of the thesis is to couple intelligent completion with machine learning (neural network) on the real example-gas well. The goal is to see if neural network can predict optimal interval control valve sizes for specific scenarios.Inženjeri kontinuirano istražuju nove tehnologije kako bi razradili kompleksnija ležišta i povećali njihov ukupni iscrpak ležišta. Jedan od načina je i inteligentno opremanje koje pruža mogućnost daljinskog nadgledanja i kontrole cjelokupnog procesa pridobivanja ugljikovodika, te optimizaciju cijelog procesa. U takvom sustavu operator donosi odluke na temelju podataka koji dolaze u stvarnom vremenu sa senzora postavljenih u bušotinu. Nadalje, strojno učenje (engl. machine learning) postaje sve popularnije i u naftnoj industriji. Primjenjuje se u automatizaciji procesa kako bi se smanjilo vrijeme i greške prilikom donošenja odluka. Cilj ovoga rada je spojiti inteligentno opremanje sa neuronskom mrežom na stvarnom primjeru plinske bušotine. Uz to, cilj je vidjeti može li neuronska mreža predvidjeti optimalne veličine intervalnog kontrolnog ventila za različite slučajeve

A framework for the near-real-time optimization of integrated oil & gas midstream processing networks

The oil and gas industry plays a key role in the world’s economy. Vast quantities of crude oil, their by-products and derivatives are produced, processed and distributed every day. Indeed, producing and processing significant volumes of crude oil requires connecting to wells in different fields that are usually spread across large geographical areas. This crude oil is then processed by Gas Oil Separation Plants (GOSPs). These facilities are often grouped into clusters that are within approximate distance from each other and then connected laterally via swing lines which allow shifting part or all of the production from one GOSP to another. Transfer lines also exist to allow processing intermediate products in neighbouring GOSPs, thereby increasing complexity and possible interactions. In return, this provides an opportunity to leverage mathematical optimization to improve network planning and load allocation. Similarly, in major oil producing countries, vast gas processing networks exist to process associated and non-associated gases. These gas plants are often located near major feed sources. Similar to GOSPs, they are also often connected through swing lines, which allow shifting feedstock from some plants to others. GOSPs and gas plants are often grouped as oil and gas midstream plants. These plants are operated on varied time horizons and plant boundaries. While plant operators are concerned with the day-to-day operation of their facility, network operators must ensure that the entire network is operated optimally and that product supply is balanced with demand. They are therefore in charge of allocating load to individual plants, while knowing each plants constraints and processing capabilities. Network planners are also in charge of producing production plans at varied time-scales, which vary from yearly to monthly and near-real time. This work aims to establish a novel framework for optimizing Oil and Gas Midstream plants for near-real time network operation. This topic has not been specifically addressed in the existing literature. It examines problems which involve operating networks of GOSPs and gas plants towards an optimal solution. It examines various modelling approaches which are suited for this specific application. It then focuses at this stage of the research on the GOSP optimization problem where it addresses optimizing the operation of a complex network of GOSPs. The goal is to operate this network such that oil production targets are met at minimum energy consumption, and therefore minimizing OpEx and Greenhouse Gas Emissions. Similarly, it is often required to operate the network such that production is maximized. This thesis proposes a novel methodology to formulate and solve this problem. It describes the level of fidelity used to represent physical process units. A Mixed Integer Non-Linear Programming (MINLP) problem is then formulated and solved to optimize load allocation, swing line flowrates and equipment utilization. The model demonstrates advanced capabilities to systematically prescribe optimal operating points. This was then applied to an existing integrated network of GOSPs and tested at varying crude oil demand levels. The results demonstrate the ability to minimize energy consumption by up to 51% in the 50% throughput case while meeting oil production targets without added capital investment.Open Acces

Data-driven Soft Sensors in the Process Industry

In the last two decades Soft Sensors established themselves as a valuable alternative to the traditional means for the acquisition of critical process variables, process monitoring and other tasks which are related to process control. This paper discusses characteristics of the process industry data which are critical for the development of data-driven Soft Sensors. These characteristics are common to a large number of process industry fields, like the chemical industry, bioprocess industry, steel industry, etc. The focus of this work is put on the data-driven Soft Sensors because of their growing popularity, already demonstrated usefulness and huge, though yet not completely realised, potential. A comprehensive selection of case studies covering the three most important Soft Sensor application fields, a general introduction to the most popular Soft Sensor modelling techniques as well as a discussion of some open issues in the Soft Sensor development and maintenance and their possible solutions are the main contributions of this work