Machine Learning for Seismic Exploration: where are we and how far are we from the Holy Grail?

Machine Learning (ML) applications in seismic exploration are growing faster than applications in other industry fields, mainly due to the large amount of acquired data for the exploration industry. The ML algorithms are constantly being implemented to almost all the steps involved in seismic processing and interpretation workflow, mainly for automation, processing time reduction, efficiency and in some cases for improving the results. We carried out a literature-based analysis of existing ML-based seismic processing and interpretation published in SEG and EAGE literature repositories and derived a detailed overview of the main ML thrusts in different seismic applications. For each publication, we extracted various metadata about ML implementations and performances. The data indicate that current ML implementations in seismic exploration are focused on individual tasks rather than a disruptive change in processing and interpretation workflows. The metadata shows that the main targets of ML applications for seismic processing are denoising, velocity model building and first break picking, whereas for seismic interpretation, they are fault detection, lithofacies classification and geo-body identification. Through the metadata available in publications, we obtained indices related to computational power efficiency, data preparation simplicity, real data test rate of the ML model, diversity of ML methods, etc. and we used them to approximate the level of efficiency, effectivity and applicability of the current ML-based seismic processing and interpretation tasks. The indices of ML-based processing tasks show that current ML-based denoising and frequency extrapolation have higher efficiency, whereas ML-based QC is more effective and applicable compared to other processing tasks. Among the interpretation tasks, ML-based impedance inversion shows high efficiency, whereas high effectivity is depicted for fault detection. ML-based Lithofacies classification, stratigraphic sequence identification and petro/rock properties inversion exhibit high applicability among other interpretation tasks

Seismic Data Strong Noise Attenuation Based on Diffusion Model and Principal Component Analysis

Seismic data noise processing is an important part of seismic exploration data processing, and the effect of noise elimination is directly related to the follow-up processing of data. In response to this problem, many authors have proposed methods based on rank reduction, sparse transformation, domain transformation, and deep learning. However, such methods are often not ideal when faced with strong noise. Therefore, we propose to use diffusion model theory for noise removal. The Bayesian equation is used to reverse the noise addition process, and the noise reduction work is divided into multiple steps to effectively deal with high-noise situations. Furthermore, we propose to evaluate the noise level of blind Gaussian seismic data using principal component analysis to determine the number of steps for noise reduction processing of seismic data. We train the model on synthetic data and validate it on field data through transfer learning. Experiments show that our proposed method can identify most of the noise with less signal leakage. This has positive significance for high-precision seismic exploration and future seismic data signal processing research.Comment: 10 pages, 13 figures. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessibl

Plug-and-Play regularized 3D seismic inversion with 2D pre-trained denoisers

Post-stack seismic inversion is a widely used technique to retrieve high-resolution acoustic impedance models from migrated seismic data. Its modelling operator assumes that a migrated seismic data can be generated from the convolution of a source wavelet and the time derivative of the acoustic impedance model. Given the band-limited nature of the seismic wavelet, the convolutional model acts as a filtering operator on the acoustic impedance model, thereby making the problem of retrieving acoustic impedances from seismic data ambiguous. In order to compensate for missing frequencies, post-stack seismic inversion is often regularized, meaning that prior information about the structure of the subsurface is included in the inversion process. Recently, the Plug-and-Play methodology has gained wide interest in the inverse problem community as a new form of implicit regularization, often outperforming state-of-the-art regularization. Plug-and-Play can be applied to any proximal algorithm by simply replacing the proximal operator of the regularizer with any denoiser of choice. We propose to use Plug-and-Play regularization with a 2D pre-trained, deep denoiser for 2D post-stack seismic inversion. Additionally, we show that a generalization of Plug-and-Play, called Multi-Agent Consensus Equilibrium, can be adopted to solve 3D post-stack inversion whilst leveraging the same 2D pre-trained denoiser used in the 2D case. More precisely, Multi-Agent Consensus Equilibrium combines the results of applying such 2D denoiser in the inline, crossline, and time directions in an optimal manner. We verify the proposed methods on a portion of the SEAM Phase 1 velocity model and the Sleipner field dataset. 1Comment: 24 pages, 10 figure

Generative adversarial networks review in earthquake-related engineering fields

Within seismology, geology, civil and structural engineering, deep learning (DL), especially via generative adversarial networks (GANs), represents an innovative, engaging, and advantageous way to generate reliable synthetic data that represent actual samples' characteristics, providing a handy data augmentation tool. Indeed, in many practical applications, obtaining a significant number of high-quality information is demanding. Data augmentation is generally based on artificial intelligence (AI) and machine learning data-driven models. The DL GAN-based data augmentation approach for generating synthetic seismic signals revolutionized the current data augmentation paradigm. This study delivers a critical state-of-art review, explaining recent research into AI-based GAN synthetic generation of ground motion signals or seismic events, and also with a comprehensive insight into seismic-related geophysical studies. This study may be relevant, especially for the earth and planetary science, geology and seismology, oil and gas exploration, and on the other hand for assessing the seismic response of buildings and infrastructures, seismic detection tasks, and general structural and civil engineering applications. Furthermore, highlighting the strengths and limitations of the current studies on adversarial learning applied to seismology may help to guide research efforts in the next future toward the most promising directions

Elastic pre-stack seismic inversion through Discrete Cosine Transform reparameterization and Convolutional Neural Networks

We develop a pre-stack inversion algorithm that combines a Discrete Cosine Transform (DCT) reparameterization of data and model spaces with a Convolutional Neural Network (CNN). The CNN is trained to predict the mapping between the DCT-transformed seismic data and the DCT-transformed 2-D elastic model. A convolutional forward modeling based on the full Zoeppritz equations constitutes the link between the elastic properties and the seismic data. The direct sequential co-simulation algorithm with joint probability distribution is used to generate the training and validation datasets under the assumption of a stationary non-parametric prior and a Gaussian variogram model for the elastic properties. The DCT is an orthogonal transformation that is here used as an additional feature extraction technique that reduces the number of unknown parameters in the inversion and the dimensionality of the input and output of the network. The DCT reparameterization also acts as a regularization operator in the model space and allows for the preservation of the lateral and vertical continuity of the elastic properties in the recovered solution. We also implement a Monte Carlo simulation strategy that propagates onto the estimated elastic model the uncertainties related to both noise contamination and network approximation. We focus on synthetic inversions on a realistic subsurface model that mimics a real gas-saturated reservoir hosted in a turbiditic sequence. We compare the outcomes of the implemented algorithm with those provided by a popular linear inversion approach and we also assess the robustness of the CNN inversion to errors in the estimated source wavelet and to erroneous assumptions about the noise statistic. Our tests confirm the applicability of the proposed approach, opening the possibility to estimate the subsurface elastic parameters and the associated uncertainties in near real-time while satisfactorily preserving the assumed spatial variability and the statistical properties of the elastic parameters

Intelligent reconstruction for spatially irregular seismic data by combining compressed sensing with deep learning

Data reconstruction is the most essential step in seismic data processing. Although the compressed sensing (CS) theory breaks through the Nyquist sampling theorem, we previously proved that the CS-based reconstruction of spatially irregular seismic data could not fully meet the theoretical requirements, resulting in low reconstruction accuracy. Although deep learning (DL) has great potential in mining features from data and accelerating the process, it faces challenges in earth science such as limited labels and poor generalizability. To improve the generalizability of deep neural network (DNN) in reconstructing seismic data in the actual situation of limited labeling, this paper proposes a method called CSDNN that combines model-driven CS and data-driven DNN to reconstruct the spatially irregular seismic data. By physically constraining neural networks, this method increases the generalizability of the network and improves the insufficient reconstruction caused by the inability to sample randomly in the whole data definition domain. Experiments on the synthetic and field seismic data show that the CSDNN reconstruction method achieves better performance compared with the conventional CS method and DNN method, including those with low sampling rates, which verifies the feasibility, effectiveness and generalizability of this approach

Machine learning applications for seismic processing and interpretation

During the past few years, exploration seismology has increasingly made use of machine learning algorithms in several areas including seismic data processing, attribute analysis, and computer aided interpretation. Since machine learning is a data-driven method for problem solving, it is important to adopt data which have good quality with minimal bias. Hidden variables and an appropriate objective function also need to be considered. In this dissertation, I focus my research on adapting machine learning algorithms that have been successfully applied to other scientific analysis problems to seismic interpretation and seismic data processing. Seismic data volumes can be extremely large, containing Gigabytes to Terrabytes of information. Add to these volumes the rich choice of seismic attributes, each of which has its own strengths in expressing geologic patterns, and the problem grows larger still. Seismic interpretation involves picking faults and horizons and identifying geologic features by their geometry, morphology, and amplitude patterns seen on seismic data. For the seismic facies classification task, I tested multiple attributes as input and built an attribute subset that can best differentiate the salt, mass transport deposits (MTDs), and conformal reflector seismic patterns using a suite of attribute selection algorithms. The resulting attribute subset differentiates the three classes with high accuracy and has the benefit of reducing the dimensionality of the data. To maximize the use of unlabeled data as well as labeled data, I provide a workflow for facies classification based on a semi-supervised learning approach. Compared to using only labeled data, I find that the addition of unlabeled data for learning results in higher performance of classification.. In seismic processing, I propose a deep learning approach for random and coherent noise attenuation in the frequency – space domain. I find that the deep ResNet architecture speeds up the process of denoising and improves the accuracy, which efficiently separates the noise from signals. Finally, I review geophysical inversion and machine learning approaches in an aspect of solving inverse problems and show similarities and differences of these approaches in both mathematical formulation and numerical tests

Image-domain seismic inversion by deblurring with invertible Recurrent Inference Machines

In complex geologic settings and in the presence of sparse acquisition systems, seismic migration images manifest as nonstationary blurred versions of the unknown subsurface model. Thus, image-domain deblurring is an important step to produce interpretable and high-resolution models of the subsurface. Most deblurring methods focus on inverting seismic images for their underlying reflectivity by iterative least-squares inversion of a local Hessian approximation; this is obtained by either direct modeling of the so-called point-spread functions (PSFs) or by a migration-demigration process. In this work, we adopt a novel deep-learning (DL) framework, based on invertible recurrent inference machines (i-RIMs), which allows approaching any inverse problem as a supervised learning task informed by the known modeling operator (convolution with PSFs in our case): our algorithm can directly invert migrated images for impedance perturbation models, assisted with the prior information of a smooth velocity model and the modeling operator. Because i-RIMs are constrained by the forward operator, they implicitly learn to shape/regularize output models in a training-data-driven fashion. As such, the resulting deblurred images indicate great robustness to noise in the data and spectral deficiencies (e.g., due to limited acquisition). The key role played by the i-RIM network design and the inclusion of the forward operator in the training process is supported by several synthetic examples. Finally, using field data, we find that i-RIM-based deblurring has great potential in yielding robust, high-quality relative impedance estimates from migrated seismic images. Our approach could be of importance toward future DL-based quantitative reservoir characterization and monitoring