Abstract:Velocity model inversion is one of the most challenging tasks in seismic exploration, and an accurate velocity model is essential for high-resolution seismic imaging. Recently, velocity inversion methods based on deep learning (DL), particularly convolutional neural networks (CNNs), have attracted considerable attention from the seismic exploration community. These researchers aim to directly estimate the velocity model from raw seismograms using a well-trained model. Although CNN-based velocity inversion methods have demonstrated remarkable performance in terms of intelligence and automation, their inversion performance is often constrained by a limited long-range dependence. Specifically, when conducting a convolutional operation on raw seismic data using small kernels (i.e., 1 ՠ1, 3 ՠ3, 5 ՠ5, and 7 ՠ7), CNN-based methods extract only local features and neglect the weak spatial correlation between different local features that reflect the information of the same interface. This correlation could assist CNN in providing an overview of the seismic data and promote inversion performance when using DL. Furthermore, the time-varying properties of seismic data pose a challenge to the weight-sharing of CNNs. Here, we proposed a new DL framework based on a transformer, called the seismic velocity inversion transformer (SVIT), to address the problem of velocity inversion. SVIT utilizes a self-attention mechanism to capture the long-range dependence of seismic data, rather than stacking multiple convolutional layers, as in CNNs. Thus, SVIT can provide more informative remote features for building velocity models. The validity and reliability of the proposed method were demonstrated through numerical experiments using synthetic models. Compared with the conventional full waveform inversion method and an existing CNN-based velocity inversion method, the proposed SVIT showed greater consistency with the target in terms of velocity value, subsurface structures, and geological interfaces, and is expected to provide a new DL-based solution to resolve inversion problems.

SVInvNet: A Densely Connected Encoder-Decoder Architecture for Seismic Velocity Inversion

Seismic Velocity Inversion Transformer

Deep-Learning Inversion of Seismic Data

Deep-learning inversion: A next-generation seismic velocity model building method

Data-driven Seismic Prestack Velocity Inversion Via Combining Residual Network with Convolutional Autoencoder

A Physics-Based Neural-Network Way To Perform Seismic Full Waveform Inversion

Encoder-Decoder Architecture for 3D Seismic Inversion

Deep Learning with Adaptive Attention for Seismic Velocity Inversion

Two-dimensional Seismic Velocity Inversion Via Enhanced Multi-view Convolutional Neural Networks for Regression

BiInNet: Bilateral Inversion Network for Real-Time Velocity Analysis

Seismic velocity inversion based on CNN-LSTM fusion deep neural network

An intriguing property of geophysics inversion

InversionNet3D: Efficient and Scalable Learning for 3D Full Waveform Inversion

Seismic Inversion Via Closed-Loop Fully Convolutional Residual Network and Transfer Learning

Semi-Supervised Seismic Impedance Inversion With Convolutional Neural Network and Lightweight Transformer

Cyclic Learning Rate U-Shaped ResNet Embedded with Dual Attentions for Velocity Model Building

ROBUST DEEP LEARNING-BASED SEISMIC INVERSION WORKFLOW USING TEMPORAL CONVOLUTIONAL NETWORKS

TransInver: 3D Data-driven Seismic Inversion based on Self-Attention

Inversion-DeepONet: A Novel DeepONet-Based Network with Encoder-Decoder for Full Waveform Inversion

Enhanced Seismic Imaging with Predictive Neural Networks for Geophysics