Abstract:Velocity model inversion is one of the most challenging tasks in seismic exploration, and an accurate velocity model is essential for high-resolution seismic imaging. Recently, velocity inversion methods based on deep learning (DL), particularly convolutional neural networks (CNNs), have attracted considerable attention from the seismic exploration community. These researchers aim to directly estimate the velocity model from raw seismograms using a well-trained model. Although CNN-based velocity inversion methods have demonstrated remarkable performance in terms of intelligence and automation, their inversion performance is often constrained by a limited long-range dependence. Specifically, when conducting a convolutional operation on raw seismic data using small kernels (i.e., 1 ՠ1, 3 ՠ3, 5 ՠ5, and 7 ՠ7), CNN-based methods extract only local features and neglect the weak spatial correlation between different local features that reflect the information of the same interface. This correlation could assist CNN in providing an overview of the seismic data and promote inversion performance when using DL. Furthermore, the time-varying properties of seismic data pose a challenge to the weight-sharing of CNNs. Here, we proposed a new DL framework based on a transformer, called the seismic velocity inversion transformer (SVIT), to address the problem of velocity inversion. SVIT utilizes a self-attention mechanism to capture the long-range dependence of seismic data, rather than stacking multiple convolutional layers, as in CNNs. Thus, SVIT can provide more informative remote features for building velocity models. The validity and reliability of the proposed method were demonstrated through numerical experiments using synthetic models. Compared with the conventional full waveform inversion method and an existing CNN-based velocity inversion method, the proposed SVIT showed greater consistency with the target in terms of velocity value, subsurface structures, and geological interfaces, and is expected to provide a new DL-based solution to resolve inversion problems.

SeismicTransformer: an Attention-Based Deep Learning Method for the Simulation of Seismic Wavefields

SeisT: A foundational deep learning model for earthquake monitoring tasks

Seismogram Transformer: A Generic Deep Learning Backbone Network for Multiple Earthquake Monitoring Tasks

SeisT: A Foundational Deep-Learning Model for Earthquake Monitoring Tasks

Unsupervised Deep Learning for Seismic Data Reconstruction

Transformer For Low-frequency Extrapolating of Seismic Data

Deep learning for high-resolution seismic imaging

A Multi-Task Fourier Transformer Network for Seismic Source Characterization Estimation from a Single-Station Waveform

Rapid Earthquake Magnitude Estimation Using Deep Learning.

Xi-Net: Transformer Based Seismic Waveform Reconstructor

Earthquake magnitude and location estimation from real time seismic waveforms with a transformer network

Swin Transformer for Seismic Denoising

Attention and Hybrid Loss Guided 2-D Network for Seismic Impedance Inversion

Optimizing a Transformer-based network for a deep learning seismic processing workflow

Transformer for seismic image super-resolution

Simulating Multicomponent Elastic Seismic Wavefield Using Deep Learning

Seismic Facies Segmentation Via a Segformer-Based Specific Encoder–Decoder–Hypercolumns Scheme

Study on Geomagnetic Observations Associated With Three Major Earthquakes in Southwest China Through a Novel Deep Learning Framework

Earthquake transformer—an attentive deep-learning model for simultaneous earthquake detection and phase picking

Seismic Velocity Inversion Transformer