Inverseformer: Dual-Branch Network with Attention Enhancement for Density Interface Inversion

Ping Yu,Long-Ran Zhou,Xiao Zhao,Peng-Yu Lu,Guan-Lin Huang,Jian Jiao,Feng-Yi Bi
DOI: https://doi.org/10.1109/lgrs.2024.3470123
2024-01-01
Abstract:Density interface inversion directly reveals the density distribution of underground structures, playing a significant role in the field of geophysics. Deep learning, due to its ability to extract complex and nonlinear density structures, has been widely applied to density interface inversion. Current convolution-based neural network methods for inverting density interfaces are limited by the finite receptive field of the convolution paradigm, neglecting long-range dependencies and posing challenges for high-precision inversion of density interfaces. Additionally, when using deep learning for density interface inversion, different channels contain different information, necessitating the effective utilization of this information variation in the channel dimension. To address these issues, this letter proposes a novel dual-path Transformer network for density interface inversion, named Inverseformer. The Local-Global branch introduces Transformer to establish long-range density dependencies and, combined with the U-net network, jointly captures multiscale underground density interface features. The Channel branch introduces a channel attention mechanism for the model to operate attentively between channels, effectively capturing density interface structural changes in the channels. Synthetic model experiments show that the proposed dual-branch network for inverting density interfaces has smaller model errors and better data fitting, resulting in higher inversion accuracy and more stable inversion results. Subsequently, its effectiveness and value were validated in actual data from the Brittany region of France.
What problem does this paper attempt to address?