Self-Attention Generative Adversarial Network Interpolating and Denoising Seismic Signals Simultaneously

Mu Ding,Yatong Zhou,Yue Chi
DOI: https://doi.org/10.3390/rs16020305
IF: 5
2024-01-12
Remote Sensing
Abstract:In light of the challenging conditions of exploration environments coupled with escalating exploration expenses, seismic data acquisition frequently entails the capturing of signals entangled amidst diverse noise interferences and instances of data loss. The unprocessed state of these seismic signals significantly jeopardizes the interpretative phase. Evidently, the integration of attention mechanisms and the utilization of generative adversarial networks (GANs) have emerged as prominent techniques within signal processing owing to their adeptness in discerning intricate global dependencies. Our research introduces a pioneering approach for reconstructing and denoising seismic signals, amalgamating the principles of self-attention and generative adversarial networks—hereafter referred to as SAGAN. Notably, the incorporation of the self-attention mechanism into the GAN framework facilitates an enhanced capacity for both the generator and discriminator to emulate meaningful spatial interactions. Subsequently, leveraging the feature map generated by the self-attention mechanism within the GAN structure enables the interpolation and denoising of seismic signals. Rigorous experimentation substantiates the efficacy of SAGAN in simultaneous signal interpolation and denoising. Initially, we benchmarked SAGAN against prominent methods such as UNet, CNN, and Wavelet for the concurrent interpolation and denoising of two-dimensional seismic signals manifesting varying levels of damage. Subsequently, this methodology was extended to encompass three-dimensional seismic data. Notably, performance metrics reveal SAGAN's superiority over comparative methods. Specifically, the quantitative tables exhibit SAGAN's pronounced advantage, with a 3.46% increase in PSNR value over UNet and an impressive 11.90% surge compared to Wavelet. Moreover, the RMSE values affirm SAGAN's robust performance, showcasing an 11.54% reduction in comparison to UNet and an impressive 29.27% decrement relative to Wavelet, hence unequivocally establishing the SAGAN method as a preeminent choice for seismic signal recovery.
environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
What problem does this paper attempt to address?
The problem that this paper attempts to solve is that in seismic signal processing, due to the harsh exploration environment and high exploration costs, the collected seismic signals are often mixed with various noise interferences and there is data loss. The unprocessed seismic signals seriously affect the subsequent interpretation stage. Therefore, this paper aims to propose a new method, combining self - attention mechanism and generative adversarial network (GAN), to interpolate and denoise seismic signals simultaneously in order to improve the quality and integrity of the signals. Specifically, the goals of the paper include: 1. **Improve the reconstruction quality of seismic signals**: By introducing the self - attention mechanism, enhance the ability of the generator and discriminator to capture complex spatial dependencies, so as to more effectively recover the missing seismic signals. 2. **Achieve synchronous interpolation and denoising**: Develop a method that can perform interpolation and denoising simultaneously, avoiding the additional time and computational costs brought by training two independent networks separately. 3. **Improve the generalization ability of the method**: Ensure that the proposed method is not only applicable to 2D seismic signals, but also can handle 3D seismic signals and perform well on data with different degrees of damage. To verify the effectiveness of this method, the author conducted a large number of experiments and compared the proposed SAGAN model with existing methods such as UNet, CNN and Wavelet. The results show that SAGAN has significant advantages in performance indicators such as PSNR (Peak Signal - to - Noise Ratio) and RMSE (Root Mean Square Error). ### Formula Summary 1. **Calculation of the attention map in the self - attention mechanism**: \[ s_{i,j} = A(x_i)^T B(x_j) \] \[ \beta_{j,i} = \frac{\exp(s_{i,j})}{\sum_{i = 1}^{N} \exp(s_{i,j})} \] \[ o_j = d\left(\sum_{i = 1}^{N} \beta_{j,i} C(x_i)\right), \quad C(x_i) = W_C x_i, \quad d(x_i) = W_d x_i \] 2. **Loss functions of the generator and discriminator**: \[ L_G = -E_{z \sim p_z, y \sim p_{signal}}[D(G(z), y)] \] \[ L_D = -E_{(x,y) \sim p_{signal}}[\min(0, - 1+D(x, y))] - E_{z \sim p_z, y \sim p_{signal}}[\min(0, - 1 - D(G(z), y))] \] These formulas show the core calculation process of the SAGAN model, ensuring its efficiency and accuracy in processing complex seismic signals.