Abstract:The random noise attenuation is an essential step in seismic data processing. Due to complex geological conditions and acquisition environment, the intensity of the effective signal and random noise varies in time and space. Additionally, the morphology of seismic events is complex and diverse, such as large dips and fast changes. These complex conditions necessitate that the denoiser adjust the filtering policy dynamically. In this article, we propose a reinforcement learning-based seismic denoising (RLSD) model with the framework of asynchronous advantage actor–critic (A3C). In the A3C framework, the RLSD agent utilizes a policy network to learn a denoising policy for the state that is the sample of seismic data and selects a suitable filter from the preset action space composed of multiple simple and effective seismic filters with different parameters. Moreover, the RLSD agent utilizes a value network and a region-adaptive weighted reward function to accurately evaluate the denoising effect of nonstationary seismic signals. A curriculum learning approach is adopted to achieve convergence of the proposed RLSD model under complex seismic data by training from the stationary training data to nonstationary training data and make the model more suitable to the data to be processed by using a local similarity-based reward function to fine-tune the model. The synthetic and field seismic data applications confirm that the proposed RLSD model achieves a significant performance in preserving nonstationary signals and suppressing noise by adaptively adjusting the denoising policy according to the complex structural features and noise levels. The source code is available at https://github.com/liangc-code/RLSD.

Narrowband Active Noise Control with DDPG Based on Reinforcement Learning

DNoiseNet: Deep learning-based feedback active noise control in various noisy environments

A Secondary Path-Decoupled Active Noise Control Algorithm Based on Deep Learning

Deep learning-assisted active noise control in a time-varying environment

Deep ANC: A deep learning approach to active noise control

A Hybrid Deep-Online Learning Based Method for Active Noise Control in Wave Domain

Enhancing active noise control of road noise using deep neural network to update secondary path estimate in real time

Deep learning-based active noise control on construction sites

Updating the secondary path using deep learning models to enhance the performance of active road noise control

Experimental study of the active noise control algorithms without secondary path modeling

Deep MCANC: A deep learning approach to multi-channel active noise control

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

Robust Non-Linear Active Function-Based FxRLS for Impulsive Active Noise Control

GFANC-RL: Reinforcement Learning-based Generative Fixed-filter Active Noise Control

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

An Improved Active Noise Control Algorithm Without Secondary Path Identification Based on the Frequency-Domain Subband Architecture

Reinforcement Learning-Based Denoising Model for Seismic Random Noise Attenuation

Development of active noise control simulation with virtual controller based on computational aeroacoustics

Automatic Noise Filtering with Dynamic Sparse Training in Deep Reinforcement Learning

Analyzing Robustness of the Deep Reinforcement Learning Algorithm in Ramp Metering Applications Considering False Data Injection Attack and Defense

Online Control of Adaptive Large Neighborhood Search using Deep Reinforcement Learning