Abstract:Deep Reinforcement Learning (DRL) has been highly effective in learning from and adapting to RF environments and thus detecting and mitigating jamming effects to facilitate reliable wireless communications. However, traditional DRL methods are susceptible to catastrophic forgetting (namely forgetting old tasks when learning new ones), especially in dynamic wireless environments where jammer patterns change over time. This paper considers an anti-jamming system and addresses the challenge of catastrophic forgetting in DRL applied to jammer detection and mitigation. First, we demonstrate the impact of catastrophic forgetting in DRL when applied to jammer detection and mitigation tasks, where the network forgets previously learned jammer patterns while adapting to new ones. This catastrophic interference undermines the effectiveness of the system, particularly in scenarios where the environment is non-stationary. We present a method that enables the network to retain knowledge of old jammer patterns while learning to handle new ones. Our approach substantially reduces catastrophic forgetting, allowing the anti-jamming system to learn new tasks without compromising its ability to perform previously learned tasks effectively. Furthermore, we introduce a systematic methodology for sequentially learning tasks in the anti-jamming framework. By leveraging continual DRL techniques based on PackNet, we achieve superior anti-jamming performance compared to standard DRL methods. Our proposed approach not only addresses catastrophic forgetting but also enhances the adaptability and robustness of the system in dynamic jamming environments. We demonstrate the efficacy of our method in preserving knowledge of past jammer patterns, learning new tasks efficiently, and achieving superior anti-jamming performance compared to traditional DRL approaches.

Dynamic Spectrum Anti-Jamming Access With Fast Convergence: A Labeled Deep Reinforcement Learning Approach

Intelligent Dynamic Spectrum Anti-Jamming Communications: A Deep Reinforcement Learning Perspective

Flexible Channel Access Against Unknown Dynamic Jamming Attack: A Reinforcement Learning Approach.

On the Performance of Deep Reinforcement Learning-Based Anti-Jamming Method Confronting Intelligent Jammer

Dynamic Spectrum Anti-Jamming with Distributed Learning and Transfer Learning

Anti-jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach

Intelligent Anti-jamming based on Deep Reinforcement Learning and Transfer Learning

Dynamic Spectrum Anti-Jamming in Broadband Communications: A Hierarchical Deep Reinforcement Learning Approach

A DRL-Based Intelligent Jamming Approach for Joint Channel and Power Optimization

Lightweight Reinforcement Learning with State Abstraction for Dynamic Spectrum Anti-Jamming Communications

Primary-User-Friendly Dynamic Spectrum Anti-Jamming Access: A GAN-Enhanced Deep Reinforcement Learning Approach

Continual Deep Reinforcement Learning to Prevent Catastrophic Forgetting in Jamming Mitigation

A cognitive communication jamming strategy based on Transformer and Deep Reinforcement Learning

Fast Reinforcement Learning for Anti-jamming Communications

“Advancing Secretly by an Unknown Path”: A Reinforcement Learning-based Hidden Strategy for Combating Intelligent Reactive Jammer

Anti-Jamming Resource Allocation for Integrated Sensing and Communications Based on Game-Guided Reinforcement Learning

DRL-Based Dynamic Channel Access and SCLAR Maximization for Networks Under Jamming

Enhanced Radar Anti-Jamming With Multi-Agent Reinforcement Learning

Against Jamming Attack in Wireless Communication Networks: A Reinforcement Learning Approach

A Fast Anti-Jamming Algorithm Based on Imitation Learning for WSN

A hidden anti-jamming method based on deep reinforcement learning