Abstract:In the face of various complex interferences encountered by radar systems in modern electronic warfare, the performance of radar is greatly affected. Therefore, intelligent and adaptive radar anti-jamming waveform design methods have become crucial. This paper proposes a training algorithm for anti-jamming strategies under multiple types of interference based on deep reinforcement learning. Considering that radar jamming resistance possesses Markovian properties, meaning that the current anti-jamming strategy of the radar is only related to the current momentary state and independent of previous states, a reinforcement learning algorithm is introduced to construct the Markov Decision Process (MDP) framework. Due to the complex and continuous nature of the state-action space, neural networks are introduced. By quantifying anti-jamming decisions through the construction of state sets, action sets, and reward functions, and modeling the anti-jamming process as a Markov decision process, we propose a radar anti-multiple interference algorithm based on the Soft Actor-Critic (SAC) algorithm, called RAMI-SAC, to optimize strategies. Specifically, considering the synchronization between radar signals and interference signals, we utilize the characteristics of radar signals and interference signals from the previous time step to construct the state space. We use the RAMI-SAC algorithm to generate anti-jamming strategies, including the masking pulse width, frequency band, and signal power of the current radar sequence. Through multiple sets of simulations, the convergence of the algorithm is demonstrated, resulting in anti-jamming strategies that can withstand attacks from multiple types of interference, maintaining a certain level of detection capability even in the presence of multiple types of interference.

Reinforcement Learning-Based Anti-Jamming in Networked UAV Radar Systems

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

UAV Communication Against Intelligent Jamming: A Stackelberg Game Approach With Federated Reinforcement Learning

Reinforcement Learning-Based Joint Adaptive Frequency Hopping and Pulse-Width Allocation for Radar anti-Jamming

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

Energy Efficient Relay in UAV Networks Against Jamming: A Reinforcement Learning Based Approach.

Research on Efficient Multiagent Reinforcement Learning for Multiple UAVs' Distributed Jamming Strategy

Performance Analysis of Deep Reinforcement Learning-Based Intelligent Cooperative Jamming Method Confronting Multi-functional Networked Radar

Anti-Intelligent UAV Jamming Strategy Via Deep Q-Networks

Distributed reinforcement learning based framework for energy-efficient UAV relay against jamming

Design of Anti-Jamming Waveforms for Cognitive Radar Based on Deep Reinforcement Learning

Reinforcement Learning based Anti-jamming Frequency Hopping Strategies Design for Cognitive Radar

Joint Optimization of Jamming Type Selection and Power Control for Countering Multi-function Radar Based on Deep Reinforcement Learning

Joint Trajectory and Passive Beamforming Optimization in IRS-UAV Enhanced Anti-Jamming Communication Networks

Interference-Aware Cooperative Anti-Jamming Distributed Channel Selection in UAV Communication Networks

Frequency Agile Anti-Interference Technology Based on Reinforcement Learning Using Long Short-Term Memory and Multi-Layer Historical Information Observation

An Optimization Method for Collaborative Radar Antijamming Based on Multi-Agent Reinforcement Learning

Reinforcement Learning Based Radar Anti-Jamming Strategy Design Against a Non-Stationary Jammer

Smart Shield: Prevent Aerial Eavesdropping Via Cooperative Intelligent Jamming Based on Multi-Agent Reinforcement Learning

Jamming-Resilient Path Planning for Multiple UAVs via Deep Reinforcement Learning

Jamming Strategy Optimization through Dual Q-Learning Model against Adaptive Radar