Abstract:Due to the need for the real-time participation of a large number of professionals, existing decision-making methods for radar interference suppression are characterized by a slow decision-making speed, unstable decision-making effects, and insufficient decision-making intelligence. In this paper, a deep reinforcement learning (DRL)-based decision-making method for radar interference suppression is proposed. This method has a fast decision speed and a stable and accurate decision effect, and can complete decision-making tasks by itself with high intelligence. To enhance the ability of the agent to acquire high-value experiences, the variable greedy algorithm (VGA) is proposed. The VGA adjusts the fixed greedy value in the original action strategy into a declining greedy curve that mimics the human learning process via a combination of the ideas in the win or learn fast–policy hill-climbing (WoLF-PHC) algorithm and the Ebbinghaus forgetting curve. To improve the efficiency of the agent in utilizing high-value experiences, the double-depth prioritized experience replay (DDPER) algorithm is proposed. The DDPER algorithm changes the uniform random experience replay into prioritized experience replay (PER), and performs sorting and extraction learning based on experience values in the form of additive trees to achieve better learning results. Further, the accuracy and speed of decision-making are improved via the double-depth experience replay system. The findings of a simulation experiment show that the agent can efficiently learn the most optimal radar interference suppression method by knowing that the interference suppression algorithm library contains algorithms that can deal with current environmental interference signals. Furthermore, compared to the PER–double deep Q-Network (PER-DDQN) presented by Zhang, the average accuracy, speed, and stability of decision-making are respectively increased by 6.4%, 2.51%, and 102.12%.

Radar Anti-Jamming Decision-Making Method Based on DDPG-MADDPG Algorithm

Radar Anti-Jamming Countermeasures Intelligent Decision-Making: A Partially Observable Markov Decision Process Approach

Improving anti-jamming decision-making strategies for cognitive radar via multi-agent deep reinforcement learning

An Intelligent Anti-jamming Decision-making Method Based on Deep Reinforcement Learning for Cognitive Radar

Deep Reinforcement Learning Based Decision Making for Radar Jamming Suppression

AK-MADDPG-Based Antijamming Strategy Design Method for Frequency Agile Radar

Design of anti‐jamming decision‐making for cognitive radar

Radar and Jammer Intelligent Game under Jamming Power Dynamic Allocation

Design of Anti-Jamming Waveforms for Cognitive Radar Based on Deep Reinforcement Learning

Multi-Agent Reinforcement Learning for Anti-jamming Game of Frequency-Agile Radar

Frequency Diversity Array Radar and Jammer Intelligent Frequency Domain Power Countermeasures Based on Multi-Agent Reinforcement Learning

Radar Jamming Decision-Making in Cognitive Electronic Warfare: A Review

Enhanced Radar Anti-Jamming With Multi-Agent Reinforcement Learning

Intelligent Decision Method of Slope Perturbing Based on Q-Learning for Anti-Deception Jamming

Smart Noise Jamming Power Adjustment Using Exploratory Deep Deterministic Policy Gradient

Joint Optimization of Jamming Type Selection and Power Control for Countering Multi-function Radar Based on Deep Reinforcement Learning

Jamming Policy Generation via Heuristic Programming Reinforcement Learning

Joint Optimization of Jamming Type Selection and Power Control for Countering Multifunction Radar Based on Deep Reinforcement Learning

A Probabilistic Jamming Strategy Model for Frequency Agility Radar Anti-Jamming Problem

Performance Analysis of Deep Reinforcement Learning-Based Intelligent Cooperative Jamming Method Confronting Multi-functional Networked Radar

GA-Dueling DQN Jamming Decision-Making Method for Intra-Pulse Frequency Agile Radar