Abstract:Though learning the emission policy online to capture an unknown jammer's emission pattern and exploit its strategy weakness is a promising and appealing technique for radar anti-jamming, current research on cognitive radar's active emission policies still suffers from low sample efficiency, limited generalization, and underutilization of radar emission flexibility. To address these issues, we propose a framework based on policy search that combines policy parameterization, black-box process, and bandit optimization to efficiently adjust radar emission policy online and significantly improve radar detection performance in the presence of mainlobe interference. In short, we let a low-dimensional vector drive the radar's emission policy in a manual code framework and restrict the policy parameters to contain only categorical variables. Then, a Thompson Sampling Decision Tree (TSDT) algorithm is proposed to determine the optimal information-sharing mechanism among parameterized policies and capture their correlation to accelerate optimization. As a result, TSDT recommends the active emission policy through hierarchical sampling when balancing the exploration-exploitation trade-off. In this way, the low dimensional vector fully represents the emission flexibility, and its low dimension significantly facilitates the sample efficiency. Also, the black box process avoids strong assumptions about the jammer. The experiment simulates a frequency agility (FA) radar with optional pulse widths, bandwidths, and FA policies against four kinds of jammers with different decision logics, and the results show that the proposed algorithm can quickly adapt to diverse jammers and significantly improve the radar's detection performance.

Online Decision-making Method for Frequency-agile Radar Based on Multi-Armed Bandit

An Intelligent Frequency Decision Method for a Frequency Agile Radar Based on Deep Reinforcement Learning

Online Frequency-Agile Strategy for Radar Detection Based on Constrained Combinatorial Non-Stationary Bandit

Radar Anti-Jamming Decision-Making Method Based on DDPG-MADDPG Algorithm

Online Emission Policy Selection for Radar Anti-Jamming using Bandit-Optimized Policy Search

An online frequency allocation strategy for multi‐carrier radar against spot jammer

Frequency Agile Anti-Interference Technology Based on Reinforcement Learning Using Long Short-Term Memory and Multi-Layer Historical Information Observation

An Intelligent Jamming Strategy Design Method Against Frequency Agility Radar

A Cognitive Jamming Decision-making Method for Multi-functional Radar Based on Threat Assessment

Joint Jamming and Mutual Interference Elimination for Frequency Agile Radars Via Decentralized Q-Learning

Anti-jamming Equilibrium Strategy Learning of Frequency Agile Radar Based on Monte Carlo Tree Search

AK-MADDPG-Based Antijamming Strategy Design Method for Frequency Agile Radar

Frequency Diversity Array Radar and Jammer Intelligent Frequency Domain Power Countermeasures Based on Multi-Agent Reinforcement Learning

A Probabilistic Jamming Strategy Model for Frequency Agility Radar Anti-Jamming Problem

An Adaptive Dwell Time Scheduling Model for Phased Array Radar Based on Three-Way Decision

Radar Anti-Jamming Countermeasures Intelligent Decision-Making: A Partially Observable Markov Decision Process Approach

A Fast Learning Method for Optimal Jamming to Radar in Real-Time Environment

GA-Dueling DQN Jamming Decision-Making Method for Intra-Pulse Frequency Agile Radar

An Intelligent Strategy Decision Method for Collaborative Jamming Based On Hierarchical Multi-Agent Reinforcement Learning

Multi-Agent Reinforcement Learning for Anti-jamming Game of Frequency-Agile Radar

Intelligent Decision Method of Slope Perturbing Based on Q-Learning for Anti-Deception Jamming