Online Emission Policy Selection for Radar Anti-Jamming using Bandit-Optimized Policy Search
Yuyuan Fang,Song Wei,Lei Zhang,Zhenhua Wu,Jianxin Wu
DOI: https://doi.org/10.1109/taes.2024.3358793
IF: 3.491
2024-01-01
IEEE Transactions on Aerospace and Electronic Systems
Abstract:Though learning the emission policy online to capture an unknown jammer's emission pattern and exploit its strategy weakness is a promising and appealing technique for radar anti-jamming, current research on cognitive radar's active emission policies still suffers from low sample efficiency, limited generalization, and underutilization of radar emission flexibility. To address these issues, we propose a framework based on policy search that combines policy parameterization, black-box process, and bandit optimization to efficiently adjust radar emission policy online and significantly improve radar detection performance in the presence of mainlobe interference. In short, we let a low-dimensional vector drive the radar's emission policy in a manual code framework and restrict the policy parameters to contain only categorical variables. Then, a Thompson Sampling Decision Tree (TSDT) algorithm is proposed to determine the optimal information-sharing mechanism among parameterized policies and capture their correlation to accelerate optimization. As a result, TSDT recommends the active emission policy through hierarchical sampling when balancing the exploration-exploitation trade-off. In this way, the low dimensional vector fully represents the emission flexibility, and its low dimension significantly facilitates the sample efficiency. Also, the black box process avoids strong assumptions about the jammer. The experiment simulates a frequency agility (FA) radar with optional pulse widths, bandwidths, and FA policies against four kinds of jammers with different decision logics, and the results show that the proposed algorithm can quickly adapt to diverse jammers and significantly improve the radar's detection performance.
telecommunications,engineering, electrical & electronic, aerospace