Deep Reinforcement Learning-Based Anti-Jamming Algorithm Using Dual Action Network

Xiangchen Li,Jienan Chen,Xiang Ling,Tingyong Wu
DOI: https://doi.org/10.1109/twc.2022.3227575
IF: 10.4
2023-01-01
IEEE Transactions on Wireless Communications
Abstract:Due to the open nature of wireless communication, malicious electromagnetic jamming has long been a severe threat to the establishment and stability of communication links. To address this anti-jamming problem, a Markov decision process (MDP) with a two-dimensional action space consisting of transmit frequency and power is proposed in this paper, modeling the interaction between a normal communication link and the presence of malicious jammers in a frequency hopping (FH) communication system. Furthermore, we also prove the existence of the deterministic optimal policy of the proposed model theoretically. To obtain a policy for the communication link to avoid being jammed, the Dual Action Network-Based Deep Reinforcement Learning Algorithm, and Action Feedback Mechanism are proposed. The energy consumption and frequency switching overhead are considered and evaluated in both the proposed model and the algorithm. Finally, the proposed model and algorithm are verified not only in a virtual simulation environment but also in the field testing environment. The result suggests that the proposed algorithm is of great practical value for solving anti-jamming problems.
What problem does this paper attempt to address?