Opponent Awareness-based Anti-intelligent Jamming Channel Access Scheme: A Deep Reinforcement Learning Perspective

Hongcheng Yuan,Jin Chen,Wen Li,Guoxin Li,Hao Han,Taoyi Chen,Fanglin Gu,Yuhua Xu
DOI: https://doi.org/10.1109/jiot.2023.3329529
IF: 10.6
2023-01-01
IEEE Internet of Things Journal
Abstract:As a fundamental requirement for IoT communication systems the importance of highly reliable anti-jamming communication methods in safety use cases is growing. In this paper, we propose a novel anti-intelligent jamming scheme called opponent awareness-based anti-jamming algorithm (OA3). The user-jammer-environment interaction is formulated as a two-player simultaneous action stochastic game where participators have the ability to update their strategies. The decision-making process of each agent is modeled as a Markov decision process (MDP). Begin with the intuition “learn how the jammer learns", the opponent awareness-based iterative learning objective (OAL) of the user is presented by considering the learning awareness of the jammer to defeat the intelligent jamming. Finally, we introduce the framework including offline policy learning and online policy exploiting to implement OAL and accelerate the learning. Simulations show that the OA3 outperforms the benchmark anti-jamming strategy in terms of packet success rate.
computer science, information systems,telecommunications,engineering, electrical & electronic
What problem does this paper attempt to address?