Optimal Frequency-Hopping Anti-Jamming Strategy Based on Multi-Step Prediction Markov Decision Process

Wei Peng,Wang Shilian,Luo Junshan,Liu Yan,Hu Li
DOI: https://doi.org/10.1007/s11276-021-02735-7
IF: 2.701
2021-01-01
Wireless Networks
Abstract:With the increasingly fierce competition for electromagnetic spectrum resources and the rapid development in artificial intelligence, frequency-hopping (FH) communication systems are facing serious intelligent jamming attacks. Under this background, game theory has become an effective tool to solve the optimal decision-making problem in communication countermeasures. In this paper, focusing on defending against sweep jamming attacks and considering the inevitable transmission delay of an actual communication system, we propose a multi-step prediction Markov decision process (MPMDP) and set up a multi-step prediction Bellman iterative equation (MPBIE). To solve the MPBIE, multi-step state transition probabilities are derived, and a simplified algorithm is designed. Combing the complete strategy we proposed, the MPMDP strategy to maximize the utility of the FH communication system is obtained. With the assumption that the jammer can learn the MPMDP strategy of the FH communication system, we furtherly study its optional sweep jamming attack strategy. The MPMDP strategy and the optional intelligent sweep jamming attack strategy as a Nash equilibrium of the communication system and the jammer are proved. Lastly, simulation results show that the property and theorems proposed in this paper are valid, and our MPMDP strategy outperforms similar algorithms in terms of the applicable range and performance.
What problem does this paper attempt to address?