A New Frequency Hopping Strategy Based on Federated Reinforcement Learning for FANET

Yuanfan Ye,Ming Lei,Minjian Zhao
DOI: https://doi.org/10.1109/vtc2021-fall52928.2021.9625406
2021-01-01
Abstract:The flying ad-hoc network (FANET) is widely applied to unmanned aerial vehicles (UAV s) but it is vulnerable to the frequency jamming in reality. Therefore, this paper proposes a federated deep Q-network (DQN) based frequency hopping strategy to solve the problem of periodic frequency jamming. We developed a DQN mechanism with an exploration-exploitation epsilon-greedy policy, directed by a federated learning mechanism to obtain a frequency hopping strategy. The simulation results show that our proposed algorithm has better convergence and decision accuracy performance compared with the DQN based frequency hopping strategy. And the performance will improve when the number of UAVs increases.
What problem does this paper attempt to address?