Abstract:This paper investigates the cooperative anti-jamming distributed channel selection problem in UAV communication networks. Considering the existence of malicious jamming and co-channel interference, we design an interference-aware cooperative anti-jamming scheme for the purpose of maximizing users' utilities. Moreover, the channel switching cost and cooperation cost are introduced, which have a great impact on users' utilities. Users in the UAV group sense the co-channel interference signal energy to judge whether they are influenced by co-channel interference. When the received co-channel interference signal energy is lower than the co-channel interference threshold, users conduct channel selection strategies independently. Otherwise, users cooperate with each other and take joint actions with a cooperative anti-jamming pattern under the impact of co-channel interference. Aiming at the independent anti-jamming channel selection problem under no co-channel interference, a Markov decision process framework is introduced, whereas for the cooperative anti-jamming channel selection case under the influence of co-channel mutual interference, a Markov game framework is employed. Furthermore, motivated by Q-learning with a "cooperation-decision-feedback-adjustment" idea, we design an interference-aware cooperative anti-jamming distributed channel selection algorithm (ICADCSA) to obtain the optimal anti-jamming channel strategies for users in a distributed way. In addition, a discussion on the quick decision for UAVs is conducted. Finally, simulation results show that the proposed algorithm converges to a stable solution with which the UAV group can avoid malicious jamming, as well as co-channel interference effectively and can realize a quick decision in high mobility UAV communication networks.

Collaborative Multiagent Reinforcement Learning Aided Resource Allocation for UAV Anti-Jamming Communication

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

UAV Communication Against Intelligent Jamming: A Stackelberg Game Approach With Federated Reinforcement Learning

A Collaborative Multi-Agent Reinforcement Learning Anti-Jamming Algorithm in Wireless Networks

Research on Efficient Multiagent Reinforcement Learning for Multiple UAVs' Distributed Jamming Strategy

Smart Shield: Prevent Aerial Eavesdropping Via Cooperative Intelligent Jamming Based on Multi-Agent Reinforcement Learning

Reinforcement Learning-Based Anti-Jamming in Networked UAV Radar Systems

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

UAV-Enabled Secure Communications by Multi-Agent Deep Reinforcement Learning

Cooperative anti-jamming and interference mitigation for UAV networks: A local altruistic game approach

Multi-Agent Deep Reinforcement Learning for Secure UAV Communications

Approximating Nash equilibrium for anti-UAV jamming Markov game using a novel event-triggered multi-agent reinforcement learning

Interference-Aware Cooperative Anti-Jamming Distributed Channel Selection in UAV Communication Networks

Multi-Agent Reinforcement Learning-Based Resource Sharing in Multi-UAV Wireless Networks

Multi-Agent Reinforcement Learning With Policy Clipping and Average Evaluation for UAV-Assisted Communication Markov Game

Multi-Agent Reinforcement Learning for Joint Cooperative Spectrum Sensing and Channel Access in Cognitive UAV Networks

UAV Cooperative Air Combat Maneuvering Confrontation Based on Multi-agent Reinforcement Learning

Intelligent Anti-Jamming Communication for Wireless Sensor Networks: A Multi-Agent Reinforcement Learning Approach

Anti-Intelligent UAV Jamming Strategy Via Deep Q-Networks

Multi-Agent Reinforcement Learning with Action Masking for UAV-enabled Mobile Communications

Joint UAV trajectory and communication design with heterogeneous multi-agent reinforcement learning