Abstract:The swarm relay and power allocation policy determines the bit error rate and the energy consumption of unmanned aerial vehicles (UAVs) and can be optimized based on the network and jamming model, which is rarely known by UAVs. In this paper, we propose a multi-agent reinforcement learning (RL)-based UAV swarm communication scheme to optimize the relay selection and power allocation against jamming. Based on the network topology, channel states, previous performance and observations shared by the neighboring UAVs, this scheme formulates the policy distribution to improve the policy exploration and applies a policy learning mechanism to stabilize the learning process. Based on transfer learning, the shared swarm experiences are exploited to accelerate the initial learning and improve policy optimization. A deep RL-based scheme is proposed to mitigate the state quantization error for the rapidly changing channel states under high swarm moving speed and thus further improve the anti-jamming performance. This scheme designs a policy network with four fully connected layers to approximate the policy distribution and uses another two neural networks to estimate the average policy distribution and the expected long-term utility, respectively, to update the policy network for stabilized deep learning. We investigate the computational complexity and derive the performance bound regarding the bit error rate, the energy consumption and the utility. Simulation and experimental results verify the performance gain of our proposed schemes over related works.

Reinforcement Learning Based Power Control for VANET Broadcast Against Jamming

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Power control method based on network condition information for VANET

Reinforcement Learning-Based Wireless Communications Against Jamming and Interference

Power and Interference Control for VLC-Based UDN: A Reinforcement Learning Approach.

Jamming and Eavesdropping Defense Scheme Based on Deep Reinforcement Learning in Autonomous Vehicle Networks

Decentralized Deep Reinforcement Learning for Delay-Power Tradeoff in Vehicular Communications

Joint Spectrum Allocation and Power Control in Vehicular Networks Based on Reinforcement Learning.

Age of Information-Aware Radio Resource Management in Vehicular Networks: A Proactive Deep Reinforcement Learning Perspective

Power-control-based Broadcast Scheme for Emergency Messages in VANETs

Multi-Agent Deep Reinforcement Learning for Channel Resource Allocation in Vehicular Networks

Distributed and Coordinated Multi-Agent Learning for Resource Allocation in Vehicular Networks

Anti-Jamming Technique for IRS Aided JRC System in Mobile Vehicular Networks

A New Anti-Jamming Strategy Based on Deep Reinforcement Learning for MANET

Deep Reinforcement Learning for Distributed Dynamic Power Allocation in Wireless Networks.

Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks.

Cognitive Risk Control for Anti-Jamming V2V Communications in Autonomous Vehicle Networks

UAV Relay in VANETs Against Smart Jamming with Reinforcement Learning

Against Jamming Attack in Wireless Communication Networks: A Reinforcement Learning Approach

Meta Soft Actor-Critic Based Robust Sequential Power Control in Vehicular Networks

Deep Reinforcement Learning Based Adaptive Transmission Control in Vehicular Networks.