Abstract:Unmanned aerial vehicles (UAVs) with limited energy resources, severe path loss, and shadowing to the ground base stations are vulnerable to smart jammers that aim to degrade the UAV communication performance and exhaust the UAV energy. The UAV anti-jamming communication performance, such as the outage probability, degrades if the robot relay is not aware of the jamming policies and the UAV network topology. In this paper, we propose a robot relay scheme for UAVs against smart jamming, which combines reinforcement learning with a function approximation approach named tile coding, to jointly optimize the robot moving distance and relay power with the unknown jamming channel states and locations. The robot mobility and relay policy are chosen based on the received jamming power, the robot received signal quality, location and energy consumption, and the bit error rate of the UAV messages. We also present a deep reinforcement learning version for the robot with sufficient computing resources. It uses three deep neural networks to choose the robot mobility and relay policy with reduced sample complexity, so as to avoid exploring dangerous policies that lead to the high outage probability of the UAV messages. The network architecture of the three networks is designed with fully connected layers instead of convolutional layers to reduce the computational complexity, which is analyzed by theoretical analyses. We provide the performance bound of the proposed schemes in terms of the bit error rate, robot energy consumption and utility based on a game-theoretic study. Simulation results show that the performance of our proposed relay schemes, including the bit error rate, the outage probability, and the robot energy consumption outperforms the existing schemes.

UAV Anti-Jamming Video Transmissions with QoE Guarantee: A Reinforcement Learning-Based Approach.

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Learning-Based Low-Latency VIoT Video Streaming Against Jamming and Interference

QoE-Aware Power Control for UAV-Aided Media Transmission with Reinforcement Learning

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

Energy Efficient Relay in UAV Networks Against Jamming: A Reinforcement Learning Based Approach.

A Learning Approach Towards Secure Cognitive Networks with UAV Relaying and Active Jamming

Distributed reinforcement learning based framework for energy-efficient UAV relay against jamming

Deep Learning-Assisted Secure UAV-Relaying Networks with Channel Uncertainties

Energy-Efficient Video Streaming in UAV-Enabled Wireless Networks: A Safe-DQN Approach

UAV Communication Against Intelligent Jamming: A Stackelberg Game Approach With Federated Reinforcement Learning

A DNN Framework for Secure Transmissions in UAV-Relaying Networks with a Jamming Receiver.

UAV Networks Against Multiple Maneuvering Smart Jamming with Knowledge-Based Reinforcement Learning.

Reinforcement Learning Based Energy Efficient Robot Relay for Unmanned Aerial Vehicles Against Smart Jamming

QoE Optimization for Live Video Streaming in UAV-to-UAV Communications via Deep Reinforcement Learning

Covert UAV Data Transmission Via Semantic Communication: A DRL-Driven Joint Position and Power Optimization Method

Reinforcement Learning Based QoS-Aware Anti-Jamming Underwater Video Transmission

Deep Reinforcement Learning-Driven Jamming-Enhanced Secure Unmanned Aerial Vehicle Communications

Energy Efficiency Maximization for Secure Live Video Streaming in UAV Wireless Networks

Lightweight Reinforcement Learning with State Abstraction for Dynamic Spectrum Anti-Jamming Communications

Reinforcement Learning-Based Anti-Jamming in Networked UAV Radar Systems