Abstract:Integration of unmanned aerial vehicles (UAVs) with ultra-reliable and low-latency communication (URLLC) systems can improve the real-time communication performance for various industrial internet of things (IIoT) applications. Designing an intelligent resource allocation system is one of the challenges posed by an energy-constrained UAV communication system. Therefore, we formulate a sum rate maximization problem, subject to the UAVs' energy by optimizing the blocklength allocation and the power control jointly in the uplink UAV-assisted URLLC systems, in which the probabilistic channel model between UAV and users is adopted. The problem is difficult to solve due to the non-convex objective function and the energy constraints, and also challenging to make fast decision in the complex communication environment. Thus, we propose a deep reinforcement learning (DRL)-based scheme to optimize the blocklength allocation and power control jointly. First, transform the original problem into the multi-agent reinforcement learning process, where each subcarrier is regarded as the agent that optimizes its individual blocklength allocation and power control. Then, each agent makes the intelligent decision to obtain the maximum reward value depending on the weighted segmented reward function, which is related to the UAV energy consumption and user rates to improve the rate performance. Finally, the simulation results show that the proposed scheme outperforms the benchmark schemes and has the stable convergence in different settings, such as the learning rate, the error probability, the subcarrier spacing, and the number of users.

Anti-jamming Transmission in Softwarization UAV Network: a Federated Deep Reinforcement Learning Approach

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

UAV Communication Against Intelligent Jamming: A Stackelberg Game Approach With Federated Reinforcement Learning

Game Theory and Multi-Agent DRL Based Anti-Jamming Transmission for Integrated Air-Ground Network

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

A Learning Approach Towards Secure Cognitive Networks with UAV Relaying and Active Jamming

Covert UAV Data Transmission Via Semantic Communication: A DRL-Driven Joint Position and Power Optimization Method

Downlink Transmit Power Control in Ultra-Dense UAV Network Based on Mean Field Game and Deep Reinforcement Learning

Cooperative Secure Communication in UAV Assisted Networks with Dynamic Role Switching.

Deep Reinforcement Learning-Driven Jamming-Enhanced Secure Unmanned Aerial Vehicle Communications

Multi-objective Deep Reinforcement Learning Based Joint Beamforming and Power Allocation in UAV Assisted Cellular Communication

Dynamic Role Switching Scheme with Joint Trajectory and Power Control for Multi-UAV Cooperative Secure Communication

Distributed reinforcement learning based framework for energy-efficient UAV relay against jamming

A deep reinforcement learning framework and its implementation for UAV-aided covert communication

Lightweight Reinforcement Learning with State Abstraction for Dynamic Spectrum Anti-Jamming Communications

Blocklength Allocation and Power Control in UAV-Assisted URLLC System via Multi-agent Deep Reinforcement Learning

UAV Anti-Jamming Video Transmissions with QoE Guarantee: A Reinforcement Learning-Based Approach.

Energy Efficient Relay in UAV Networks Against Jamming: A Reinforcement Learning Based Approach.

Multi-Agent Deep Reinforcement Learning for Secure UAV Communications

UAV-Enabled Secure Communications by Multi-Agent Deep Reinforcement Learning

UAV Networks Against Multiple Maneuvering Smart Jamming with Knowledge-Based Reinforcement Learning.