Abstract:Integration of unmanned aerial vehicles (UAVs) with ultra-reliable and low-latency communication (URLLC) systems can improve the real-time communication performance for various industrial internet of things (IIoT) applications. Designing an intelligent resource allocation system is one of the challenges posed by an energy-constrained UAV communication system. Therefore, we formulate a sum rate maximization problem, subject to the UAVs' energy by optimizing the blocklength allocation and the power control jointly in the uplink UAV-assisted URLLC systems, in which the probabilistic channel model between UAV and users is adopted. The problem is difficult to solve due to the non-convex objective function and the energy constraints, and also challenging to make fast decision in the complex communication environment. Thus, we propose a deep reinforcement learning (DRL)-based scheme to optimize the blocklength allocation and power control jointly. First, transform the original problem into the multi-agent reinforcement learning process, where each subcarrier is regarded as the agent that optimizes its individual blocklength allocation and power control. Then, each agent makes the intelligent decision to obtain the maximum reward value depending on the weighted segmented reward function, which is related to the UAV energy consumption and user rates to improve the rate performance. Finally, the simulation results show that the proposed scheme outperforms the benchmark schemes and has the stable convergence in different settings, such as the learning rate, the error probability, the subcarrier spacing, and the number of users.

Power and Rate Adaptation for URLLC With Statistical Channel Knowledge and HARQ

Power Adaptation in URLLC over Parallel Fading Channels in the Finite Blocklength Regime

Adaptive Modulation and Coding for URLLC Retransmission

Power-Efficient Uplink Resource Allocation For Ultra-Reliable And Low-Latency Communication

Joint Optimization with Power and Rate Control in HARQ System

Power Consumption-Oriented Resource Allocation Strategy For Ultra-Reliable Low-Latency Communication

Graph Convolutional Network Enabled Power-Constrained HARQ Strategy for URLLC

Joint Uplink and Downlink Resource Allocation Towards Energy-efficient Transmission for URLLC

Retransmission Aware Adaptive Modulation and Coding Towards Deterministic Delay Performance

Deep Reinforcement Learning Empowered Rate Selection of XP-HARQ

Minimizing the Queue-Length-Bound Violation Probability for URLLC: A Cross Layer Approach

Joint Power Optimization and Subcarrier Allocation for URLLC in Cell-Free Massive MIMO System

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

Power Allocation for FDMA-URLLC Downlink with Random Channel Assignment.

Blocklength Allocation and Power Control in UAV-Assisted URLLC System via Multi-agent Deep Reinforcement Learning

On the Uplink Transmission Performance of URLLC with Interference Channel

Learning-Based Rich Feedback HARQ for Energy-Efficient Short Packet Transmission

Ultra-Reliable and Low-Latency Wireless Communications in the High SNR Regime: A Cross-Layer Tradeoff

Cooperative Deep Reinforcement Learning Enabled Power Allocation for Packet Duplication URLLC in Multi-Connectivity Vehicular Networks

Transmission Performance Optimization for URLLC with Limited Training and Feedback Overheads

HARQ-IR Aided Short Packet Communications: BLER Analysis and Throughput Maximization