Abstract:In this article, the joint scheduling problem of ultra‐reliable low latency communication (URLLC) and enhanced mobile broad band (eMBB) is formulated as an optimization problem with the goal of maximizing the data rate of eMBB users while satisfying the requirements of URLLC latency and eMBB data rate. A digital twin‐enabled deep reinforcement learning framework is proposed to solve the above problem. In the coexistence of ultra‐reliable low latency communication (URLLC) and enhanced mobile broad band (eMBB) in 5G networks, the arriving URLLC traffic with strict latency requirements will be scheduled by puncturing ongoing eMBB transmissions, negatively impacting eMBB data rate. In this article, we add reliability measurement for eMBB users with high data rate requirements. The scheduling problem is formulated as an optimization problem with the goal of maximizing the data rate of eMBB users while meeting the requirements of URLLC latency and eMBB data rate. To jointly optimize resource allocation policy and puncturing policy, an algorithm based on deep reinforcement learning (DRL) is introduced. Considering that the utilization of DRL in the resource scheduling problem is limited due to the nonstationary communication environment, a digital twin‐enabled DRL architecture is presented to fine‐tune the DRL model according to feedback from the real‐world network. The DRL agent can explore in the digital twin model, avoiding the loss of quality of service caused by exploration in the real‐world environment. According to simulation results, the approach proposed in this article can improve the reliability of eMBB users with data rate requirements.

Optimization of Energy Efficiency for Uplink Murllc over Multiple Cells Using Cooperative Multi-Agent Reinforcement Learning

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Tradeoff Between Network Energy Consumption and Terminal Energy Consumption Via Small Cell Power Control

Multi-Agent Reinforcement Learning Based Unlicensed Resource Sharing for LTE-U Networks.

Adaptive Modulation and Coding for URLLC Retransmission

Communication-Efficient Orchestrations for URLLC Service via Hierarchical Reinforcement Learning

Deep Reinforcement Learning for User Association and Resource Allocation in Heterogeneous Cellular Networks

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

Blocklength Allocation and Power Control in UAV-Assisted URLLC System via Multi-agent Deep Reinforcement Learning

Federated Learning for Distributed Energy-Efficient Resource Allocation

Efficient Communications for Multi-Agent Reinforcement Learning in Wireless Networks

Reinforcement Learning Based Multi-Access Control with Energy Harvesting

A Self-Organizing Resource Allocation Strategy Based on Q-learning Approach in Ultra-Dense Networks

Energy Efficiency Optimization for Subterranean LoRaWAN Using A Reinforcement Learning Approach: A Direct-to-Satellite Scenario

Multi-Agent Deep Reinforcement Learning for Computation Offloading and Interference Coordination in Small Cell Networks

Joint Cooperative Clustering and Power Control for Energy-Efficient Cell-Free XL-MIMO with Multi-Agent Reinforcement Learning

Novel Adaptive Transmission Scheme for Effective URLLC Support in 5G NR: A Model-Based Reinforcement Learning Solution.

Enhancing Energy-Efficient URLLC in Cell-Free mMIMO Systems With Transceiver Impairments: An RSMA-DRL Based Approach

Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

A Multi-agent Reinforcement Learning Based Power Control Algorithm for D2D Communication Underlaying Cellular Networks

Digital twin‐enabled deep reinforcement learning for joint scheduling of ultra‐reliable low latency communication and enhanced mobile broad band: A reliability‐guaranteed approach