Abstract:Network slicing-based communication systems can dynamically and efficiently allocate resources for diversified services. However, due to the limitation of the network interface on channel access and the complexity of the resource allocation, it is challenging to achieve an acceptable solution in the practical system without precise prior knowledge of the dynamics probability model of the service requests. Existing work attempts to solve this problem using deep reinforcement learning (DRL), however, such methods usually require a lot of interaction with the real environment in order to achieve good results. In this paper, a framework consisting of a digital twin and reinforcement learning agents is present to handle the issue. Specifically, we propose to use the historical data and the neural networks to build a digital twin model to simulate the state variation law of the real environment. Then, we use the data generated by the network slicing environment to calibrate the digital twin so that it is in sync with the real environment. Finally, DRL for slice optimization optimizes its own performance in this virtual pre-verification environment. We conducted an exhaustive verification of the proposed digital twin framework to confirm its scalability. Specifically, we propose to use loss landscapes to visualize the generalization of DRL solutions. We explore a distillation-based optimization scheme for lightweight slicing strategies. In addition, we also extend the framework to offline reinforcement learning, where solutions can be used to obtain intelligent decisions based solely on historical data. Numerical simulation experiments show that the proposed digital twin can significantly improve the performance of the slice optimization strategy.

Deep Reinforcement Learning-Based Resource Reservation Algorithm for Emergency Internet-of-things Slice

RAN Slice Strategy Based on Deep Reinforcement Learning for Smart Grid

Deep Reinforcement Learning for Resource Management in Network Slicing

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

Real-Time Resource Slicing for 5G RAN Via Deep Reinforcement Learning

Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing

Ultra-Dense LEO Satellite Access Network Slicing: A Deep Reinforcement Learning Approach

Constrained Reinforcement Learning for Resource Allocation in Network Slicing

Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

Deep Reinforcement Learning for Online Resource Allocation in IoT Networks: Technology, Development, and Future Challenges

DRL‐based customised resource allocation for sub‐slices in 6G network slicing

Intelligent Resource Slicing for eMBB and URLLC Coexistence in 5G and Beyond: A Deep Reinforcement Learning Based Approach

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Deep Reinforcement Learning for Resource Management on Network Slicing: A Survey

Deep Reinforcement Learning Based Resource Allocation Approach for Wireless Networks Considering Network Slicing Paradigm

Towards efficient RAN slicing: A deep hierarchical reinforcement learning approach

Intelligent Resource Scheduling for 5G Radio Access Network Slicing

Dynamic RAN Slicing for Service-Oriented Vehicular Networks via Constrained Learning

Intelligent QoS aware slice resource allocation with user association parameterization for beyond 5G ORAN based architecture using DRL

Autonomous Resource Slicing for Virtualized Vehicular Networks With D2D Communications Based on Deep Reinforcement Learning

A Heuristically Assisted Deep Reinforcement Learning Approach for Network Slice Placement