Abstract:The emerging future generation 5G technology is expected to support service-oriented virtualized networks where different network applications provide unique services. 5G networks have the potential to allow completely different slices to co-exist in a substrate network and satisfy the differentiated requirements of various users. In networks with heterogeneous traffics, operators are required to provide services in isolation since each operator has its own defined performance requirements. However, achieving an efficient resource provisioning mechanism for such traffics is very challenging. This paper proposes a coarse resource provisioning scheme and a dynamic resource slicing refinement scheme based on dueling deep reinforcement learning for virtualized radio access network. Firstly, coarse resource provisioning scheme provisions and allocates radio resource to slices based on preferences and weights at different base stations. Secondly, reinforcement learning based slicing refinement adjusts the resource allocated to slices autonomously in order to balance satisfaction and resource utilization. The proposed dueling DQN algorithm unifies two objectives (QoS satisfaction and resource utilization) by weights to indicate the importance of each factor in the reward function. After the dueling DQN algorithm has output actions to provision resource at slice level, BS-level resource update is performed. Also, a common learning agent is used to control the activities of all the slices in the network. Then, a shape-based resource allocation algorithm is proposed to customize the diverse requirements of users to improve user satisfaction and resource utilization. Finally, a comprehensive performance evaluation is conducted against state-of-the-art solutions based on OFDMA air-interface design. The results reveal that the proposed algorithm balances satisfaction and resource utilization with 80% of the available resources. The algorithm also provides performance isolation such that, a sudden change in user population in one slice does not affect the others.

Intelligent Joint Network Slicing and Routing via GCN-powered Multi-Task Deep Reinforcement Learning

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Intelligent Radio Access Network Slicing for Service Provisioning in 6G: A Hierarchical Deep Reinforcement Learning Approach

Continuous Multi-objective Zero-touch Network Slicing via Twin Delayed DDPG and OpenAI Gym

DeepSlicing: Deep Reinforcement Learning Assisted Resource Allocation for Network Slicing

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

Joint Routing and Scheduling Optimization in Time-Sensitive Networks Using Graph-Convolutional-Network-Based Deep Reinforcement Learning.

RAN Slice Strategy Based on Deep Reinforcement Learning for Smart Grid

A Constrained Reinforcement Learning Based Approach for Network Slicing.

Deep Reinforcement Learning for Resource Management in Network Slicing

Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing

Dynamic Network Slice Reconfiguration by Exploiting Deep Reinforcement Learning

Resource Slicing and Customization in RAN with Dueling Deep Q-Network

Digital Twin-Assisted Flexible Slice Admission Control for 5G Core Network: A Deep Reinforcement Learning Approach

GAN-based Deep Distributional Reinforcement Learning for Resource Management in Network Slicing

Zero-touch Continuous Network Slicing Control via Scalable Actor-Critic Learning

Deep Reinforcement Learning for End-to-End Network Slicing: Challenges and Solutions

Energy-Efficient Intra-Domain Network Slicing for Multi-Layer Orchestration in Intelligent-Driven Distributed 6G Networks: Learning Generic Assignment Skills with Unsupervised Reinforcement Learning

Network Slicing via Transfer Learning aided Distributed Deep Reinforcement Learning

Deep Reinforcement Learning for Resource Management on Network Slicing: A Survey

Constrained Reinforcement Learning for Resource Allocation in Network Slicing