Abstract:The emerging future generation 5G technology is expected to support service-oriented virtualized networks where different network applications provide unique services. 5G networks have the potential to allow completely different slices to co-exist in a substrate network and satisfy the differentiated requirements of various users. In networks with heterogeneous traffics, operators are required to provide services in isolation since each operator has its own defined performance requirements. However, achieving an efficient resource provisioning mechanism for such traffics is very challenging. This paper proposes a coarse resource provisioning scheme and a dynamic resource slicing refinement scheme based on dueling deep reinforcement learning for virtualized radio access network. Firstly, coarse resource provisioning scheme provisions and allocates radio resource to slices based on preferences and weights at different base stations. Secondly, reinforcement learning based slicing refinement adjusts the resource allocated to slices autonomously in order to balance satisfaction and resource utilization. The proposed dueling DQN algorithm unifies two objectives (QoS satisfaction and resource utilization) by weights to indicate the importance of each factor in the reward function. After the dueling DQN algorithm has output actions to provision resource at slice level, BS-level resource update is performed. Also, a common learning agent is used to control the activities of all the slices in the network. Then, a shape-based resource allocation algorithm is proposed to customize the diverse requirements of users to improve user satisfaction and resource utilization. Finally, a comprehensive performance evaluation is conducted against state-of-the-art solutions based on OFDMA air-interface design. The results reveal that the proposed algorithm balances satisfaction and resource utilization with 80% of the available resources. The algorithm also provides performance isolation such that, a sudden change in user population in one slice does not affect the others.

Network Slicing with Centralized and Distributed Reinforcement Learning for Combined Satellite/Ground Networks in a 6G Environment

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Ultra-Dense LEO Satellite Access Network Slicing: A Deep Reinforcement Learning Approach

Multi-objective Optimization of Space-Air-Ground Integrated Network Slicing Relying on a Pair of Central and Distributed Learning Algorithms

Energy-Efficient Intra-Domain Network Slicing for Multi-Layer Orchestration in Intelligent-Driven Distributed 6G Networks: Learning Generic Assignment Skills with Unsupervised Reinforcement Learning

Intelligent Joint Network Slicing and Routing via GCN-powered Multi-Task Deep Reinforcement Learning

Optimizing network slicing in 6G networks through a hybrid deep learning strategy

An SDN Based Testbed for Dynamic Network Slicing in Satellite-Terrestrial Networks

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

DRL‐based customised resource allocation for sub‐slices in 6G network slicing

Space Edge Cloud Enabling Network Slicing For 5g Satellite Network

EdgeSlice: Slicing Wireless Edge Computing Network with Decentralized Deep Reinforcement Learning

Resource Slicing and Customization in RAN with Dueling Deep Q-Network

Customized Slicing for 6G: Enforcing Artificial Intelligence on Resource Management

A Reinforcement Learning Based Approach for 5G Network Slicing Across Multiple Domains.

Fast and Scalable Network Slicing by Integrating Deep Learning with Lagrangian Methods

Artificial Intelligence-Assisted Network Slicing: Network Assurance and Service Provisioning in 6G

AI-assisted E2E Network Slicing for Integrated Sensing and Communication in 6G Networks

Distributed Deep Reinforcement Learning Assisted Resource Allocation Algorithm for Space-Air-Ground Integrated Networks

An intelligent self-sustained RAN slicing framework for diverse service provisioning in 5G-beyond and 6G networks

Efficient resource allocation through CNN-game theory based network slicing recognition for next-generation networks