Abstract:The emerging future generation 5G technology is expected to support service-oriented virtualized networks where different network applications provide unique services. 5G networks have the potential to allow completely different slices to co-exist in a substrate network and satisfy the differentiated requirements of various users. In networks with heterogeneous traffics, operators are required to provide services in isolation since each operator has its own defined performance requirements. However, achieving an efficient resource provisioning mechanism for such traffics is very challenging. This paper proposes a coarse resource provisioning scheme and a dynamic resource slicing refinement scheme based on dueling deep reinforcement learning for virtualized radio access network. Firstly, coarse resource provisioning scheme provisions and allocates radio resource to slices based on preferences and weights at different base stations. Secondly, reinforcement learning based slicing refinement adjusts the resource allocated to slices autonomously in order to balance satisfaction and resource utilization. The proposed dueling DQN algorithm unifies two objectives (QoS satisfaction and resource utilization) by weights to indicate the importance of each factor in the reward function. After the dueling DQN algorithm has output actions to provision resource at slice level, BS-level resource update is performed. Also, a common learning agent is used to control the activities of all the slices in the network. Then, a shape-based resource allocation algorithm is proposed to customize the diverse requirements of users to improve user satisfaction and resource utilization. Finally, a comprehensive performance evaluation is conducted against state-of-the-art solutions based on OFDMA air-interface design. The results reveal that the proposed algorithm balances satisfaction and resource utilization with 80% of the available resources. The algorithm also provides performance isolation such that, a sudden change in user population in one slice does not affect the others.

Knowledge Transfer Based Radio and Computation Resource Allocation for 5G RAN Slicing

Learning from Peers: Deep Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G RAN Slicing

Knowledge Transfer and Reuse: A Case Study of AI-enabled Resource Management in RAN Slicing

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

RAN Resource Slicing in 5G Using Multi-Agent Correlated Q-Learning

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

Toward an Efficient and Dynamic Allocation of Radio Access Network Slicing Resources for 5G Era

Autonomous Resource Provisioning and Resource Customization for Mixed Traffics in Virtualized Radio Access Network

Dynamic Resource Allocation for Network Slicing with Multi-Tenants in 5G Two-Tier Networks

Real-Time Resource Slicing for 5G RAN Via Deep Reinforcement Learning

Resource Slicing and Customization in RAN with Dueling Deep Q-Network

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Joint Q-Learning Based Resource Allocation and Multi-Numerology B5G Network Slicing Exploiting LWA Technology

Q-Learning Based Joint Allocation of Fronthaul and Radio Resources in Multiwavelength-Enabled C-RAN

Mobility aware and energy-efficient federated deep reinforcement learning assisted resource allocation for 5G-RAN slicing

Radio Resource Management for Intelligent Neutral Host (INH) in Multi-Operator Environments

SNAF: DRL-Based Interdependent E2E Resource Slicing Scheme for a Virtualized Network

Multi-Dimensional Resource Allocation Algorithm for End-to-End Network Slicing

Intelligent QoS aware slice resource allocation with user association parameterization for beyond 5G ORAN based architecture using DRL

Intelligent Resource Scheduling for 5G Radio Access Network Slicing

Reinforcement Learning for Dynamic Resource Optimization in 5G Radio Access Network Slicing