Abstract:The emerging future generation 5G technology is expected to support service-oriented virtualized networks where different network applications provide unique services. 5G networks have the potential to allow completely different slices to co-exist in a substrate network and satisfy the differentiated requirements of various users. In networks with heterogeneous traffics, operators are required to provide services in isolation since each operator has its own defined performance requirements. However, achieving an efficient resource provisioning mechanism for such traffics is very challenging. This paper proposes a coarse resource provisioning scheme and a dynamic resource slicing refinement scheme based on dueling deep reinforcement learning for virtualized radio access network. Firstly, coarse resource provisioning scheme provisions and allocates radio resource to slices based on preferences and weights at different base stations. Secondly, reinforcement learning based slicing refinement adjusts the resource allocated to slices autonomously in order to balance satisfaction and resource utilization. The proposed dueling DQN algorithm unifies two objectives (QoS satisfaction and resource utilization) by weights to indicate the importance of each factor in the reward function. After the dueling DQN algorithm has output actions to provision resource at slice level, BS-level resource update is performed. Also, a common learning agent is used to control the activities of all the slices in the network. Then, a shape-based resource allocation algorithm is proposed to customize the diverse requirements of users to improve user satisfaction and resource utilization. Finally, a comprehensive performance evaluation is conducted against state-of-the-art solutions based on OFDMA air-interface design. The results reveal that the proposed algorithm balances satisfaction and resource utilization with 80% of the available resources. The algorithm also provides performance isolation such that, a sudden change in user population in one slice does not affect the others.

End-to-end CNN-based dueling deep Q-Network for autonomous cell activation in Cloud-RANs

Autonomous Cell Activation for Energy Saving in Cloud-Rans Based on Dueling Deep Q-network

Relational Reinforcement Learning Based Autonomous Cell Activation in Cloud-RANs

A Reinforcement Learning Framework for Autonomous Cell Activation and Customized Energy-Efficient Resource Allocation in C-RANs.

Multicell Power Control under QoS Requirements with CNet

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

Resource Slicing and Customization in RAN with Dueling Deep Q-Network

Static Deep Q-learning for Green Downlink C-RAN

Dynamic user-centric multi-dimensional resource allocation for a wide-area coverage signaling cell based on DQN

A Dynamic Power Allocation Scheme Based on Multi-Agent Deep Q-Network with Environmental Awareness for 5G Dense Cellular Networks

A Deep Reinforcement Learning-Based Power Control Scheme for the 5G Wireless Systems

Slicing Resource Allocation Based on Dueling DQN for eMBB and URLLC Hybrid Services in Heterogeneous Integrated Networks

Revised reinforcement learning based on anchor graph hashing for autonomous cell activation in cloud-RANs

Deep Q-Network Based Resource Allocation for UAV-assisted Ultra-Dense Networks

ENCG-DRL for Multicast Service Oriented Energy-Efficient DU-CU Deployment and RMSA in EON-enabled RAN

Joint Resource Allocation and Power Control for D2D Communication with Deep Reinforcement Learning in MCC

Transfer Learning for Autonomous Cell Activation Based on Relational Reinforcement Learning With Adaptive Reward

Deep Reinforcement Learning for User Association and Resource Allocation in Heterogeneous Cellular Networks

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

A Self-Organizing Resource Allocation Strategy Based on Q-learning Approach in Ultra-Dense Networks