Abstract:The emerging future generation 5G technology is expected to support service-oriented virtualized networks where different network applications provide unique services. 5G networks have the potential to allow completely different slices to co-exist in a substrate network and satisfy the differentiated requirements of various users. In networks with heterogeneous traffics, operators are required to provide services in isolation since each operator has its own defined performance requirements. However, achieving an efficient resource provisioning mechanism for such traffics is very challenging. This paper proposes a coarse resource provisioning scheme and a dynamic resource slicing refinement scheme based on dueling deep reinforcement learning for virtualized radio access network. Firstly, coarse resource provisioning scheme provisions and allocates radio resource to slices based on preferences and weights at different base stations. Secondly, reinforcement learning based slicing refinement adjusts the resource allocated to slices autonomously in order to balance satisfaction and resource utilization. The proposed dueling DQN algorithm unifies two objectives (QoS satisfaction and resource utilization) by weights to indicate the importance of each factor in the reward function. After the dueling DQN algorithm has output actions to provision resource at slice level, BS-level resource update is performed. Also, a common learning agent is used to control the activities of all the slices in the network. Then, a shape-based resource allocation algorithm is proposed to customize the diverse requirements of users to improve user satisfaction and resource utilization. Finally, a comprehensive performance evaluation is conducted against state-of-the-art solutions based on OFDMA air-interface design. The results reveal that the proposed algorithm balances satisfaction and resource utilization with 80% of the available resources. The algorithm also provides performance isolation such that, a sudden change in user population in one slice does not affect the others.

Deep reinforcement learning‐aided RAN slicing enforcement supporting latency sensitive services in B5G networks

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

EdgeSlice: Slicing Wireless Edge Computing Network with Decentralized Deep Reinforcement Learning

Dynamic SDN-based Radio Access Network Slicing with Deep Reinforcement Learning for URLLC and eMBB Services

Real-Time Resource Slicing for 5G RAN Via Deep Reinforcement Learning

Deep Reinforcement Learning for Network Slicing with Heterogeneous Resource Requirements and Time Varying Traffic Dynamics

Zero-touch Continuous Network Slicing Control via Scalable Actor-Critic Learning

Deep Reinforcement Learning for Adaptive Network Slicing in 5G for Intelligent Vehicular Systems and Smart Cities

Communication and Computation O-RAN Resource Slicing for URLLC Services Using Deep Reinforcement Learning

RAN Slice Strategy Based on Deep Reinforcement Learning for Smart Grid

A Reinforcement Learning Based Approach for 5G Network Slicing Across Multiple Domains.

Learning from Peers: Deep Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G RAN Slicing

Resource Slicing and Customization in RAN with Dueling Deep Q-Network

Deep Reinforcement Learning for Resource Management on Network Slicing: A Survey

Intelligent QoS aware slice resource allocation with user association parameterization for beyond 5G ORAN based architecture using DRL

Deep Reinforcement Learning for End-to-End Network Slicing: Challenges and Solutions

Safe and Fast Reinforcement Learning for Network Slicing Resource Allocation

Dynamic Reservation and Deep Reinforcement Learning Based Autonomous Resource Slicing for Virtualized Radio Access Networks.

Customized Slicing for 6G: Enforcing Artificial Intelligence on Resource Management

Continuous Multi-objective Zero-touch Network Slicing via Twin Delayed DDPG and OpenAI Gym