Abstract:The emerging future generation 5G technology is expected to support service-oriented virtualized networks where different network applications provide unique services. 5G networks have the potential to allow completely different slices to co-exist in a substrate network and satisfy the differentiated requirements of various users. In networks with heterogeneous traffics, operators are required to provide services in isolation since each operator has its own defined performance requirements. However, achieving an efficient resource provisioning mechanism for such traffics is very challenging. This paper proposes a coarse resource provisioning scheme and a dynamic resource slicing refinement scheme based on dueling deep reinforcement learning for virtualized radio access network. Firstly, coarse resource provisioning scheme provisions and allocates radio resource to slices based on preferences and weights at different base stations. Secondly, reinforcement learning based slicing refinement adjusts the resource allocated to slices autonomously in order to balance satisfaction and resource utilization. The proposed dueling DQN algorithm unifies two objectives (QoS satisfaction and resource utilization) by weights to indicate the importance of each factor in the reward function. After the dueling DQN algorithm has output actions to provision resource at slice level, BS-level resource update is performed. Also, a common learning agent is used to control the activities of all the slices in the network. Then, a shape-based resource allocation algorithm is proposed to customize the diverse requirements of users to improve user satisfaction and resource utilization. Finally, a comprehensive performance evaluation is conducted against state-of-the-art solutions based on OFDMA air-interface design. The results reveal that the proposed algorithm balances satisfaction and resource utilization with 80% of the available resources. The algorithm also provides performance isolation such that, a sudden change in user population in one slice does not affect the others.

Customizable and Robust Internet of Robots Based on Network Slicing and Digital Twin

ROG: A High Performance and Robust Distributed Training System for Robotic IoT

Dynamic Network Slicing Orchestration for Remote Adaptation and Configuration in Industrial IoT

Intelligent Slicing of Radio Resource Control Layer for Cellular IoT: Design and Implementation

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing

Deep Reinforcement Learning Enables Joint Trajectory and Communication in Internet of Robotic Things

Adaptive Digital Twin and Communication-Efficient Federated Learning Network Slicing for 5G-enabled Internet of Things

Deep Reinforcement Learning-Based Resource Reservation Algorithm for Emergency Internet-of-things Slice

EdgeSlice: Slicing Wireless Edge Computing Network with Decentralized Deep Reinforcement Learning

RIS-Enabled Integrated Sensing, Computing, and Communication for Internet of Robotic Things

Deep Reinforcement Learning for Online Resource Allocation in IoT Networks: Technology, Development, and Future Challenges

Intelligent QoS aware slice resource allocation with user association parameterization for beyond 5G ORAN based architecture using DRL

Intelligent and Collaborative Orchestration of Network Slices

Resource Slicing and Customization in RAN with Dueling Deep Q-Network

Internet of Robotic Things: Current Technologies, Applications, Challenges and Future Directions

Automatic Network Slicing for IoT in Smart City

AI-assisted E2E Network Slicing for Integrated Sensing and Communication in 6G Networks

Adaptive Security Service Provisioning for Industrial IoT: Harnessing Deep Reinforcement Learning Within a Slice-Specific Framework

OnSlicing: Online End-to-End Network Slicing with Reinforcement Learning

Ultra-Dense LEO Satellite Access Network Slicing: A Deep Reinforcement Learning Approach