Abstract:Network slicing allows mobile network operators to virtualize infrastructures and provide customized slices for supporting various use cases with heterogeneous requirements. Online deep reinforcement learning (DRL) has shown promising potential in solving network problems and eliminating the simulation-to-reality discrepancy. Optimizing cross-domain resources with online DRL is, however, challenging, as the random exploration of DRL violates the service level agreement (SLA) of slices and resource constraints of infrastructures. In this paper, we propose OnSlicing, an online end-to-end network slicing system, to achieve minimal resource usage while satisfying slices' SLA. OnSlicing allows individualized learning for each slice and maintains its SLA by using a novel constraint-aware policy update method and proactive baseline switching mechanism. OnSlicing complies with resource constraints of infrastructures by using a unique design of action modification in slices and parameter coordination in infrastructures. OnSlicing further mitigates the poor performance of online learning during the early learning stage by offline imitating a rule-based solution. Besides, we design four new domain managers to enable dynamic resource configuration in radio access, transport, core, and edge networks, respectively, at a timescale of subseconds. We implement OnSlicing on an end-to-end slicing testbed designed based on OpenAirInterface with both 4G LTE and 5G NR, OpenDayLight SDN platform, and OpenAir-CN core network. The experimental results show that OnSlicing achieves 61.3% usage reduction as compared to the rule-based solution and maintains nearly zero violation (0.06%) throughout the online learning phase. As online learning is converged, OnSlicing reduces 12.5% usage without any violations as compared to the state-of-the-art online DRL solution.

Deep Reinforcement Learning-based Optimization for End-to-end Network Slicing with Control- and User-Plane Separation

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Reinforcement Learning-Based Network Slicing Scheme for Optimized UE-QoS in Future Networks

Ultra-Dense LEO Satellite Access Network Slicing: A Deep Reinforcement Learning Approach

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

An end-to-end network slicing framework for 5G wireless communication systems

Service-Aware Resource Allocation Based on RAN Slicing for Smart Grid.

Fast and Scalable Network Slicing by Integrating Deep Learning with Lagrangian Methods

Multi-objective Optimization of Space-Air-Ground Integrated Network Slicing Relying on a Pair of Central and Distributed Learning Algorithms

Slicing Resource Allocation Based on Dueling DQN for eMBB and URLLC Hybrid Services in Heterogeneous Integrated Networks

OnSlicing: Online End-to-End Network Slicing with Reinforcement Learning

Dynamic SDN-based Radio Access Network Slicing with Deep Reinforcement Learning for URLLC and eMBB Services

Deep Reinforcement Learning for End-to-End Network Slicing: Challenges and Solutions

Deep Reinforcement Learning for Network Slicing with Heterogeneous Resource Requirements and Time Varying Traffic Dynamics

A Service-Oriented Deployment Policy of End-to-End Network Slicing Based on Complex Network Theory

Data-Driven Adaptive Network Slicing for Multi-Tenant Networks

Autonomous Resource Slicing for Virtualized Vehicular Networks With D2D Communications Based on Deep Reinforcement Learning

An intelligent self-sustained RAN slicing framework for diverse service provisioning in 5G-beyond and 6G networks

A Deep Contextual Bandit-Based End-to-End Slice Provisioning Approach for Efficient Allocation of 5G Network Resources

Safe and Fast Reinforcement Learning for Network Slicing Resource Allocation

Intelligent Joint Network Slicing and Routing via GCN-powered Multi-Task Deep Reinforcement Learning