Abstract:Network slicing enables operators to efficiently support diverse applications on a common physical infrastructure. The ever-increasing densification of network deployment leads to complex and non-trivial inter-cell interference, which requires more than inaccurate analytic models to dynamically optimize resource management for network slices. In this paper, we develop a DIRP algorithm with multiple deep reinforcement learning (DRL) agents to cooperatively optimize resource partition in individual cells to fulfill the requirements of each slice, based on two alternative reward functions. Nevertheless, existing DRL approaches usually tie the pretrained model parameters to specific network environments with poor transferability, which raises practical deployment concerns in large-scale mobile networks. Hence, we design a novel transfer learning-aided DIRP (TL-DIRP) algorithm to ease the transfer of DIRP agents across different network environments in terms of sample efficiency, model reproducibility, and algorithm scalability. The TL-DIRP algorithm first centrally trains a generalized model and then transfers the "generalist" to each local agent as "specialist" with distributed finetuning and execution. TL-DIRP consists of two steps: 1) centralized training of a generalized distributed model, 2) transferring the "generalist" to each "specialist" with distributed finetuning and execution. The numerical results show that not only DIRP outperforms existing baseline approaches in terms of faster convergence and higher reward, but more importantly, TL-DIRP significantly improves the service performance, with reduced exploration cost, accelerated convergence rate, and enhanced model reproducibility. As compared to a traffic-aware baseline, TL-DIRP provides about 15% less violation ratio of the quality of service (QoS) for the worst slice service and 8.8% less violation on the average service QoS.

Multi-SP Network Slicing Parallel Relieving Edge Network Conflict

Adaptive Resource Management for Edge Network Slicing using Incremental Multi-Agent Deep Reinforcement Learning

DeepSlicing: Deep Reinforcement Learning Assisted Resource Allocation for Network Slicing

Multi-Tenant Cross-Slice Resource Orchestration: A Deep Reinforcement Learning Approach

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

A Constrained Reinforcement Learning Based Approach for Network Slicing.

Network Slicing via Transfer Learning aided Distributed Deep Reinforcement Learning

EdgeSlice: Slicing Wireless Edge Computing Network with Decentralized Deep Reinforcement Learning

MADDPG-empowered slice reconfiguration approach for 5G multi-tier system

Age of Information-Aware Multi-tenant Resource Orchestration in Network Slicing.

Resource Allocation Method for Network Slicing Using Constrained Reinforcement Learning

MAARS: Multiagent Actor–Critic Approach for Resource Allocation and Network Slicing in Multiaccess Edge Computing

Resource Allocation for Network Slicing in Dynamic Multi-Tenant Networks: A Deep Reinforcement Learning Approach

Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing

Multi-objective Optimization of Space-Air-Ground Integrated Network Slicing Relying on a Pair of Central and Distributed Learning Algorithms

Intelligent Joint Network Slicing and Routing via GCN-powered Multi-Task Deep Reinforcement Learning

Constrained Reinforcement Learning for Resource Allocation in Network Slicing

Inter-Cell Network Slicing With Transfer Learning Empowered Multi-Agent Deep Reinforcement Learning

Dynamic Network Slice Reconfiguration by Exploiting Deep Reinforcement Learning

Joint Resource Optimization, Computation Offloading and Resource Slicing for Multi-Edge Traffic-Cognitive Networks

Graph Attention Network-Based Multi-Agent Reinforcement Learning for Slicing Resource Management in Dense Cellular Network