Abstract:Network slicing enables operators to efficiently support diverse applications on a common physical infrastructure. The ever-increasing densification of network deployment leads to complex and non-trivial inter-cell interference, which requires more than inaccurate analytic models to dynamically optimize resource management for network slices. In this paper, we develop a DIRP algorithm with multiple deep reinforcement learning (DRL) agents to cooperatively optimize resource partition in individual cells to fulfill the requirements of each slice, based on two alternative reward functions. Nevertheless, existing DRL approaches usually tie the pretrained model parameters to specific network environments with poor transferability, which raises practical deployment concerns in large-scale mobile networks. Hence, we design a novel transfer learning-aided DIRP (TL-DIRP) algorithm to ease the transfer of DIRP agents across different network environments in terms of sample efficiency, model reproducibility, and algorithm scalability. The TL-DIRP algorithm first centrally trains a generalized model and then transfers the "generalist" to each local agent as "specialist" with distributed finetuning and execution. TL-DIRP consists of two steps: 1) centralized training of a generalized distributed model, 2) transferring the "generalist" to each "specialist" with distributed finetuning and execution. The numerical results show that not only DIRP outperforms existing baseline approaches in terms of faster convergence and higher reward, but more importantly, TL-DIRP significantly improves the service performance, with reduced exploration cost, accelerated convergence rate, and enhanced model reproducibility. As compared to a traffic-aware baseline, TL-DIRP provides about 15% less violation ratio of the quality of service (QoS) for the worst slice service and 8.8% less violation on the average service QoS.

An Actor-Critic-Based Transfer Learning Framework for Experience-Driven Networking.

TRCC: Transferable Congestion Control with Reinforcement Learning

Experience-driven Networking: A Deep Reinforcement Learning based Approach

Distributed and Adaptive Traffic Engineering with Deep Reinforcement Learning

Enabling efficient routing for traffic engineering in SDN with Deep Reinforcement Learning

A Multi-Task-Learning-Based Transfer Deep Reinforcement Learning Design for Autonomic Optical Networks

Enabling Robust DRL-Driven Networking Systems Via Teacher-Student Learning

Inter-Cell Network Slicing With Transfer Learning Empowered Multi-Agent Deep Reinforcement Learning

A Multi-agent Reinforcement Learning Perspective on Distributed Traffic Engineering

Network Slicing via Transfer Learning aided Distributed Deep Reinforcement Learning

Automated Traffic Engineering in SDWAN: Beyond Reinforcement Learning

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Traffic Engineering in Hybrid Software Defined Network Via Reinforcement Learning

Targeted Knowledge Transfer for Learning Traffic Signal Plans.

TraCo: Learning Virtual Traffic Coordinator for Cooperation with Multi-Agent Reinforcement Learning.

Leveraging Domain Knowledge for Robust Deep Reinforcement Learning in Networking

Leveraging Deep Reinforcement Learning for Traffic Engineering: A Survey

A Deep Reinforcement Learning Approach for Deploying SDN Switches in ISP Networks from the Perspective of Traffic Engineering

Sim-to-Real Optimization of Complex Real World Mobile Network with Imperfect Information via Deep Reinforcement Learning from Self-play

A Deep Reinforcement Learning Approach for Adaptive Traffic Routing in Next-gen Networks

Traffic Engineering in a Shared Inter-DC WAN Via Deep Reinforcement Learning