Abstract:Network function virtualization (NFV) is critical to the scalability and flexibility of various network services in the form of service function chains (SFCs), which refer to a set of Virtual Network Functions (VNFs) chained in a specific order. However, the NFV performance is hard to fulfill the ever-increasing requirements of network services mainly due to the static orchestrations of SFCs. To tackle this issue, a novel Scalable SFC Orchestration (SSCO) scheme is proposed in this paper for NFV-enabled networks via federated reinforcement learning. SSCO has three remarkable characteristics distinguishing from the previous work: (1) A federated-learning-based framework is designed to train a global learning model, with time-variant local model explorations, for scalable SFC orchestration, while avoiding data sharing among stakeholders; (2) SSCO allows for parameter update among local clients and the cloud server just at the first and last epochs of each episode to ensure that distributed clients can make model optimization at a low communication cost; (3) SSCO introduces an efficient deep reinforcement learning (DRL) approach, with the local learning knowledge of available resources and instantiation cost, to map VNFs into networks flexibly. Furthermore, a loss-weight-based mechanism is proposed to generate and exploit reference samples in replay buffers for future training, avoiding the strong relevance of samples. Simulation results obtained from different working scenarios demonstrate that SSCO can significantly reduce placement errors and improve resource utilization ratio to place time-variant VNFs compared with the state-of-the-art mechanisms. Furthermore, the results show that the proposed approach can achieve desirable scalability.

CVTSA: Cooperative VNF and Time-Slot Scheduling Algorithm for NFV Orchestration

Scheduling Reconfigurable Service Function Chain

Efficient Service Reconfiguration with Partial Virtual Network Function Migration

A Clustered VNF Chaining Scheme with Delay Guarantees in NFV-Based VANETs

On Dynamic Mapping and Scheduling of Service Function Chains in SDN/NFV-Enabled Networks

Service Function Chain Placement for Joint Cost and Latency Optimization.

Online VNF Chaining and Predictive Scheduling: Optimality and Trade-offs

Low-Latency and Resource-Efficient Service Function Chaining Orchestration in Network Function Virtualization.

Seamless Scheduling for NFV-Enabled 5G-TSN Network: A Full-Path AoI Based Method

A Four-Stage Adaptive Scheduling Scheme for Service Function Chain in NFV.

Orchestrating Service Function Chains with Joint Resource Optimization in NFV Networks.

Joint Dynamical VNF Placement and SFC Routing in NFV-Enabled SDNs.

Online Scheduling in Virtualized TSN Networks Via Joint Admission Control and VNF Embedding

Virtual Network Function Placement Considering Resource Optimization and SFC Requests in Cloud Datacenter

Virtual network function placement and resource optimization in NFV and edge computing enabled networks.

A Dynamic Placement Mechanism of Service Function Chaining Based on Software-defined Networking.

On Application-Aware and On-Demand Service Composition in Heterogenous NFV Environments.

An Approach for Service Function Chain Reconfiguration in Network Function Virtualization Architectures.

AI-based software-defined virtual network function scheduling with delay optimization

An online service function chain orchestration method for profit maximization in edge computing networks

Scalable Orchestration of Service Function Chains in NFV-Enabled Networks: A Federated Reinforcement Learning Approach