Abstract:Network function virtualization (NFV) makes the realization of specific network functions no longer depend on inherent hardware by executing virtual network functions (VNFs), but realizes network functions in a more flexible programming manner, thereby reducing the pressure of resource allocation on the underlying network. Service function chain (SFC) is composed of a set of fixed order VNFs. These VNFs need to be deployed on appropriate physical nodes to meet user function requirements, i.e., the placement of SFC. Traditional solutions mostly use mathematical models or heuristic methods, which are not applicable in the context of large-scale networks. Secondly, the existing methods do not integrate intelligent learning algorithms into the service function chain placement (SFCP) problem, which limits the possibility of obtaining better solutions. This paper presents a multi-objective optimization service function chain placement (MOO-SFCP) algorithm based on reinforcement learning (RL). The goal of the algorithm is to optimize the resource allocation mode, including several performance indexes such as underlying resource consumption revenue, revenue cost ratio, VNF acceptance rate and network latency. We model the SFCP as a Markov decision process (MDP), and use a two-layer policy network as an intelligent agent. In the training stage of RL, the agent comprehensively considers the optimization objectives and formulates the optimal physical node mapping strategy for VNF requests. In the test phase, the whole SFCP is completed according to the trained node mapping strategy. Simulation results show that the algorithm proposed in this paper has excellent performance in the aspects of underlying resource allocation revenue, VNF acceptance rate and so on. In addition, we prove that the algorithm has good flexibility by changing the delay constraint.

A Dynamic Placement Mechanism of Service Function Chaining Based on Software-defined Networking.

Scheduling Reconfigurable Service Function Chain

Service Function Chain Placement for Joint Cost and Latency Optimization.

On Dynamic Mapping and Scheduling of Service Function Chains in SDN/NFV-Enabled Networks

Low-Latency and Resource-Efficient Service Function Chaining Orchestration in Network Function Virtualization.

Efficiently Embedding Service Function Chains with Dynamic Virtual Network Function Placement in Geo-Distributed Cloud System

On Dynamic Service Function Chain Deployment and Readjustment

Design and Evaluation of Schemes for Provisioning Service Function Chain with Function Scalability.

Dynamic Heuristic for the Recomposition of Service Function Chain

An Approach for Service Function Chain Reconfiguration in Network Function Virtualization Architectures.

Cost-aware Placement and Chaining of Service Function Chain with VNF Instance Sharing.

Research on Service Function Chain Orchestrating Algorithm Based on SDN and NFV

Adaptive Service Function Chaining Mappings in 5G Using Deep Q-learning

On the Effective Parallelization and Near-Optimal Deployment of Service Function Chains

Cost-Efficient Virtual Network Function Placement and Traffic Steering

To Deploy New or to Deploy More?: an Online SFC Deployment Scheme at Network Edge

Congestion-Aware Algorithms for Service Function Chaining in Software-Defined Wide Area Networks.

A Parallel Placement Approach for Service Function Chain Using Deep Reinforcement Learning

Dynamic Service Function Chaining Orchestration in a Multi-Domain: A Heuristic Approach Based on SRv6

Multi-objective Optimization Service Function Chain Placement Algorithm Based on Reinforcement Learning

DRL-SFCP: Adaptive Service Function Chains Placement with Deep Reinforcement Learning