Abstract:Network function virtualization (NFV) makes the realization of specific network functions no longer depend on inherent hardware by executing virtual network functions (VNFs), but realizes network functions in a more flexible programming manner, thereby reducing the pressure of resource allocation on the underlying network. Service function chain (SFC) is composed of a set of fixed order VNFs. These VNFs need to be deployed on appropriate physical nodes to meet user function requirements, i.e., the placement of SFC. Traditional solutions mostly use mathematical models or heuristic methods, which are not applicable in the context of large-scale networks. Secondly, the existing methods do not integrate intelligent learning algorithms into the service function chain placement (SFCP) problem, which limits the possibility of obtaining better solutions. This paper presents a multi-objective optimization service function chain placement (MOO-SFCP) algorithm based on reinforcement learning (RL). The goal of the algorithm is to optimize the resource allocation mode, including several performance indexes such as underlying resource consumption revenue, revenue cost ratio, VNF acceptance rate and network latency. We model the SFCP as a Markov decision process (MDP), and use a two-layer policy network as an intelligent agent. In the training stage of RL, the agent comprehensively considers the optimization objectives and formulates the optimal physical node mapping strategy for VNF requests. In the test phase, the whole SFCP is completed according to the trained node mapping strategy. Simulation results show that the algorithm proposed in this paper has excellent performance in the aspects of underlying resource allocation revenue, VNF acceptance rate and so on. In addition, we prove that the algorithm has good flexibility by changing the delay constraint.

UAV Dynamic Service Function Chains Deployment Based on Security Considerations: A Reinforcement Learning Method

Scheduling Reconfigurable Service Function Chain

DRL-SFCP: Adaptive Service Function Chains Placement with Deep Reinforcement Learning

A Q-Learning-Based Approach For Deploying Dynamic Service Function Chains

Dynamic Service Function Chain Deployment and Readjustment Method Based on Deep Reinforcement Learning

DRL-D: Revenue-Aware Online Service Function Chain Deployment Via Deep Reinforcement Learning

Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning

Policy Network Assisted Monte Carlo Tree Search for Intelligent Service Function Chain Deployment

A Deep Reinforcement Learning-Based Approach for Adaptive SFC Deployment in Multi-Domain Networks

A Parallel Placement Approach for Service Function Chain Using Deep Reinforcement Learning

Service Function Chain Embedding Meets Machine Learning: Deep Reinforcement Learning Approach

An Autonomous Deployment Mechanism for AI Security Services

Security SFC Path Selection Using Deep Reinforcement Learning.

A Deep Reinforcement Learning-Based Algorithm for Reliability-Aware Multi-Domain Service Deployment in Smart Ecosystems

Flying Ad-Hoc Network Covert Communications with Deep Reinforcement Learning

Automatic Selection of Security Service Function Chaining Using Reinforcement Learning

Dynamic SFC Embedding Algorithm Assisted by Federated Learning in Space–Air–Ground-Integrated Network Resource Allocation Scenario

Research on Service Function Chain Embedding and Migration Algorithm for UAV IoT

Service Function Chain Deployment Using Deep Q Learning and Tidal Mechanism

GCN-TD - A Learning-based Approach for Service Function Chain Deployment on the Fly.

Multi-objective Optimization Service Function Chain Placement Algorithm Based on Reinforcement Learning