Abstract:Network functions virtualization (NFV) solves the problem of tight coupling between network functions and hardware. While the Service Function Chaining (SFC) is the basic business model and provides customized services for network functions in NFV. However, the existing network function deployment and migration mechanisms are relatively static and rigid. For example, problems such as network load imbalance, deployment nodes or virtual network function instances failing, and virtual function elastic scaling cannot be performed. Aiming at the above problems, this paper proposes the decision-making optimization algorithm for virtual network function migration based on deep reinforcement learning. The algorithm takes network and node resources as constraints, establishes a migration decision model including state space, behavior space, and reward mechanism, and realizes flexible adaptation of virtual network functions. In the algorithm, migration decision-making based on Deep Q Network (DQN) includes offline training and online decision-making. In the offline training stage, DQN is used to train the strategy network model. The online migration stage is based on the trained strategy network model, which uses the current network state as the model input to dynamically generate the migration strategy. Finally, the network performs the migration of virtual network functions online. This algorithm optimizes the node load and solves the problem of service interruption caused by the excessive load of a single node, failure of links, and virtual function instances in the network. Finally, we build a practical prototype system and demonstrate the performance of the proposed DQN approach. According to the network status, the prototype system realizes the on-demand dynamic migration of virtual network functions. And the experimental results verify that the proposed elastic adaptation mechanism can effectively solve the migration problems, improve the quality of service, and enhance the scalability and flexibility of the network.

A Deep Q-Learning Based VNF Migration Strategy for Elastic Control in SDN/NFV Network

Efficient Service Reconfiguration with Partial Virtual Network Function Migration

Scheduling Reconfigurable Service Function Chain

Online Fault-tolerant VNF Chain Placement: A Deep Reinforcement Learning Approach

Priority-awareness VNF migration method based on deep reinforcement learning

Deep Reinforcement Learning for Resource Demand Prediction and Virtual Function Network Migration in Digital Twin Network

DQN Approach for Adaptive Self-Healing of VNFs in Cloud-Native Network

Two-Phase Virtual Network Function Selection and Chaining Algorithm Based on Deep Learning in SDN/NFV-Enabled Networks

Fault Tolerance Oriented SFC Optimization in SDN/NFV-Enabled Cloud Environment Based on Deep Reinforcement Learning

Elastic Network Service Chain with Fine-Grained Vertical Scaling

DDQP: A Double Deep Q-Learning Approach to Online Fault-Tolerant SFC Placement

Sdn Based Vxlan Optimization In Cloud Computing Networks

AdaptNF: Adaptive Service Chain Scheduling with Stateless Migration and NF Consolidation

SLA-Aware Multiple Migration Planning and Scheduling in SDN-NFV-enabled Clouds

A Machine Learning-Based Migration Strategy for Virtual Network Function Instances

Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning

Multi-objective Optimization Service Function Chain Placement Algorithm Based on Reinforcement Learning

Automated Function Placement and Online Optimization of Network Functions Virtualization

Enhancing Software‐Defined Networking With Dynamic Load Balancing and Fault Tolerance Using a Q‐Learning Approach

AQMDRL: Automatic Quality of Service Architecture Based on Multistep Deep Reinforcement Learning in Software-Defined Networking

Consistent State Updates for Virtualized Network Function Migration