Abstract:With the widespread adoption of edge computing and the rollout of 5G technology, the edge network is experiencing rapid growth. Edge computing enables the execution of certain computational tasks on edge devices, fostering more efficient resource utilization. However, the reliability of the edge network is constrained by its network connections. Network instability can significantly compromise service quality. An effective service function chain (SFC) migration algorithm is essential to optimize resource utilization, enhance service quality. This paper begins by analyzing the current research landscape of edge networks and SFC migration algorithms. Subsequently, the challenges associated with edge network and SFC migration are formally articulated, leading to the proposal of a SFC migration algorithm based on deep reinforcement learning (DRL) with a focus on reliability assurance (RA-SFCM). The algorithm leverages multi-agent deep reinforcement learning to dynamically perceive changes in the edge network environment. It introduces an advantage function to evaluate the performance of each agent relative to the average level and incorporates a central attention mechanism with multiple attention heads to better capture the interdependencies and relationships among different agents. Additionally, this paper innovatively defines and quantifies the reliability of the migration process. By introducing a reliability penalty mechanism based on the migration target nodes and link capacity, it enhances the reliability of the migration schemes. The experimental results conclusively demonstrate the remarkable advantages of the RA-SFCM algorithm in terms of real-time performance, resource utilization efficiency, and reliability. Compared to algorithms such as Sa-VNFM, ROVM, and DLTSAC, RA-SFCM exhibits superior performance. For RA-SFCM, the optimized deployment migration strategy enhances real-time performance, precise resource management improves utilization efficiency, and advanced fault tolerance mechanisms strengthen reliability.

Deep Reinforcement Learning Based Reliability Aware SFC Placement in Multi-Domain Networks

A Deep Reinforcement Learning-Based Approach for Adaptive SFC Deployment in Multi-Domain Networks

DRL-SFCP: Adaptive Service Function Chains Placement with Deep Reinforcement Learning

Scheduling Reconfigurable Service Function Chain

Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning

A Multi-Agent Reinforcement Learning Scheme for SFC Placement in Edge Computing Networks

A Deep Reinforcement Learning-Based Algorithm for Reliability-Aware Multi-Domain Service Deployment in Smart Ecosystems

Multi-objective Optimization Service Function Chain Placement Algorithm Based on Reinforcement Learning

On-Policy Versus Off-Policy Reinforcement Learning for Multi-Domain SFC Embedding in SDN/NFV-Enabled Networks

A Parallel Placement Approach for Service Function Chain Using Deep Reinforcement Learning

Dependency Aware and Delay Guaranteed SFC Placement in Multi-domain Networks

Deep Reinforcement Learning-based Dynamic SFC Deployment in IoT-MEC Networks

Reliability-aware virtual network function placement in carrier networks.

Online Fault-tolerant VNF Chain Placement: A Deep Reinforcement Learning Approach

Reliability-assured Service Function Chain Migration Strategy in Edge Networks Using Deep Reinforcement Learning

Leveraging Deep Reinforcement Learning with Attention Mechanism for Virtual Network Function Placement and Routing

Scalable Orchestration of Service Function Chains in NFV-Enabled Networks: A Federated Reinforcement Learning Approach

Survivable SFC deployment method based on federated learning in multi-domain network

Risk-Aware SFC Placement Method in Edge Cloud Environment

A Reinforcement Learning Approach for Placement of Stateful Virtualized Network Functions

Parallel Placement of Virtualized Network Functions via Federated Deep Reinforcement Learning