Abstract:With the widespread adoption of edge computing and the rollout of 5G technology, the edge network is experiencing rapid growth. Edge computing enables the execution of certain computational tasks on edge devices, fostering more efficient resource utilization. However, the reliability of the edge network is constrained by its network connections. Network instability can significantly compromise service quality. An effective service function chain (SFC) migration algorithm is essential to optimize resource utilization, enhance service quality. This paper begins by analyzing the current research landscape of edge networks and SFC migration algorithms. Subsequently, the challenges associated with edge network and SFC migration are formally articulated, leading to the proposal of a SFC migration algorithm based on deep reinforcement learning (DRL) with a focus on reliability assurance (RA-SFCM). The algorithm leverages multi-agent deep reinforcement learning to dynamically perceive changes in the edge network environment. It introduces an advantage function to evaluate the performance of each agent relative to the average level and incorporates a central attention mechanism with multiple attention heads to better capture the interdependencies and relationships among different agents. Additionally, this paper innovatively defines and quantifies the reliability of the migration process. By introducing a reliability penalty mechanism based on the migration target nodes and link capacity, it enhances the reliability of the migration schemes. The experimental results conclusively demonstrate the remarkable advantages of the RA-SFCM algorithm in terms of real-time performance, resource utilization efficiency, and reliability. Compared to algorithms such as Sa-VNFM, ROVM, and DLTSAC, RA-SFCM exhibits superior performance. For RA-SFCM, the optimized deployment migration strategy enhances real-time performance, precise resource management improves utilization efficiency, and advanced fault tolerance mechanisms strengthen reliability.

Deep Reinforcement Learning-Based SFC Deployment Scheme for 6G IoT Scenario.

A Multi-Agent Reinforcement Learning Scheme for SFC Placement in Edge Computing Networks

Scheduling Reconfigurable Service Function Chain

Reliability-assured Service Function Chain Migration Strategy in Edge Networks Using Deep Reinforcement Learning

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

A Resource Allocation Scheme for Energy Demand Management in 6G-enabled Smart Grid

Deploying Network Functions for Multiaccess Edge-IoT with Deep Reinforcement Learning

Collective reinforcement learning based resource allocation for digital twin service in 6G networks

DRL-D: Revenue-Aware Online Service Function Chain Deployment Via Deep Reinforcement Learning

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

A Deep Reinforcement Learning-Based Algorithm for Reliability-Aware Multi-Domain Service Deployment in Smart Ecosystems

Edge-edge Collaboration Based Micro-service Deployment in Edge Computing Networks

A New Realistic Platform for Benchmarking and Performance Evaluation of DRL-Driven and Reconfigurable SFC Provisioning Solutions

Edge Intelligence-driven Joint Offloading and Resource Allocation for Future 6G Industrial Internet of Things

Service Function Chain Embedding Meets Machine Learning: Deep Reinforcement Learning Approach

SFC active reconfiguration based on user mobility and resource demand prediction in dynamic IoT-MEC networks

Scalable Orchestration of Service Function Chains in NFV-Enabled Networks: A Federated Reinforcement Learning Approach

Reinforcement Learning-Based QoS/QoE-aware Service Function Chaining in Software-Driven 5G Slices.

GenAI Assistance for Deep Reinforcement Learning-based VNF Placement and SFC Provisioning in 5G Cores

A Q-Learning-Based Approach For Deploying Dynamic Service Function Chains

Knowledge-Assisted Actor Critic Proximal Policy Optimization-Based Service Function Chain Reconfiguration Algorithm for 6G IoT Scenario