Abstract:With the widespread adoption of edge computing and the rollout of 5G technology, the edge network is experiencing rapid growth. Edge computing enables the execution of certain computational tasks on edge devices, fostering more efficient resource utilization. However, the reliability of the edge network is constrained by its network connections. Network instability can significantly compromise service quality. An effective service function chain (SFC) migration algorithm is essential to optimize resource utilization, enhance service quality. This paper begins by analyzing the current research landscape of edge networks and SFC migration algorithms. Subsequently, the challenges associated with edge network and SFC migration are formally articulated, leading to the proposal of a SFC migration algorithm based on deep reinforcement learning (DRL) with a focus on reliability assurance (RA-SFCM). The algorithm leverages multi-agent deep reinforcement learning to dynamically perceive changes in the edge network environment. It introduces an advantage function to evaluate the performance of each agent relative to the average level and incorporates a central attention mechanism with multiple attention heads to better capture the interdependencies and relationships among different agents. Additionally, this paper innovatively defines and quantifies the reliability of the migration process. By introducing a reliability penalty mechanism based on the migration target nodes and link capacity, it enhances the reliability of the migration schemes. The experimental results conclusively demonstrate the remarkable advantages of the RA-SFCM algorithm in terms of real-time performance, resource utilization efficiency, and reliability. Compared to algorithms such as Sa-VNFM, ROVM, and DLTSAC, RA-SFCM exhibits superior performance. For RA-SFCM, the optimized deployment migration strategy enhances real-time performance, precise resource management improves utilization efficiency, and advanced fault tolerance mechanisms strengthen reliability.

Cold-start Aware Cloud-Native Service Function Chain Caching in Resource-Constrained Edge: A Reinforcement Learning Approach

Cold-Start Aware Cloud-Native Parallel Service Function Chain Caching in Edge-Cloud Network

Deep Reinforcement Learning for Cooperative Coded Caching Strategy in Fog Radio Access Network

Service Function Chain Embedding Meets Machine Learning: Deep Reinforcement Learning Approach

Reinforcement learning for cost-effective IoT service caching at the edge

Asynchronous Federated and Reinforcement Learning for Mobility-Aware Edge Caching in IoV

A Federated Deep Reinforcement Learning-based Low-power Caching Strategy for Cloud-edge Collaboration

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Autonomous Cache Resource Slicing and Content Placement at Virtualized Mobile Edge Network

Resource-Aware Service Function Chain Deployment in Cloud-Edge Environment

XRL-SHAP-Cache: an Explainable Reinforcement Learning Approach for Intelligent Edge Service Caching in Content Delivery Networks

Efficient Federated DRL-Based Cooperative Caching for Mobile Edge Networks

Hierarchical Deep Reinforcement Learning for Joint Service Caching and Computation Offloading in Mobile Edge-Cloud Computing

DRL-D: Revenue-Aware Online Service Function Chain Deployment Via Deep Reinforcement Learning

Exploiting Deep Reinforcement Learning for Edge Caching in Cell-Free Massive MIMO Systems

How to Cache Important Contents for Multi-modal Service in Dynamic Networks: A DRL-based Caching Scheme

Reliability-assured Service Function Chain Migration Strategy in Edge Networks Using Deep Reinforcement Learning

Asynchronous Federated Learning for Vehicular Edge Caching of Consumer Content

Collaborative caching relay algorithm based on recursive deep reinforcement learning in mobile vehicle edge network

Distributed Caching in Converged Networks: A Deep Reinforcement Learning Approach