SFC Orchestration Method for Edge Cloud and Central Cloud Collaboration: QoS and Energy Consumption Joint Optimization Combined with Reputation Assessment
Lanlan Rui,Shiyou Chen,Shuyun Wang,Zhipeng Gao,Xuesong Qiu,Wenjing Li,Shaoyong Guo
DOI: https://doi.org/10.1109/tpds.2023.3301670
IF: 5.3
2023-01-01
IEEE Transactions on Parallel and Distributed Systems
Abstract:Network function virtualization (NFV) is an emerging technology that uses virtualization technology to provide various services in enterprise networks and reduce costs. However, in cloud edge networks, effective virtual network function (VNF) configuration is particularly difficult, and the system design needs to consider the reliability and energy-saving while meeting the requirements of Quality of Service (QoS). This paper uses the binary integer programming (BIP) model to study the service function chain (SFC) orchestration problem, and designs a federated deep reinforcement learning SFC orchestration algorithm (FDOA). With this method, energy consumption can be reduced and the QoS of users can be improved. In addition, considering the limitations of local deep reinforcement learning (DRL) model training, this paper proposes a federated DRL algorithm to help obtain a more robust model, and simultaneously improve the convergence speed of the model. Among them, we introduce reputation theory during model training to evaluate the reliability of the nodes carrying the DRL model, avoiding the influence of unreliable models on the training effect. Finally, the simulation results show that FDOA has better performance in training time and end-to-end delay compared with other existing algorithms.