A Socialized Learning-Based Scheduling Framework in Intricate Edge Clouds
Yunfeng Zhao,Ziwei Wang,Chao Qiu,Qiang He,Dusit Niyato,Xin Wang,Xiaofei Wang,Qinghua Hu
DOI: https://doi.org/10.1109/tsc.2024.3403048
IF: 11.019
2024-01-01
IEEE Transactions on Services Computing
Abstract:Edge computing has emerged as a powerful paradigm for efficient scheduling at the network edge to fulfill users' requirements for low latency. Edge servers' and clouds' ability to interact allows them to leverage edge servers' limited computing and storage resources collectively to handle all requests collaboratively. This has unlocked the potential of the edge-cloud system. However, its sophistication (e.g., heterogeneous resources, intertwined dependencies, etc.) also raised unforeseen challenges in request dispatch and service orchestration phases within the scheduling process, including complex hierarchy , limited cooperation and unfocused information . Traditional resource optimization methods for edge-cloud systems cannot address these intricate situations properly, raising concerns over system efficiency, stability, and costs. This paper proposes learning-based methods to accommodate time-varying requests and dynamic service prevalence. Specifically, we employ the multi-agent advantage actor-critic (MAA2C) and the graph convolutional networks-based MAA2C (GCN-MAA2C) in two phases, respectively, to enhance individual intelligence and facilitate optimal dispatch and orchestration decisions. Inspired by the regulations in human society, we propose SocialEdge , a socialized learning-based scheduling framework for the edge-cloud system. To leverage the hierarchical correlation, we develop an inter-layer socialized refining mechanism. The inference results from one layer guide the training process of the next layer, enabling the abstraction of optimization-critical knowledge. Moreover, we apply intra-layer socialized cooperating, where federated averaging with MAA2C is implemented to ensure the cooperation of individuals over private data for achieving optimal global solutions. Furthermore, we propose a socialized resonance mechanism across the layers to extract high-value information and induce resonance toward the system objective, aiming to improve the efficiency of scheduling. Experimental evaluations on a proof-of-concept testbed and two real traces demonstrate that SocialEdge reduces scheduling cost by 11.2% while enhancing time efficiency by 77.4%, and system throughput by 17.9%, compared to baseline methods.