Abstract:Edge computing has emerged as a powerful paradigm for efficient scheduling at the network edge to fulfill users' requirements for low latency. Edge servers' and clouds' ability to interact allows them to leverage edge servers' limited computing and storage resources collectively to handle all requests collaboratively. This has unlocked the potential of the edge-cloud system. However, its sophistication (e.g., heterogeneous resources, intertwined dependencies, etc.) also raised unforeseen challenges in request dispatch and service orchestration phases within the scheduling process, including complex hierarchy , limited cooperation and unfocused information . Traditional resource optimization methods for edge-cloud systems cannot address these intricate situations properly, raising concerns over system efficiency, stability, and costs. This paper proposes learning-based methods to accommodate time-varying requests and dynamic service prevalence. Specifically, we employ the multi-agent advantage actor-critic (MAA2C) and the graph convolutional networks-based MAA2C (GCN-MAA2C) in two phases, respectively, to enhance individual intelligence and facilitate optimal dispatch and orchestration decisions. Inspired by the regulations in human society, we propose SocialEdge , a socialized learning-based scheduling framework for the edge-cloud system. To leverage the hierarchical correlation, we develop an inter-layer socialized refining mechanism. The inference results from one layer guide the training process of the next layer, enabling the abstraction of optimization-critical knowledge. Moreover, we apply intra-layer socialized cooperating, where federated averaging with MAA2C is implemented to ensure the cooperation of individuals over private data for achieving optimal global solutions. Furthermore, we propose a socialized resonance mechanism across the layers to extract high-value information and induce resonance toward the system objective, aiming to improve the efficiency of scheduling. Experimental evaluations on a proof-of-concept testbed and two real traces demonstrate that SocialEdge reduces scheduling cost by 11.2% while enhancing time efficiency by 77.4%, and system throughput by 17.9%, compared to baseline methods.

Crossl.earning: Vertical and Horizontal Learning for Request Scheduling in Edge-Cloud Systems

An Offline-Transfer-Online Framework for Cloud-Edge Collaborative Distributed Reinforcement Learning

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

EC-TRL: Evolutionary-Weighted Clustering and Transformer-Augmented Reinforcement Learning for Dynamic Resource Scheduling in Edge Cloud Environments

A Socialized Learning-Based Scheduling Framework in Intricate Edge Clouds

<i>SocialEdge</i>: Socialized Learning-Based Request Scheduling for Edge-Cloud Systems

Deep Reinforcement Learning-Based Task Scheduling in IoT Edge Computing

Online simulation task scheduling in cloud manufacturing with cross attention and deep reinforcement learning

An Integrated Cloud-Edge-Device Adaptive Deep Learning Service for Cross-Platform Web

Deep Reinforcement Learning-Based Workload Scheduling for Edge Computing

Deep Reinforcement Learning-based scheduling for optimizing system load and response time in edge and fog computing environments

Deep Reinforcement Learning-Based Traffic Engineering in Cloud-Edge-End Collaboration Environments

Cross-domain Resources Optimization for Hybrid Edge Computing Networks: Federated DRL Approach

Reinforcement Learning for Task Placement in Collaborative Cloud- Edge Computing

Service Management and Energy Scheduling Toward Low-Carbon Edge Computing

Cloud-Edge Training Architecture for Sim-to-Real Deep Reinforcement Learning

A DRL Based Real-time Computing Load Scheduling Method.

Digital Twin-Assisted Efficient Reinforcement Learning for Edge Task Scheduling

TF-DDRL: A Transformer-enhanced Distributed DRL Technique for Scheduling IoT Applications in Edge and Cloud Computing Environments

A Deep Reinforcement Learning Approach to Multi-Component Job Scheduling in Edge Computing

Deep Reinforcement Learning for Scheduling in an Edge Computing-Based Industrial Internet of Things