Abstract:Collaborative Mobile Edge Computing (MEC) has emerged as a promising approach to provide low service latency for computation-intensive Internet of Things applications, facilitated by the cooperation of edge-edge and edge-cloud resources. However, existing collaborative MEC methods typically restrict the collaborative processing between any two Edge Servers (ESs) or one ES and the cloud server for a task request, limiting the exploitation of available resources on other ESs. Moreover, these conventional methods rely on offline task partitioning, potentially leading to extended make-span, especially when ES computing capacities exhibit heterogeneity. In this paper, we propose an innovative method named SMCoEdge. This method performs dynamic parallel multi-ES selection and workload allocation in heterogeneous collaborative MEC environments, thus simultaneously enabling multiple ESs' idle resources to accelerate task processing. We formulate our problem into an online linear programming problem, with the objective of minimizing task computing and transmission make-spans. To enhance computational efficiency, we decompose the problem into two stages: multi-ES selection and workload allocation. Then, we propose an online Deep Reinforcement Learning based Simultaneous Multi-ES Offloading (DRL-SMO) algorithm along with a top-$k$ deep Q-learning network model to effectively solve our problem, where an efficient algorithm is proposed to achieve the optimal solution for the workload allocation stage. Furthermore, we provide a theoretical performance analysis, demonstrating that the DRL-SMO algorithm achieves a near-optimal solution for our problem within an approximate linear time complexity. Finally, our extensive experimental results demonstrate the substantial advantages of our method. It consistently reduces the average make-span by 19.63% and keeps a lower offloading failure rate, when compared to state-of-the-art methods. These findings underline the efficacy of our method in enhancing collaborative MEC performance.

Dynamic Distributed Edge Resource Provisioning Via Online Learning Across Timescales.

Delay-Aware Stochastic Resource Management for Mobile Edge Computing Systems Via Constrained Reinforcement Learning

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

Provisioning Edge Inference As a Service Via Online Learning.

Learning for Learning: Predictive Online Control of Federated Learning with Edge Provisioning

An Expanded Distributed Algorithm for Dynamic Resource Allocation over Strongly Connected Topologies

Distributed Algorithm for a Finite Time Horizon Resource Allocation over a Directed Network

Online Learning for Offloading and Autoscaling in Renewable-Powered Mobile Edge Computing

Mobile Edge Computing Networks: Online Low-Latency and Fresh Service Provisioning

EDC - An Edge-Oriented Dynamic Resource Configuration Strategy.

When CPN Meets AI: Resource Provisioning for Inference Query Upon Computing Power Network

Cost-Effective Traffic Scheduling and Resource Allocation for Edge Service Provisioning

Online Optimization of DNN Inference Network Utility in Collaborative Edge Computing

Dynamic Service Placement and Request Scheduling for Edge Networks

Collaborative Resource Management and Workloads Scheduling in Cloud-Assisted Mobile Edge Computing across Timescales

Joint Task Offloading and Service Placement for Mobile Edge Computing: An Online Two-Timescale Approach

Deep Reinforcement Learning based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing

Dynamic Parallel Multi-Server Selection and Allocation in Collaborative Edge Computing

Lyapunov-Guided Deep Reinforcement Learning for Stable Online Computation Offloading in Mobile-Edge Computing Networks

A Dynamic Service Placement Based on Deep Reinforcement Learning in Mobile Edge Computing

Dynamic Scheduling for Federated Edge Learning with Streaming Data