Abstract:Collaborative Mobile Edge Computing (MEC) has emerged as a promising approach to provide low service latency for computation-intensive Internet of Things applications, facilitated by the cooperation of edge-edge and edge-cloud resources. However, existing collaborative MEC methods typically restrict the collaborative processing between any two Edge Servers (ESs) or one ES and the cloud server for a task request, limiting the exploitation of available resources on other ESs. Moreover, these conventional methods rely on offline task partitioning, potentially leading to extended make-span, especially when ES computing capacities exhibit heterogeneity. In this paper, we propose an innovative method named SMCoEdge. This method performs dynamic parallel multi-ES selection and workload allocation in heterogeneous collaborative MEC environments, thus simultaneously enabling multiple ESs' idle resources to accelerate task processing. We formulate our problem into an online linear programming problem, with the objective of minimizing task computing and transmission make-spans. To enhance computational efficiency, we decompose the problem into two stages: multi-ES selection and workload allocation. Then, we propose an online Deep Reinforcement Learning based Simultaneous Multi-ES Offloading (DRL-SMO) algorithm along with a top-$k$ deep Q-learning network model to effectively solve our problem, where an efficient algorithm is proposed to achieve the optimal solution for the workload allocation stage. Furthermore, we provide a theoretical performance analysis, demonstrating that the DRL-SMO algorithm achieves a near-optimal solution for our problem within an approximate linear time complexity. Finally, our extensive experimental results demonstrate the substantial advantages of our method. It consistently reduces the average make-span by 19.63% and keeps a lower offloading failure rate, when compared to state-of-the-art methods. These findings underline the efficacy of our method in enhancing collaborative MEC performance.

Multi-objective Deep Reinforcement Learning for Function Offloading in Serverless Edge Computing

Multi-objective Deep Reinforcement Learning for Mobile Edge Computing

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

Dynamic Parallel Multi-Server Selection and Allocation in Collaborative Edge Computing

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Multi-mobile vehicles task offloading for vehicle-edge-cloud collaboration: A dependency-aware and deep reinforcement learning approach

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Security-Aware Task Offloading Using Deep Reinforcement Learning in Mobile Edge Computing Systems

Multi-Queue-Based Offloading Strategy for Deep Reinforcement Learning Tasks

Decentralized Computation Offloading for Multi-User Mobile Edge Computing: A Deep Reinforcement Learning Approach

Decentralized Scheduling for Concurrent Tasks in Mobile Edge Computing Via Deep Reinforcement Learning

Lyapunov-Guided Deep Reinforcement Learning for Stable Online Computation Offloading in Mobile-Edge Computing Networks

Fast Adaptive Task Offloading in Edge Computing based on Meta Reinforcement Learning

Joint Server Selection, Cooperative Offloading and Handover in Multi-access Edge Computing Wireless Network: A Deep Reinforcement Learning Approach

Energy Efficient Joint Computation Offloading and Service Caching for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Deep reinforcement learning-based task offloading and service migrating policies in service caching-assisted mobile edge computing

Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks