Abstract:Collaborative Mobile Edge Computing (MEC) has emerged as a promising approach to provide low service latency for computation-intensive Internet of Things applications, facilitated by the cooperation of edge-edge and edge-cloud resources. However, existing collaborative MEC methods typically restrict the collaborative processing between any two Edge Servers (ESs) or one ES and the cloud server for a task request, limiting the exploitation of available resources on other ESs. Moreover, these conventional methods rely on offline task partitioning, potentially leading to extended make-span, especially when ES computing capacities exhibit heterogeneity. In this paper, we propose an innovative method named SMCoEdge. This method performs dynamic parallel multi-ES selection and workload allocation in heterogeneous collaborative MEC environments, thus simultaneously enabling multiple ESs' idle resources to accelerate task processing. We formulate our problem into an online linear programming problem, with the objective of minimizing task computing and transmission make-spans. To enhance computational efficiency, we decompose the problem into two stages: multi-ES selection and workload allocation. Then, we propose an online Deep Reinforcement Learning based Simultaneous Multi-ES Offloading (DRL-SMO) algorithm along with a top-$k$ deep Q-learning network model to effectively solve our problem, where an efficient algorithm is proposed to achieve the optimal solution for the workload allocation stage. Furthermore, we provide a theoretical performance analysis, demonstrating that the DRL-SMO algorithm achieves a near-optimal solution for our problem within an approximate linear time complexity. Finally, our extensive experimental results demonstrate the substantial advantages of our method. It consistently reduces the average make-span by 19.63% and keeps a lower offloading failure rate, when compared to state-of-the-art methods. These findings underline the efficacy of our method in enhancing collaborative MEC performance.

Meces: Latency-efficient Rescaling via Prioritized State Migration for Stateful Distributed Stream Processing Systems

Megaphone: Latency-conscious state migration for distributed streaming dataflows

Optimal Operator State Migration for Elastic Data Stream Processing

TATA: Throughput-Aware TAsk Placement in Heterogeneous Stream Processing with Deep Reinforcement Learning

MorphStream: Scalable Processing of Transactions over Streams on Multicores

Delay-Optimal Computation Offloading for Computation-Constrained Mobile Edge Networks.

Dynamic Resource Management In a Massively Parallel Stream Processing Engine

Scaling Reverse Time Migration Performance Through Reconfigurable Dataflow Engines

A state lossless scheduling strategy in distributed stream computing systems

Segue: Quality of Service Aware Edge Cloud Service Migration

An On-the-Fly Scheduling Strategy for Distributed Stream Processing Platform.

Mobile-Aware Service Function Chain Intelligent Seamless Migration in Multi-access Edge Computing

Lc‐Stream: An elastic scheduling strategy with latency constraints in geo‐distributed stream computing environments

Resource- and Message Size-Aware Scheduling of Stream Processing at the Edge with application to Realtime Microscopy

Mobility-aware task offloading in MEC with task migration and result caching

Design and Implementation of the MaxStream Federated Stream Processing Architecture

To Migrate or not to Migrate: An Analysis of Operator Migration in Distributed Stream Processing

FlexSP:(1 + Β)-Choice Based Flexible Stream Partitioning for Stateful Operators

Analyzing efficient stream processing on modern hardware

Dynamic Parallel Multi-Server Selection and Allocation in Collaborative Edge Computing

Adaptive Scheduling Framework of Streaming Applications based on Resource Demand Prediction with Hybrid Algorithms