Abstract:This paper studies a sequential task offloading problem for a multiuser mobile edge computing (MEC) system. While most of the existing works consider static one-shot offloading optimization with fixed wireless channel conditions and fixed computational tasks, we consider a dynamic optimization approach, which embraces wireless channel fluctuations and random deep neural network (DNN) task arrivals over an infinite horizon. Specifically, we introduce a local CPU workload queue (WD-QSI) and an MEC server workload queue (MEC-QSI) to model the dynamic workload of DNN tasks at each WD and the MEC server, respectively. The transmit power and the partitioning of the local DNN task at each WD are dynamically determined based on the instantaneous channel conditions (to capture the transmission opportunities) and the instantaneous WD-QSI and MEC-QSI (to capture the dynamic urgency of the tasks) to minimize the average latency of the DNN tasks. The joint optimization can be formulated as an ergodic Markov decision process (MDP), in which the optimality condition is characterized by a centralized Bellman equation. However, the brute force solution of the MDP is not viable due to the curse of dimensionality as well as the requirement for knowledge of the global state information. To overcome these issues, we first decompose the MDP into multiple lower dimensional sub-MDPs, each of which can be associated with a WD or the MEC server. Next, we further develop a parametric online Q-learning algorithm, so that each sub-MDP is solved locally at its associated WD or the MEC server. The proposed solution is completely decentralized in the sense that the transmit power for sequential offloading and the DNN task partitioning can be determined based on the local channel state information (CSI) and the local WD-QSI at the WD only. Additionally, no prior knowledge of the distribution of the DNN task arrivals or the channel statistics will be needed for the MEC server. The proposed solution can achieve the superb performance over various state-of-the-art baselines.

Offloading Strategy for Dependency-Aware Tasks in MEC System Based on Deep Q-network

Task Offloading Algorithm in Edge Computing Based on DQN

A Multi-Layer Offloading Framework for Dependency-Aware Tasks in MEC

Delay-Optimal Computation Offloading for Computation-Constrained Mobile Edge Networks.

Task Offloading and Resource Allocation Strategy Based on Deep Learning for Mobile Edge Computing

Dependent Task Scheduling and Offloading for Minimizing Deadline Violation Ratio in Mobile Edge Computing Networks

Deep reinforcement learning based adaptive threshold multi-tasks offloading approach in MEC

Optimal Offloading and Resource Allocation in Mobile-Edge Computing with Inter-User Task Dependency.

Energy- and Cost-Aware Scheduling for Task- Dependency Applications in Mobile Edge Computing

Dependency-Aware Parallel Offloading and Computation in MEC-Enabled Networks

Cost-Effective Task Offloading Scheduling for Hybrid Mobile Edge-Quantum Computing

Collaborative Offloading Strategy for Dependent Tasks in Mobile Edge Computing

Mobility-Aware Computation Offloading with Adaptive Load Balancing in Small-Cell MEC

An intelligent approach of task offloading for dependent services in Mobile Edge Computing

Dynamic Computing Offloading Strategy for Multi-dimensional Resources Based on MEC

Sequential Offloading for Distributed DNN Computation in Multiuser MEC Systems

Multi-Queue-Based Offloading Strategy for Deep Reinforcement Learning Tasks

Joint Task Secure Offloading and Resource Allocation for Multi-MEC Server to Improve User QoE.

Efficient Dependent Task Offloading for Multiple Applications in MEC-Cloud System

Ultra-Low Latency Multi-Task Offloading in Mobile Edge Computing

Dynamic Task Offloading for Mobile Edge Computing with Hybrid Energy Supply