Abstract:In mobile edge computing (MEC), randomly offloading tasks to edge servers (ES) can cause wireless devices (WD) to compete for limited bandwidth resources, leading to overall performance degradation. Reinforcement learning can provide suitable strategies for task offloading and resource allocation through exploration and trial-and-error, helping to avoid blind offloading. However, traditional reinforcement learning algorithms suffer from slow convergence and a tendency to get stuck in suboptimal local minima, significantly impacting the energy consumption and data timeliness of edge computing task unloading. To address these issues, we propose Parallel Exploration with Asynchronous Training-based Deep Reinforcement Learning (PEATDRL) algorithm for MEC network offloading decisions. Its objective is to maximize system performance while limiting energy consumption in an MEC environment characterized by time-varying wireless channels and random user task arrivals. Firstly, our model employs two independent DNNs for parallel exploration, each generating different offloading strategies. This parallel exploration enhances environmental adaptability, avoids the limitations of a single DNN, and addresses the issue of agents getting stuck in suboptimal local minima due to the explosion of decision combinations, thereby improving decision performance. Secondly, we set different learning rates for the two DNNs during the training phase and trained them at various intervals. This asynchronous training strategy increases the randomness of decision exploration, prevents the two DNNs from converging to the same suboptimal local solution, and improves convergence efficiency by enhancing sample utilization. Finally, we examine the impact of different parallel levels and training step differences on system performance metrics and explain the parameter choices. Experimental results show that the proposed method provides a viable solution to the performance issues caused by slow convergence and local minima, with PEATDRL improving task queue convergence speed by more than 20% compared to baseline algorithms.

Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning

Dynamic Task Offloading for Internet of Things in Mobile Edge Computing Via Deep Reinforcement Learning

Digital Twin-Driven Intelligent Task Offloading for Collaborative Mobile Edge Computing

Dependency-Aware Dynamic Task Offloading Based on Deep Reinforcement Learning in Mobile Edge Computing

Dynamic Task Offloading in MEC-Enabled IoT Networks - A Hybrid DDPG-D3QN Approach.

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Dynamic Task Offloading for Mobile Edge Computing with Hybrid Energy Supply

Security-Aware Task Offloading Using Deep Reinforcement Learning in Mobile Edge Computing Systems

Deep Reinforcement Learning for Time-Energy Tradeoff Online Offloading in MEC-Enabled Industrial Internet of Things

Deep Reinforcement Learning-Based Dynamical Task Offloading for Mobile Edge Computing

Task graph offloading via deep reinforcement learning in mobile edge computing

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

An Efficient Computation Offloading Approach in Multi-access Edge Computing Using Deep Reinforcement Learning

Energy-Efficient Dependency-Aware Task Offloading in Mobile Edge Computing: A Digital Twin Empowered Approach

DRL‐based computing offloading approach for large‐scale heterogeneous tasks in mobile edge computing

Energy and Delay-Aware Task Offloading and Resource Allocation in Mobile Edge Computing

Dynamic Task Offloading in Edge Computing based on Dependency-aware Reinforcement Learning

Energy-aware Task Offloading with Deadline Constraint in Mobile Edge Computing

Deep Reinforcement Learning Method for Task Offloading in Mobile Edge Computing Networks Based on Parallel Exploration with Asynchronous Training

A DRL-based Algorithm for Dependent Task Offloading in Multi-access Edge Computing