Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

Stochastic Computation Offloading and Scheduling Based on Mobile Edge Computing

Computation Offloading Scheme with D2D for MEC-enabled Cellular Networks

Delay-Optimal Computation Offloading for Computation-Constrained Mobile Edge Networks.

Closed-Form Delay-Optimal Computation Offloading in Mobile Edge Computing Systems

Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning

Ultra-Low Latency Multi-Task Offloading in Mobile Edge Computing

Performance Optimization in Mobile-Edge Computing Via Deep Reinforcement Learning

MDP-Based Scheduling Design for Mobile-Edge Computing Systems with Random User Arrival.

Online Optimization of Energy-Efficient User Association and Workload Offloading for Mobile Edge Computing

An Online Computation Offloading Mechanism for Mobile Edge Computing in Ultra-Dense Small Cell Networks.

Quantum Particle Swarm Optimization for Task Offloading in Mobile Edge Computing

Mobility-Aware Computation Offloading with Adaptive Load Balancing in Small-Cell MEC

Delay-Optimal Computation Task Scheduling for Mobile-Edge Computing Systems

Offloading Time Optimization via Markov Decision Process in Mobile-Edge Computing

Computation Offloading in Heterogeneous Mobile Edge Computing with Energy Harvesting

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Online Multi-Task Offloading for Semantic-Aware Edge Computing Systems

Decentralized Computation Offloading for Multi-User Mobile Edge Computing: A Deep Reinforcement Learning Approach

Asynchronous Mobile-Edge Computation Offloading: Energy-Efficient Resource Management

Joint Social-Aware and Mobility-Aware Computation Offloading in Heterogeneous Mobile Edge Computing

Service‐dependent Task Offloading for Multiuser Mobile Edge Computing System