Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

Edge-Centric Bandit Learning for Task-Offloading Allocations in Multi-RAT Heterogeneous Networks

An MAB Approach for MEC-centric Task-offloading Control in Multi-RAT HetNets

Multi-Agent Multi-Armed Bandit Learning for Online Management of Edge-Assisted Computing

Offloading Tasks to Unknown Edge Servers: A Contextual Multi-Armed Bandit Approach.

Contextual User-Centric Task Offloading for Mobile Edge Computing in Ultra-Dense Network

A Combinatorial Bandit Approach to UAV-aided Edge Computing

Calibrated Bandit Learning for Decentralized Task Offloading in Ultra-Dense Networks

Decentralized Task Offloading in Edge Computing: A Multi-User Multi-Armed Bandit Approach

Batch based Multi-Arm Bandits with Knapsacks for Tasks Allocation in MEC.

Mobile-Edge Computation Offloading And Resource Allocation In Heterogeneous Wireless Networks

Partial observation learning-based task offloading and spectrum allocation in UAV collaborative edge computing

Edge-Aided Computing and Transmission Scheduling for LTE-U-Enabled IoT

A Multi-User Effective Computation Offloading Mechanism for MEC System: Batched Multi-Armed Bandits Approach

An intelligent task offloading method based on multi-agent deep reinforcement learning in ultra-dense heterogeneous network with mobile edge computing

Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment

Cache Placement Optimization in Mobile Edge Computing Networks with Unaware Environment -- An Extended Multi-armed Bandit Approach

AI-Enabled Task Offloading for Improving Quality of Computational Experience in Ultra Dense Networks

Towards Decentralized Task Offloading and Resource Allocation in User-Centric Mobile Edge Computing

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Reinforcement Learning-Based Task Offloading of MEC-Assisted UAVs in Precision Agriculture

Policy network-based dual-agent deep reinforcement learning for multi-resource task offloading in multi-access edge cloud networks