Abstract:In heterogeneous wireless networks, massive mobile terminals randomly generate a large number of computation tasks (payloads). How to better manage these mobile terminals located in wireless networks to achieve acceptable quality of service (QoS) such as latency minimization, energy consumption minimization is crucial. A multi-access edge computing (MEC) server can be leveraged to execute the offloaded payloads generated from mobile terminals owing to its powerful processing power and location proximity features. However, an MEC server cannot tackle all offloaded tasks from multiple mobile terminals, and its energy consumption needs further consideration. We introduce an edge server model combined with the unmanned aerial vehicle (UAV) and equipped with the macro base station (MBS-MEC) to process the arrival payloads, and all UAVs and MBS-MECs can harvest renewable energy by using energy harvesting equipment. Furthermore, we model the computation offloading as a deep reinforcement learning scheme without priori knowledge. Considering the infeasibility of deep-reinforcement learning-based centralized learning for the proposed edge computing framework, we propose a distributed computation offloading scheme based on deep reinforcement learning (DCODRL) to minimize the weighted average cost, including the latency cost and the energy cost. Each mobile terminal can be regarded as a learning agent for the DCODRL. To compensate for the lack of cooperation of the DCODRL, we propose a gated-recurrent-unit-assisted multi-agent computation offloading scheme based on deep reinforcement learning (MCODRL) to improve the offloading policy by obtaining global observation information and designing a common reward for all agents. Comprehensive numerical results reflect the convergence and effectiveness of the DCODRL and MCODRL, and the efficacy of the proposed algorithms is further verified through comparisons with two baseline algorithms.

Moving Server: Follow-up Computation Offloading Paradigm for Vehicular Users

Joint Optimization of Energy and Delay for Computation Offloading in Vehicular Edge Computing

Computation Offloading for Service Workflow in Mobile Cloud Computing

Delay-Optimal Computation Offloading for Computation-Constrained Mobile Edge Networks.

Computation Offloading for Multi-server Multi-access Edge Vehicular Networks: A DDQN-based Method

A Density-Based Offloading Strategy for IoT Devices in Edge Computing Systems

Closed-Form Delay-Optimal Computation Offloading in Mobile Edge Computing Systems

Dynamic Offloading Method for Mobile Edge Computing of Internet of Vehicles Based on Multi-Vehicle Users and Multi-MEC Servers

A Game-Based Computation Offloading Method in Vehicular Multiaccess Edge Computing Networks

Reinforcement Learning Based Computation Migration for Vehicular Cloud Computing

Distributed Task Offloading Game in Multiserver Mobile Edge Computing Networks

Collaborative Mobile Computation Offloading to Vehicle-Based Cloudlets

QoS and Fairness Oriented Dynamic Computation Offloading in the Internet of Vehicles based on Estimate Time of Arrival

Deep Deterministic Policy Gradient-Based Algorithm for Computation Offloading in IoV

Self-Learning Based Computation Offloading for Internet of Vehicles: Model and Algorithm

Exploiting Moving Intelligence: Delay-Optimized Computation Offloading in Vehicular Fog Networks.

Joint Optimization of Computation Offloading and Task Scheduling in Vehicular Edge Computing Networks

Adaptive Computation Offloading Policy for Multi-Access Edge Computing in Heterogeneous Wireless Networks

Multi-mobile vehicles task offloading for vehicle-edge-cloud collaboration: A dependency-aware and deep reinforcement learning approach

Dynamic NOMA-Based Computation Offloading in Vehicular Platoons

Volunteer Assisted Collaborative Offloading and Resource Allocation in Vehicular Edge Computing