Abstract:Abstract Internet of Things devices generate a large number of heterogeneous workloads in real-time that require specific application to tackle, and the inability to communicate between devices and communication base stations due to complex scenarios is a thorny issue. Service caching play a key role in managing specific-request workload from devices, and unmanned aerial vehicles with computation and communication functions can effectively solve communication barrier between devices and ground base stations. In addition, the joint optimization of workload offloading and service cache placement is a key issue. Accordingly, we design an unmanned aerial vehicle-enabled mobile edge computing system with multiple devices, unmanned aerial vehicles and edge servers. The proposed framework takes into account the randomness of workload arrival, the time-varying nature of channel states, the limitations of the hosting service caching, and wireless communication blocking. Furthermore, we designed workload offloading and service caching hosting decision-making optimization problems to minimize the long-term weighted average latency and energy consumption costs. To tackle this joint optimization problem, we propose a request-specific workload offloading and service caching decision-making scheme based on the medley deep reinforcement learning scheme. To this end, the proposed scheme is decomposed into two-stage optimization subproblems: the workload offloading decision-making problem and the service caching hosting selection problem. In terms of the first subproblem, we model each device as a learning agent and propose the workloads offloading decision-making scheme based on multi-agent deep deterministic policy gradient. For the second subproblem, we present the decentralized double deep Q-learning scheme to tackle the service caching hosting policy. According to the comprehensive experimental results, the proposed scheme is able to converge rapidly on various parameter configurations and whose performance surpasses the other four baseline learning algorithms.

Latency and Reliability Oriented Collaborative Optimization for Multi-UAV Aided Mobile Edge Computing System

Joint Offloading and Trajectory Design for UAV-Enabled Mobile Edge Computing Systems

Latency Minimization for UAV-Enabled URLLC-Based Mobile Edge Computing Systems

QoE Maximization for Multiple-UAV-Assisted Multi-Access Edge Computing: An Online Joint Optimization Approach

Heterogeneous UAVs assisted mobile edge computing for energy consumption minimization of the edge side

Energy Efficient Resource Allocation in UAV-Enabled Mobile Edge Computing Networks

Optimal Communication-Computing-Caching for Maximizing Revenue in UAV-Aided Mobile Edge Computing

Intelligent task offloading and collaborative computation in multi-UAV-enabled mobile edge computing

Collaboration in the Sky: A Distributed Framework for Task Offloading and Resource Allocation in Multi-Access Edge Computing

Energy-Efficient Resource Management for Multi-UAV-Enabled Mobile Edge Computing

Minimizing Maximum Latency of Task Offloading for Multi-UAV-Assisted Maritime Search and Rescue

Medley deep reinforcement learning-based workload offloading and cache placement decision in UAV-enabled MEC networks

Multi-objective Optimization for Multi-UAV-assisted Mobile Edge Computing

Resource Allocation and Offloading Strategy for UAV-Assisted LEO Satellite Edge Computing

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

Joint Trajectory and Resource Optimization for UAV and D2D-enabled Heterogeneous Edge Computing Networks

Multi-UAV-Enabled Mobile-Edge Computing for Time-Constrained IoT Applications

Min-Max Latency Minimization for Energy-Constrained Multi-UAV Mobile Edge Computing

An UAV and EV based mobile edge computing system for total delay minimization

Joint Optimization on Trajectory, Computation and Communication resources in Information Freshness Sensitive MEC System

Multi-UAV-Enabled Load-Balance Mobile-Edge Computing for IoT Networks