Abstract:Abstract Internet of Things devices generate a large number of heterogeneous workloads in real-time that require specific application to tackle, and the inability to communicate between devices and communication base stations due to complex scenarios is a thorny issue. Service caching play a key role in managing specific-request workload from devices, and unmanned aerial vehicles with computation and communication functions can effectively solve communication barrier between devices and ground base stations. In addition, the joint optimization of workload offloading and service cache placement is a key issue. Accordingly, we design an unmanned aerial vehicle-enabled mobile edge computing system with multiple devices, unmanned aerial vehicles and edge servers. The proposed framework takes into account the randomness of workload arrival, the time-varying nature of channel states, the limitations of the hosting service caching, and wireless communication blocking. Furthermore, we designed workload offloading and service caching hosting decision-making optimization problems to minimize the long-term weighted average latency and energy consumption costs. To tackle this joint optimization problem, we propose a request-specific workload offloading and service caching decision-making scheme based on the medley deep reinforcement learning scheme. To this end, the proposed scheme is decomposed into two-stage optimization subproblems: the workload offloading decision-making problem and the service caching hosting selection problem. In terms of the first subproblem, we model each device as a learning agent and propose the workloads offloading decision-making scheme based on multi-agent deep deterministic policy gradient. For the second subproblem, we present the decentralized double deep Q-learning scheme to tackle the service caching hosting policy. According to the comprehensive experimental results, the proposed scheme is able to converge rapidly on various parameter configurations and whose performance surpasses the other four baseline learning algorithms.

Federated Deep Reinforcement Learning-Based Intelligent Dynamic Services in UAV-Assisted MEC

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Semi-Distributed Resource Management in UAV-Aided MEC Systems: A Multi-Agent Federated Reinforcement Learning Approach

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

A Hybrid Task Offloading and Resource Allocation Approach For Digital Twin-Empowered UAV-Assisted MEC Network Using Federated Reinforcement Learning For Future Wireless Network

Multi-UAV Hierarchical Intelligent Traffic Offloading Network Optimization Based on Deep Federated Learning

Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning

Medley deep reinforcement learning-based workload offloading and cache placement decision in UAV-enabled MEC networks

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

Distributed Offloading for Multi-UAV Swarms in MEC-Assisted 5G Heterogeneous Networks

A Deep Reinforcement Learning Based Approach for Optimizing Trajectory and Frequency in Energy Constrained Multi-UAV Assisted MEC System

JO-TADP: Learning-Based Cooperative Dynamic Resource Allocation for MEC–UAV-Enabled Wireless Network

Multi-UAV-Assisted Federated Learning for Energy-Aware Distributed Edge Training

UAV-Enabled Federated Learning in Dynamic Environments: Efficiency and Security Trade-off

Multi-UAV-Enabled Load-Balance Mobile-Edge Computing for IoT Networks

AI Driven Heterogeneous MEC System with UAV Assistance for Dynamic Environment: Challenges and Solutions

Battery-constrained Federated Edge Learning in UAV-enabled IoT for B5G/6G Networks

Multi-objective Deep Reinforcement Learning for Computation offloading in UAV-Assisted Multi-Access Edge Computing

Predictive UAV Base Station Deployment and Service Offloading With Distributed Edge Learning

Deep reinforcement learning based computation offloading for xURLLC services with UAV-assisted IoT-based multi-access edge computing system