Abstract:Abstract Internet of Things devices generate a large number of heterogeneous workloads in real-time that require specific application to tackle, and the inability to communicate between devices and communication base stations due to complex scenarios is a thorny issue. Service caching play a key role in managing specific-request workload from devices, and unmanned aerial vehicles with computation and communication functions can effectively solve communication barrier between devices and ground base stations. In addition, the joint optimization of workload offloading and service cache placement is a key issue. Accordingly, we design an unmanned aerial vehicle-enabled mobile edge computing system with multiple devices, unmanned aerial vehicles and edge servers. The proposed framework takes into account the randomness of workload arrival, the time-varying nature of channel states, the limitations of the hosting service caching, and wireless communication blocking. Furthermore, we designed workload offloading and service caching hosting decision-making optimization problems to minimize the long-term weighted average latency and energy consumption costs. To tackle this joint optimization problem, we propose a request-specific workload offloading and service caching decision-making scheme based on the medley deep reinforcement learning scheme. To this end, the proposed scheme is decomposed into two-stage optimization subproblems: the workload offloading decision-making problem and the service caching hosting selection problem. In terms of the first subproblem, we model each device as a learning agent and propose the workloads offloading decision-making scheme based on multi-agent deep deterministic policy gradient. For the second subproblem, we present the decentralized double deep Q-learning scheme to tackle the service caching hosting policy. According to the comprehensive experimental results, the proposed scheme is able to converge rapidly on various parameter configurations and whose performance surpasses the other four baseline learning algorithms.

DRL-based Content Caching Strategy With Efficient User Preference Predictions in UAV-assisted VEC

Efficient Vehicular Edge Computing: A Novel Approach With Asynchronous Federated and Deep Reinforcement Learning for Content Caching in VEC

Content Fetching Delay Optimization-Based Caching and Resource Allocation for UAV-Enabled Networks

Cache Sharing in UAV-Enabled Cellular Network: A Deep Reinforcement Learning-Based Approach

Caching Placement Optimization in UAV-assisted Cellular Networks: A Deep Reinforcement Learning based Framework

Mobility-Aware Cooperative Caching in Vehicular Edge Computing Based on Asynchronous Federated and Deep Reinforcement Learning

Caching in the Sky: Proactive Deployment of Cache-Enabled Unmanned Aerial Vehicles for Optimized Quality-of-Experience

UAV Edge Caching Content Recommendation Algorithm Based on Graph Neural Network

Medley deep reinforcement learning-based workload offloading and cache placement decision in UAV-enabled MEC networks

Collaborative caching relay algorithm based on recursive deep reinforcement learning in mobile vehicle edge network

Probabilistic Caching Strategy and TinyML-Based Trajectory Planning in UAV-Assisted Cellular IoT System

Novel Edge Caching Approach Based on Multi-Agent Deep Reinforcement Learning for Internet of Vehicles

UAV-Assisted Wireless Cooperative Communication and Coded Caching: A Multiagent Two-Timescale DRL Approach

Resource Allocation in UAV-D2D Networks: A Scalable Heterogeneous Multi-Agent Deep Reinforcement Learning Approach

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning

A Federated Deep Reinforcement Learning-based Low-power Caching Strategy for Cloud-edge Collaboration

A novel user preference-aware content caching algorithm in mobile edge networks

Optimal Probabilistic Collaborative Caching in UAV-Assisted Vehicular Networks

Asynchronous Federated Learning for Vehicular Edge Caching of Consumer Content

Proactive Content Caching Scheme in Urban Vehicular Networks

Energy-efficient Caching and Task offloading for Timely Status Updates in UAV-assisted VANETs