Abstract:In emergency scenarios, strong mobility and serious interference cause unstable transmission of on-site information such as close-up photos and high resolution videos, which requires a robust temporary communication network. In this paper, we focus on a UAV-assisted wireless cooperative communication and coded caching network, where emergency command vehicles and a UAV serve as content providers (CPs) to cache and transmit coded fragments or complete files for rescuers regarded as content requesters (CRs). The delivery success probability and content hit ratio are theoretically derived by incorporating the physical connectivity and social relationship between CPs and CRs. Aiming at maximizing the overall content hit ratio, we propose a multiagent two-timescale deep reinforcement learning (MA2T-DRL) algorithm to jointly optimize the transmission power and caching strategies for CPs. Specifically, we develop a two tier deep-Q networks (DQNs) framework integrating a slow-timescale DQN (ST-DQN) and a fast-timescale DQN (FT-DQN) for caching decision-making and power decision-making respectively, and then the QMIX framework is leveraged to aggregate all the outputs from local ST-DQNs. Considering the cooperative characteristics of coded caching, we further propose a novel clustering method for CPs such that CPs in the same cluster have the same willingness to serve CRs, and each cluster is regarded as the agent for training which further reduces the aggregation scale of the mixing network. Simulation results show that the proposed MA2T-DRL algorithm is efficient in model training, and presents the advantages in performance and complexity compared with the single-agent centralized training and the multiagent independent distributed training.

Reinforcement Learning Based Cooperative Coded Caching under Dynamic Popularities in Ultra-Dense Networks

Deep Reinforcement Learning for Cooperative Coded Caching Strategy in Fog Radio Access Network

Multi-Agent Reinforcement Learning for Cooperative Coded Caching via Homotopy Optimization

Double Coded Caching in Ultra Dense Networks: Caching and Multicast Scheduling Via Deep Reinforcement Learning.

Multi-Agent Deep Reinforcement Learning-Based Cooperative Edge Caching for Ultra-Dense Next-Generation Networks

Dynamic Coded Caching in Wireless Networks Using Multi-Agent Reinforcement Learning

Accelerated Deep Reinforcement Learning for Wireless Coded Caching

Deep Learning for Wireless Coded Caching with Unknown and Time-Variant Content Popularity

Cluster Based Deep Reinforcement Learning for Wireless Caching with Social Connection Awareness

Mean-Field Game Theoretic Edge Caching in Ultra-Dense Networks

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks.

Pareto-Optimal Multi-Agent Cooperative Caching Relying on Multi-Policy Reinforcement Learning

A Reinforcement Learning Based Smart Cache Strategy for Cache-Aided Ultra-Dense Network.

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Exploiting Deep Reinforcement Learning for Edge Caching in Cell-Free Massive MIMO Systems

Multi-Agent Reinforcement Learning for Efficient Content Caching in Mobile D2D Networks

Deep Reinforcement Learning for Cooperative Content Caching in Vehicular Edge Computing and Networks.

A Learning-Based Approach for Proactive Caching in Wireless Communication Networks.

UAV-Assisted Wireless Cooperative Communication and Coded Caching: A Multiagent Two-Timescale DRL Approach

A Reinforcement Learning Approach for D2D-Assisted Cache-Enabled HetNets