Abstract:Caching the most likely to be requested content at the mobile devices in a cooperative manner can facilitate direct content delivery without fetching content from the remote content server and thus alleviate the user-perceived latency, reduce the burden on backhaul and minimize the duplicated content transmissions. In addition to content popularity, it is also essential to consider the users' dynamic behaviour for real-time applications, which can further improve the communication chances between user devices, leading to efficient content service time. The majority of previous studies consider stationary network topologies, in which all users remain stationary during data transmission, and the user can receive desired content from the corresponding base station. In this work, we study an essential issue: caching content by taking advantage of user mobility and the randomness of user interaction time. In a cooperative caching problem, we consider a realistic scenario with user devices moving at various velocities. We formulate the cache placement problem as maximization of saved delay with capacity and deadline constraints by considering the contact duration and inter-contact time among the user devices. We designed on-policy learning integrated fuzzy logic-based caching scheme to solve the high dimensionality of the proposed Integer linear programming problem. The proposed caching schemes improve the long-term reward and higher convergence rate than the Q-learning mechanism. Extensive simulation results demonstrate that the proposed cooperative caching mechanism significantly improves the performance in terms of reward, acceleration ratio, hit ratio and offloading ratio compared with existing mechanisms.

A Networked Multi-Agent Reinforcement Learning Approach for Cooperative FemtoCaching Assisted Wireless Heterogeneous Networks

Deep Reinforcement Learning for Cooperative Coded Caching Strategy in Fog Radio Access Network

Dual-Mode User-Centric Open-Loop Cooperative Caching for Backhaul-Limited Small-Cell Wireless Networks.

Cooperative Caching and Fetching in D2D Communications - A Fully Decentralized Multi-Agent Reinforcement Learning Approach

Cooperative Cache in Cognitive Radio Networks: A Heterogeneous Multi-Agent Learning Approach

Caching and Computing Resource Allocation in Cooperative Heterogeneous 5G Edge Networks Using Deep Reinforcement Learning

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Cooperative caching algorithm for mobile edge networks based on multi-agent meta reinforcement learning

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Network

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Networks

Multi-Agent Reinforcement Learning for Cooperative Coded Caching via Homotopy Optimization

Joint Optimization of Cooperative Edge Caching and Radio Resource Allocation in 5G-Enabled Massive IoT Networks

Toward Smart and Cooperative Edge Caching for 5G Networks: A Deep Learning Based Approach

Multi-agent Learning for Cooperative Large-scale Caching Networks

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Deadline-Aware Cache Placement Scheme Using Fuzzy Reinforcement Learning in Device-to-Device Mobile Edge Networks

A Joint Reinforcement-Learning Enabled Caching and Cross-Layer Network Code in F-RAN with D2D Communications

A Cooperative Caching System in Heterogeneous Edge Networks

Latency Analysis of Cooperative Caching with Multicast for 5G Wireless Networks

Joint Cache Allocation and Replacement for Content-Centric Network-Based Private 5G Networks: Deep Reinforcement Learning Approach

A Multi-Agent Reinforcement Learning Approach for Massive Access in NOMA-URLLC Networks