Abstract:Caching the most likely to be requested content at the mobile devices in a cooperative manner can facilitate direct content delivery without fetching content from the remote content server and thus alleviate the user-perceived latency, reduce the burden on backhaul and minimize the duplicated content transmissions. In addition to content popularity, it is also essential to consider the users' dynamic behaviour for real-time applications, which can further improve the communication chances between user devices, leading to efficient content service time. The majority of previous studies consider stationary network topologies, in which all users remain stationary during data transmission, and the user can receive desired content from the corresponding base station. In this work, we study an essential issue: caching content by taking advantage of user mobility and the randomness of user interaction time. In a cooperative caching problem, we consider a realistic scenario with user devices moving at various velocities. We formulate the cache placement problem as maximization of saved delay with capacity and deadline constraints by considering the contact duration and inter-contact time among the user devices. We designed on-policy learning integrated fuzzy logic-based caching scheme to solve the high dimensionality of the proposed Integer linear programming problem. The proposed caching schemes improve the long-term reward and higher convergence rate than the Q-learning mechanism. Extensive simulation results demonstrate that the proposed cooperative caching mechanism significantly improves the performance in terms of reward, acceleration ratio, hit ratio and offloading ratio compared with existing mechanisms.

Reinforcement-Learning-Based Optimization for Content Delivery Policy in Cache-Enabled HetNets

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

A Reinforcement Learning Approach for D2D-Assisted Cache-Enabled HetNets

Delay-Aware Content Delivery With Deep Reinforcement Learning in Internet of Vehicles

Reinforcement Learning Based Content Push Policy for HetNets with Energy Harvesting Small Cells.

A Q-Learning Based Scheme to Securely Cache Content in Edge-Enabled Heterogeneous Networks

Stochastic Content-Centric Multicast Scheduling for Cache-Enabled Heterogeneous Cellular Networks

Delay-Optimal Edge Cache Replacement with Non-Markovian Content Fetching

Distributed Cache Replacement for Caching-Enable Base Stations in Cellular Networks.

Joint Content Popularity Prediction And Content Delivery Policy For Cache-Enabled D2d Networks: A Deep Reinforcement Learning Approach

Joint Optimization of Preference-Aware Caching and Content Migration in Cost-Efficient Mobile Edge Networks

Optimal Cooperative Content Caching and Delivery Policy for Heterogeneous Cellular Networks

Analysis on Cache-enabled Wireless Heterogeneous Networks

A Deep Reinforcement Learning Approach for Dynamic Contents Caching in HetNets

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Multi-Agent Reinforcement Learning for Cooperative Coded Caching via Homotopy Optimization

Double Coded Caching in Ultra Dense Networks: Caching and Multicast Scheduling Via Deep Reinforcement Learning.

Combining Lyapunov Optimization and Deep Reinforcement Learning for D2D Assisted Heterogeneous Collaborative Edge Caching

Optimal Content Placement for Offloading in Cache-enabled Heterogeneous Wireless Networks

Deadline-Aware Cache Placement Scheme Using Fuzzy Reinforcement Learning in Device-to-Device Mobile Edge Networks

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning