Abstract:With the rapid development of Internet of vehicles (IoV) and the continuous emergence of vehicle information applications, the demand for content in vehicle networking is growing at an alarming speed. Mobile vehicular edge caching is regarded as a promising technology in improving Quality of Service (QoS) and reducing latency. Many caching algorithms have been proposed, which usually place contents in the Road Side Units (RSUs) to provide services to users near them. However, due to the high-speed movement of vehicles and limitations of RSU coverage, caching interrupts often occur frequently, leading to a deterioration in service quality. To deal with this problem, we make full use of Vehicle-to-Vehicle (V2V) collaboration to construct a caching system which does not require RSU support, and propose a Recursive Deep Reinforcement Learning based Collaborative Caching Relay strategy (RDRL-CR). On purpose to minimize the service delay under capacity constraints, the caching problem is formulated as an integer linear programming problem, and caching decisions are achieved through partially observable Markov Decision Process (MDP). Specifically, this strategy utilizes a Graph Neural Network (GNN) to predict vehicle trajectories, and then selects vehicles that can serve as caching nodes by calculating link stability metrics between vehicles. The Long Short Term Memory (LSTM) network is embedded into a deep deterministic strategy gradient algorithm to achieve the final caching decision. Compared with existing caching strategies, the proposed caching strategy in this paper improves the caching hit rate by about 25% and reduces content access latency by about 20%.

Distributed Caching in Converged Networks: A Deep Reinforcement Learning Approach

Distributed Caching Popular Services by Using Deep Q-Learning in Converged Networks

Deep Reinforcement Learning for Cooperative Coded Caching Strategy in Fog Radio Access Network

Distributed Cache Replacement for Caching-Enable Base Stations in Cellular Networks.

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks

Deep Reinforcement Learning for Adaptive Caching in Hierarchical Content Delivery Networks

Exploiting Deep Reinforcement Learning for Edge Caching in Cell-Free Massive MIMO Systems

Distributed Packet Forwarding and Caching Based on Stochastic Network Utility Maximization

Multi-Agent Reinforcement Learning for Cooperative Coded Caching via Homotopy Optimization

Collaborative caching relay algorithm based on recursive deep reinforcement learning in mobile vehicle edge network

Reinforcement Learning Based Cooperative Coded Caching under Dynamic Popularities in Ultra-Dense Networks

Localized Small Cell Caching: A Machine Learning Approach Based on Rating Data

Content Caching at the Wireless Network Edge: A Distributed Algorithm Via Belief Propagation

Hierarchical Deep Reinforcement Learning for Joint Service Caching and Computation Offloading in Mobile Edge-Cloud Computing

Cache-Enabled Dynamic Rate Allocation via Deep Self-Transfer Reinforcement Learning

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Deep Reinforcement Learning-based computation offloading and distributed edge service caching for Mobile Edge Computing

Dynamic Content Update for Wireless Edge Caching via Deep Reinforcement Learning

A Reinforcement-Learning Approach to Proactive Caching in Wireless Networks

Dynamic Coded Caching in Wireless Networks Using Multi-Agent Reinforcement Learning