Abstract:With the rapid development of Internet of vehicles (IoV) and the continuous emergence of vehicle information applications, the demand for content in vehicle networking is growing at an alarming speed. Mobile vehicular edge caching is regarded as a promising technology in improving Quality of Service (QoS) and reducing latency. Many caching algorithms have been proposed, which usually place contents in the Road Side Units (RSUs) to provide services to users near them. However, due to the high-speed movement of vehicles and limitations of RSU coverage, caching interrupts often occur frequently, leading to a deterioration in service quality. To deal with this problem, we make full use of Vehicle-to-Vehicle (V2V) collaboration to construct a caching system which does not require RSU support, and propose a Recursive Deep Reinforcement Learning based Collaborative Caching Relay strategy (RDRL-CR). On purpose to minimize the service delay under capacity constraints, the caching problem is formulated as an integer linear programming problem, and caching decisions are achieved through partially observable Markov Decision Process (MDP). Specifically, this strategy utilizes a Graph Neural Network (GNN) to predict vehicle trajectories, and then selects vehicles that can serve as caching nodes by calculating link stability metrics between vehicles. The Long Short Term Memory (LSTM) network is embedded into a deep deterministic strategy gradient algorithm to achieve the final caching decision. Compared with existing caching strategies, the proposed caching strategy in this paper improves the caching hit rate by about 25% and reduces content access latency by about 20%.

Deep Reinforcement Learning for Cooperative Edge Caching in Vehicular Networks

Deep Reinforcement Learning for Cooperative Content Caching in Vehicular Edge Computing and Networks.

Deep Reinforcement Learning-based Edge Caching and Multi-link Cooperative Communication in Internet-of-Vehicles

Deep Reinforcement Learning for Social-Aware Edge Computing and Caching in Urban Informatics

Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks.

Reinforcement Learning Policy for Adaptive Edge Caching in Heterogeneous Vehicular Network.

Collaborative caching relay algorithm based on recursive deep reinforcement learning in mobile vehicle edge network

Novel Edge Caching Approach Based on Multi-Agent Deep Reinforcement Learning for Internet of Vehicles

Mobility Prediction Based Vehicular Edge Caching: A Deep Reinforcement Learning Based Approach.

Multi-Agent Deep Reinforcement Learning-Based Cooperative Edge Caching for Ultra-Dense Next-Generation Networks

Mobility-Aware Cooperative Caching in Vehicular Edge Computing Based on Asynchronous Federated and Deep Reinforcement Learning

Proactive Caching in Auto Driving Scene Via Deep Reinforcement Learning.

Asynchronous Federated Learning for Vehicular Edge Caching of Consumer Content

Deep Reinforcement Learning-Based Edge Caching in Single-Cell Wireless Networks

Collaborative Edge Computing and Caching in Vehicular Networks

Efficient Vehicular Edge Computing: A Novel Approach With Asynchronous Federated and Deep Reinforcement Learning for Content Caching in VEC

Deep Reinforcement Learning for Collaborative Edge Computing in Vehicular Networks

Asynchronous Federated and Reinforcement Learning for Mobility-Aware Edge Caching in IoV

Integrated Networking, Caching, and Computing for Connected Vehicles: A Deep Reinforcement Learning Approach

Cooperative Edge-Cloud Caching for Real-time Sensing Big Data Search in Vehicular Networks.

Federated Deep Reinforcement Learning for Internet of Things with Decentralized Cooperative Edge Caching.