Abstract:The Internet of Vehicles (IoV) has witnessed a substantial surge in its expansion during recent years, with the integration of edge servers emerging as an increasingly prevalent practice to cater to content requests that demand a superior quality of service. Nonetheless, conventional cache policies often prove inadequate for IoV applications, primarily due to their incapacity to effectively handle a diverse array of content requests, the high-speed mobility of vehicles, and the inherent instability of network connections. Within the scope of this study, we commence by bifurcating various content requests into two distinct categories: latency-sensitive content request and bandwidth-sensitive content request. Subsequently, we establish a model to evaluate the service quality under the joint consideration of different types of content requests, the mobility of vehicles and storage capacity of edge nodes. Furthermore, we transform the quality-of-service (QoS) penalty function into a system reward function. This adaption enables us to propose an innovative edge cache scheme founded upon the Deep Deterministic Policy Gradient (DDPG) algorithm of Reinforcement Learning (RL) method, which empowers dynamic adjustments in response to the evolving IoV environment. To validate the effectiveness of our proposed approach, we harness the Simulation of Urban Mobility (SUMO) traffic simulation software and construct a traffic road scenario based on a specific part segment of Nanjing Beltway. A wide-ranging set of contrast experiments was performed to ensure the improved performance of the DDPG based deep reinforcement learning method. Simulation experimental results show that the proposed algorithm converges quickly and outperforms existing algorithms in terms of service quality-hit ratio for latency-sensitive content and transmission speed for bandwidth-sensitive content.

Delay-Aware Caching in Internet-of-Vehicles Networks

Delay-Aware Content Delivery With Deep Reinforcement Learning in Internet of Vehicles

Intelligent Caching for Vehicular Dew Computing in Poor Network Connectivity Environments

A joint optimization scheme of content caching and resource allocation for internet of vehicles in mobile edge computing

Two-Layer Distributed Content Caching for Infotainment Applications in VANETs

Novel Edge Caching Approach Based on Multi-Agent Deep Reinforcement Learning for Internet of Vehicles

Edge collaborative caching solution based on improved NSGA II algorithm in Internet of Vehicles

Delay-Optimal Edge Cache Replacement with Non-Markovian Content Fetching

In-Vehicle Caching (Iv-Cache) Via Dynamic Distributed Storage Relay (D<inline-Formula> &Lt;tex-Math Notation="latex">$^2$</tex-Math> &Lt;/inline-Formula>sr) in Vehicular Networks

Delay-Aware Cache-Enabled Cooperative D2D Transmission in Mobile Cellular Networks

Asynchronous Coded Caching Strategy With Nonuniform Demands for IoV Networks.

Faster Content Delivery using RSU Caching and Vehicular Pre-caching in Vehicular Networks

Proactive Content Caching Scheme in Urban Vehicular Networks

Efficient content caching for 5G assisted vehicular networks

An Intelligent Caching Strategy Considering Time-Space Characteristics in Vehicular Named Data Networks

Towards Fresh And Low-Latency Content Delivery In Vehicular Networks: An Edge Caching Aspect

Cooperative Edge Caching with Location-Based and Popular Contents for Vehicular Networks.

Simulation based QoS aware dynamic caching scheme for heterogeneous content requests in vehicular edge computing

Edge Caching to Deliver Mobile Content in Vehicular Ad Hoc Networks

Delay-Optimal Edge Caching with Imperfect Content Fetching Via Stochastic Learning

Computation Offloading and Content Caching with Traffic Flow Prediction for Internet of Vehicles in Edge Computing