Abstract:With the rapid development of smart city and 5C, user demand for Internet services has increased exponentially. Through collaborative content sharing, the storage limitation of a single edge server (ES) can be broken. However, when mobile users need to download the whole content through multiple regions, independently deciding the caching content for ESs in different regions may result in redundant caching. Furthermore, frequent switching of communication connection during user movement also causes retransmission delay. As a revolutionary approach in the artificial intelligence field, deep reinforcement learning (DRL) has earned great success in solving high-dimensional and network resource management related problems. Therefore, we integrate collaborative caching and DRL to build an intelligent edge caching framework, so as to realize collaborative caching between cloud and ESs. In this caching framework, a fed-erated-machine-learning-based user behavior prediction model is first designed to characterize the content preference and movement trajectory of mobile users. Next, to achieve efficient resource aggregation of ESs, a user-behavior-aware dynamic collaborative caching domain (DCCD) construction and management mechanism is devised to divide ESs into clusters, select cluster heads, and set the re-clustering rules. Then a DRL-based content caching and delivery algorithm is presented to decide the caching content of ESs in a DCCD from a global perspective and plan the transmission path for users, which reduces redundant content and transmission delay. Especially when a user request cannot be satisfied by the current DCCD, a cross-domain content delivery strategy is presented to allow ESs in other DCCDs to provide and forward content to the user, avoiding the traffic pressure and delay caused by requesting services from cloud. The simulation results show that the proposed collaborative caching framework can improve user satisfaction in terms of content hit rate an- service delay.

Mobility-Aware Cooperative Caching in Vehicular Edge Computing Based on Asynchronous Federated and Deep Reinforcement Learning

Efficient Vehicular Edge Computing: A Novel Approach With Asynchronous Federated and Deep Reinforcement Learning for Content Caching in VEC

Asynchronous Federated Learning for Vehicular Edge Caching of Consumer Content

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Network

Cooperative Edge Caching Based on Elastic Federated and Multi-Agent Deep Reinforcement Learning in Next-Generation Networks

Collaborative caching relay algorithm based on recursive deep reinforcement learning in mobile vehicle edge network

Deep Reinforcement Learning-based Edge Caching and Multi-link Cooperative Communication in Internet-of-Vehicles

DRL-based Content Caching Strategy With Efficient User Preference Predictions in UAV-assisted VEC

Mobility-Aware Asynchronous Federated Learning for Edge-Assisted Vehicular Networks.

Low-latency caching with auction game in vehicular edge computing.

Intelligent Caching for Vehicular Dew Computing in Poor Network Connectivity Environments

A Mobility-Aware Vehicular Caching Scheme in Content Centric Networks: Model and Optimization

Proactive Content Caching Scheme in Urban Vehicular Networks

Cooperative Caching in Vehicular Content Centric Network Based on Social Attributes and Mobility

Deep Reinforcement Learning Based Vehicle Selection for Asynchronous Federated Learning Enabled Vehicular Edge Computing

Reinforcement learning for cost-effective IoT service caching at the edge

MECC: A Mobile Edge Collaborative Caching Framework Empowered by Deep Reinforcement Learning

Novel Edge Caching Approach Based on Multi-Agent Deep Reinforcement Learning for Internet of Vehicles

Mobility-aware Proactive Edge Caching for Large Files in the Internet of Vehicles

Cooperative caching algorithm for mobile edge networks based on multi-agent meta reinforcement learning

Content Caching-Assisted Vehicular Edge Computing Using Multi-Agent Graph Attention Reinforcement Learning