Abstract:Edge caching is a promising technology to reduce backhaul strain and content access delay in Internet of Vehicles (IoV). It precaches frequently used contents close to vehicles through intermediate roadside units. Previous edge caching works often assume that content popularity is known in advance or obeys simplified models. However, such assumptions are unrealistic, as content popularity varies with uncertain spatial-temporal traffic demands in IoVs. Federated learning (FL) enables vehicles to predict popular content with distributed training. It preserves the training data remain local, thereby addressing privacy concerns and communication resource shortages. This article investigates a mobility-aware edge caching strategy by exploiting asynchronous FL and deep reinforcement learning (DRL). We first implement a novel asynchronous FL framework for local updates and global aggregation of stacked autoencoder (SAE) models. Then, utilizing the latent features extracted by the trained SAE model, we adopt a hybrid filtering model for predicting and recommending popular content. Furthermore, we explore intelligent caching decisions after content prediction. Based on the formulated Markov decision process (MDP) problem, we propose a DRL-based solution, and adopt neural network-based parameter approximations for the curse of dimensionality in RL. Extensive simulations are conducted based on real-world data trajectory. Especially, our proposed method outperforms federated averaging, least recently used, and NoDRL, and the edge hit rate is improved by roughly 6%, 21%, and 15%, respectively, when the cache capacity reaches 350 MB.

Deep Reinforcement Learning for Mobile Edge Caching: Review, New Features, and Open Issues

Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks.

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Deep Reinforcement Learning for Energy-Efficient Edge Caching in Mobile Edge Networks

Content-centric Caching Using Deep Reinforcement Learning in Mobile Computing

Mobility Prediction-Based Wireless Edge Caching Using Deep Reinforcement Learning

Deep Reinforcement Learning-Based Edge Caching in Single-Cell Wireless Networks

Edge Caching for IoT Transient Data Using Deep Reinforcement Learning

A Survey of Deep Learning for Data Caching in Edge Network

Content Update Via Deep Reinforcement Learning in Recommendation-Aware Edge Caching Network

Intelligent Cooperative Caching at Mobile Edge based on Offline Deep Reinforcement Learning

Caching Transient Data for Internet of Things: A Deep Reinforcement Learning Approach

Joint User Scheduling and Content Caching Strategy for Mobile Edge Networks Using Deep Reinforcement Learning

Intelligent Cooperative Caching at Mobile Edge Based on Offline Deep Reinforcement LearningJust Accepted

Data-Intensive Application Deployment at Edge: A Deep Reinforcement Learning Approach

A DQN-Based Cache Strategy for Mobile Edge Networks

Asynchronous Federated and Reinforcement Learning for Mobility-Aware Edge Caching in IoV

Deep Reinforcement Learning-Based Traffic Engineering in Cloud-Edge-End Collaboration Environments

Mobility Prediction Based Vehicular Edge Caching: A Deep Reinforcement Learning Based Approach.

Edge Caching for D2D Enabled Hierarchical Wireless Networks with Deep Reinforcement Learning

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network