Abstract:Edge caching is a promising technology to reduce backhaul strain and content access delay in Internet of Vehicles (IoV). It precaches frequently used contents close to vehicles through intermediate roadside units. Previous edge caching works often assume that content popularity is known in advance or obeys simplified models. However, such assumptions are unrealistic, as content popularity varies with uncertain spatial-temporal traffic demands in IoVs. Federated learning (FL) enables vehicles to predict popular content with distributed training. It preserves the training data remain local, thereby addressing privacy concerns and communication resource shortages. This article investigates a mobility-aware edge caching strategy by exploiting asynchronous FL and deep reinforcement learning (DRL). We first implement a novel asynchronous FL framework for local updates and global aggregation of stacked autoencoder (SAE) models. Then, utilizing the latent features extracted by the trained SAE model, we adopt a hybrid filtering model for predicting and recommending popular content. Furthermore, we explore intelligent caching decisions after content prediction. Based on the formulated Markov decision process (MDP) problem, we propose a DRL-based solution, and adopt neural network-based parameter approximations for the curse of dimensionality in RL. Extensive simulations are conducted based on real-world data trajectory. Especially, our proposed method outperforms federated averaging, least recently used, and NoDRL, and the edge hit rate is improved by roughly 6%, 21%, and 15%, respectively, when the cache capacity reaches 350 MB.

Deep Reinforcement Learning for Social-Aware Edge Computing and Caching in Urban Informatics

Deep Reinforcement Learning for Cooperative Edge Caching in Vehicular Networks

Deep Reinforcement Learning for Cooperative Content Caching in Vehicular Edge Computing and Networks.

Deep Reinforcement Learning-Based Mobile-Aware Edge Cooperative Caching Scheme in the Internet of Vehicles

Adaptive Task Offloading in Vehicular Edge Computing Networks: a Reinforcement Learning Based Scheme

Novel Edge Caching Approach Based on Multi-Agent Deep Reinforcement Learning for Internet of Vehicles

Deep Reinforcement Learning-based Edge Caching and Multi-link Cooperative Communication in Internet-of-Vehicles

Asynchronous Federated and Reinforcement Learning for Mobility-Aware Edge Caching in IoV

Deep Reinforcement Learning for Collaborative Edge Computing in Vehicular Networks

Adaptive Digital Twin and Multiagent Deep Reinforcement Learning for Vehicular Edge Computing and Networks

Software-Defined Networks with Mobile Edge Computing and Caching for Smart Cities: A Big Data Deep Reinforcement Learning Approach

VeSoNet: Traffic-Aware Content Caching for Vehicular Social Networks Using Deep Reinforcement Learning.

Digital Twin Empowered Content Caching in Social-Aware Vehicular Edge Networks.

Integrated Networking, Caching, and Computing for Connected Vehicles: A Deep Reinforcement Learning Approach

Deep Learning Empowered Task Offloading for Mobile Edge Computing in Urban Informatics

Mobility Prediction Based Vehicular Edge Caching: A Deep Reinforcement Learning Based Approach.

Joint Intelligent Optimization of Task Offloading and Service Caching for Vehicular Edge Computing

Towards Intelligent Adaptive Edge Caching using Deep Reinforcement Learning

Intelligent Driving Task Scheduling Service in Vehicle-Edge Collaborative Networks Based on Deep Reinforcement Learning

Reinforcement Learning Policy for Adaptive Edge Caching in Heterogeneous Vehicular Network.

Mobility-Aware Coded Edge Caching in Vehicular Networks with Dynamic Content Popularity