Abstract:The Internet of Vehicles (IoV) enables vehicular data services and applications through vehicle-to-everything (V2X) communications. One of the key services provided by IoV is popular content distribution (PCD), which aims to quickly deliver popular content that most vehicles request. However, it is challenging for vehicles to receive the complete popular content from roadside units (RSUs) due to their mobility and the RSUs' constrained coverage. The collaboration of vehicles via vehicle-to-vehicle (V2V) communications is an effective solution to assist more vehicles to obtain the entire popular content at a lower time cost. To this end, we propose a multi-agent deep reinforcement learning (MADRL)-based popular content distribution scheme in vehicular networks, where each vehicle deploys an MADRL agent that learns to choose the appropriate data transmission policy. To reduce the complexity of the MADRL-based algorithm, a vehicle clustering algorithm based on spectral clustering is provided to divide all vehicles in the V2V phase into groups, so that only vehicles within the same group exchange data. Then the multi-agent proximal policy optimization (MAPPO) algorithm is used to train the agent. We introduce the self-attention mechanism when constructing the neural network for the MADRL to help the agent accurately represent the environment and make decisions. Furthermore, the invalid action masking technique is utilized to prevent the agent from taking invalid actions, accelerating the training process of the agent. Finally, experimental results are shown and a comprehensive comparison is provided, which demonstrates that our MADRL-PCD scheme outperforms both the coalition game-based scheme and the greedy strategy-based scheme, achieving a higher PCD efficiency and a lower transmission delay.

Bilateral Content Recommendation for Intelligent Connected Vehicles: Challenges and Applications

Content In Motion: A Novel Relay Scheme For Content Dissemination In Urban Vehicular Networks

An adaptive in-vehicle multimedia recommender for group users

Traffic Big Data Analysis Supporting Vehicular Network Access Recommendation

Content in Motion: An Edge Computing Based Relay Scheme for Content Dissemination in Urban Vehicular Networks

Trust Based Secure Content Delivery in Vehicular Networks: A Bargaining Game Theoretical Approach

Channel Allocation for Adaptive Video Streaming in Vehicular Networks

Restaurant Recommendation in Vehicle Context Based on Prediction of Traffic Conditions

A Reputation-Based Cooperative Content Delivery with Parking Vehicles in Vehicular Ad-Hoc Networks.

Content Recommendation Algorithm for Intelligent Navigator in Fog Computing Based IoT Environment

A Multi-Agent Deep Reinforcement Learning-Based Popular Content Distribution Scheme in Vehicular Networks

Challenges and Solutions in Autonomous Driving: A Blockchain Approach

Wireless Recommendations for Internet of Vehicles: Recent Advances, Challenges, and Opportunities

Collaborative Content Downloading in VANETs with Fuzzy Comprehensive Evaluation.

Deep Learning-Based Business Recommendation System in Intelligent Vehicles

Effective Content Recommendation in New Media: Leveraging Algorithmic Approaches

A Carpooling Recommendation System for Taxicab Services

Content Aided Clustering And Cluster Head Selection Algorithms In Vehicular Networks

Intelligent News Recommendation System for Automobile Based on Bio-Sensing and Physiological Computing

Proactive Content Retrieval Based on Value of Popularity in Content-Centric Internet of Vehicles

Recommendation Technologies for Multimedia Content