Abstract:Resource allocation in dense vehicle-to-everything (V2X) communication networks poses intricate challenges due to scalability issues, dynamic environments, and diverse quality of service requirements. Traditional optimizations like genetic algorithms struggle with computational complexity and dynamic planning. Meanwhile, pure multi-agent reinforcement learning (MARL)—a type of machine learning where multiple agents learn to optimize their decisions through interactions with each other and the environment—faces the curse of dimensionality and communication overhead, which limits the large-scale deployment of dynamic vehicular networks. This paper proposes an innovative approach to joint spectrum allocation and power control within dense V2X networks, conceptualizing it as an MARL-based multi-objective optimization problem. To mitigate computational demands, we adopt a hybrid approach combining centralized-training-with-decentralized-execution paradigm, alongside parameter-sharing techniques, within classic Mean-Field MARL (MF-MARL) framework, and name it Scalable-V2X-MF-MARL (ScalV-MF-MARL), enabling a lightweight training process in dense V2X networks with numerous V2V agents. It also technically encodes observations and mean field of actions, thereby enhancing the model's dynamism and scalability. This advancement permits the application of a single model across varying vehicle densities. Experimental results demonstrate that ScalV-MF-MARL achieves 99.5% of the performance of density-specific MF-MARL models, while reducing GPU memory usage by 79.49% to 94.03% during training as vehicle number increases from 40 to 160. Additionally, it outstrips conventional algorithms. Its generalization capabilities across diverse V2X network densities facilitate training in less dense scenarios, with seamless application to denser networks. In conclusion, ScalV-MF-MARL streamlines the V2X network deployment and effectively handles dynamic changes in vehicle numbers.

Optimization of Resource Allocation for V2X Security Communication based on Multi-Agent Reinforcement Learning

Multi-agent Reinforcement Learning Based Resource Allocation for Vehicular Networks.

Deep Reinforcement Learning Based Wireless Resource Allocation for V2X Communications

Multi-Agent Reinforcement Learning-Based Resource Management for V2X Communication.

Resource Allocation in V2X Communications Based on Multi-Agent Reinforcement Learning with Attention Mechanism

Energy-Efficient Resource Allocation for V2X Communications

Deep Learning based Wireless Resource Allocation with Application to Vehicular Networks

Multi-Agent Reinforcement Learning-Based Decentralized Spectrum Access in Vehicular Networks with Emergent Communication

Decentralized Multi-Agent DQN-Based Resource Allocation for Heterogeneous Traffic in V2X Communications

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

Multi-Agent RL Enables Decentralized Spectrum Access in Vehicular Networks

Multi-agent Deep Reinforcement Learning Based Resource Management in Heterogeneous V2X Networks

Two-Timescale Resource Management for Ultrareliable and Low-Latency Vehicular Communications

A Scalable Mean-Field MARL Framework for Multi-Objective V2X Resource Allocation

Joint Resource Allocation for V2X Communications with Multi-Type Mean-Field Reinforcement Learning

Deep Reinforcement Learning for Resource Allocation in V2V Communications

Enabling Adaptive Optimization of Energy Efficiency and Quality of Service in NR-V2X Communications Via Multi-agent Deep Reinforcement Learning

Deep Reinforcement Learning Based Mode Selection and Resource Allocation for Cellular V2X Communications

Resource Allocation in Vehicular Networks Based on Federated Multi-Agent Reinforcement Learning

Resource Allocation for Delay-Sensitive Vehicle-to-Multi-Edges (v2es) Communications in Vehicular Networks: A Multi-Agent Deep Reinforcement Learning Approach.

Joint Resource Allocation for UAV-assisted V2X Communication with Mean Field Multi-Agent Reinforcement Learning