Abstract:Resource allocation in dense vehicle-to-everything (V2X) communication networks poses intricate challenges due to scalability issues, dynamic environments, and diverse quality of service requirements. Traditional optimizations like genetic algorithms struggle with computational complexity and dynamic planning. Meanwhile, pure multi-agent reinforcement learning (MARL)—a type of machine learning where multiple agents learn to optimize their decisions through interactions with each other and the environment—faces the curse of dimensionality and communication overhead, which limits the large-scale deployment of dynamic vehicular networks. This paper proposes an innovative approach to joint spectrum allocation and power control within dense V2X networks, conceptualizing it as an MARL-based multi-objective optimization problem. To mitigate computational demands, we adopt a hybrid approach combining centralized-training-with-decentralized-execution paradigm, alongside parameter-sharing techniques, within classic Mean-Field MARL (MF-MARL) framework, and name it Scalable-V2X-MF-MARL (ScalV-MF-MARL), enabling a lightweight training process in dense V2X networks with numerous V2V agents. It also technically encodes observations and mean field of actions, thereby enhancing the model's dynamism and scalability. This advancement permits the application of a single model across varying vehicle densities. Experimental results demonstrate that ScalV-MF-MARL achieves 99.5% of the performance of density-specific MF-MARL models, while reducing GPU memory usage by 79.49% to 94.03% during training as vehicle number increases from 40 to 160. Additionally, it outstrips conventional algorithms. Its generalization capabilities across diverse V2X network densities facilitate training in less dense scenarios, with seamless application to denser networks. In conclusion, ScalV-MF-MARL streamlines the V2X network deployment and effectively handles dynamic changes in vehicle numbers.

Multi-Agent Reinforcement Learning-Based Decentralized Spectrum Access in Vehicular Networks with Emergent Communication

Multi-Agent RL Enables Decentralized Spectrum Access in Vehicular Networks

Cooperative Spectrum Sensing Approach in C-V2X based on Multi-Agent Reinforcement Learning.

Resource Allocation in V2X Communications Based on Multi-Agent Reinforcement Learning with Attention Mechanism

A Hybrid Multi-Agent Reinforcement Learning Approach for Spectrum Sharing in Vehicular Networks

Multi-Agent Reinforcement Learning for Multi-Cell Spectrum and Power Allocation

Federated Multi-Agent Deep Reinforcement Learning for Resource Allocation of Vehicle-to-Vehicle Communications

Energy-Efficient Resource Allocation for V2X Communications

Multi-agent Reinforcement Learning Based Resource Allocation for Vehicular Networks.

A Scalable Mean-Field MARL Framework for Multi-Objective V2X Resource Allocation

Distributed and Coordinated Multi-Agent Learning for Resource Allocation in Vehicular Networks

Matching Combined Heterogeneous Multi-Agent Reinforcement Learning for Resource Allocation in NOMA-V2X Networks

Multi-Agent Reinforcement Learning Connectivity Optimization Algorithm in Vehicular Networks

Optimization of Resource Allocation for V2X Security Communication based on Multi-Agent Reinforcement Learning

Learning Based Multi-Channel Access in Vehicular Networks With Illegal Operators and Users

Deep Reinforcement Learning Based Wireless Resource Allocation for V2X Communications

Multi-agent Deep Reinforcement Learning Based Resource Management in Heterogeneous V2X Networks

Platoon Leader Selection, User Association and Resource Allocation on a C-V2X based highway: A Reinforcement Learning Approach

Traffic-driven Spectrum and Power Allocation Via Scalable Multi-Agent Reinforcement Learning

Decentralized Multi-Agent DQN-Based Resource Allocation for Heterogeneous Traffic in V2X Communications

Multi-Agent Reinforcement Learning-Based Cooperative Beam Selection in Mmwave Vehicular Networks