Abstract:Efficient spectrum sharing is essential for maximizing data communication performance in Vehicular Networks (VNs). In this article, we propose a novel hybrid framework that leverages Multi-Agent Reinforcement Learning (MARL), thereby combining both centralized and decentralized learning approaches. This framework addresses scenarios where multiple vehicle-to-vehicle (V2V) links reuse the frequency spectrum preoccupied by vehicle-to-infrastructure (V2I) links. We introduce the QMIX technique with the Deep Q Networks (DQNs) algorithm to facilitate collaborative learning and efficient spectrum management. The DQN technique uses a neural network to approximate the Q value function in high-dimensional state spaces, thus mapping input states to (action, Q value) tables that facilitate self-learning across diverse scenarios. Similarly, the QMIX is a value-based technique for multi-agent environments. In the proposed model, each V2V agent having its own DQN observes the environment, receives observation, and obtains a common reward. The QMIX network receives Q values from all agents considering individual benefits and collective objectives. This mechanism leads to collective learning while V2V agents dynamically adapt to real-time conditions, thus improving VNs performance. Our research finding highlights the potential of hybrid MARL models for dynamic spectrum sharing in VNs and paves the way for advanced cooperative learning strategies in vehicular communication environments. Furthermore, we conducted an in-depth exploration of the simulation environment and performance evaluation criteria, thus concluding in a comprehensive comparative analysis with cutting-edge solutions in the field. Simulation results show that the proposed framework efficiently performs against the benchmark architecture in terms of V2V transmission probability and V2I peak data transfer.

Heterogeneous Multi-Agent Reinforcement Learning for Distributed Channel Access in WLANs

Multi-Agent Reinforcement Learning-Based Distributed Channel Access for Next Generation Wireless Networks

Multi-Agent Reinforcement Learning-Based Decentralized Spectrum Access in Vehicular Networks with Emergent Communication

Multi-Agent Reinforcement Learning for Multi-Cell Spectrum and Power Allocation

Online Multi-Agent Reinforcement Learning for Multiple Access in Wireless Networks

Scalable Joint Learning of Wireless Multiple-Access Policies and their Signaling

Traffic-driven Spectrum and Power Allocation Via Scalable Multi-Agent Reinforcement Learning

A Hybrid Multi-Agent Reinforcement Learning Approach for Spectrum Sharing in Vehicular Networks

Multi-Agent Reinforcement Learning based Uplink OFDMA for IEEE 802.11ax Networks

Learning Random Access Schemes for Massive Machine-Type Communication with MARL

Communication-Efficient and Resilient Distributed Q-Learning.

Efficient Communications in Multi-Agent Reinforcement Learning for Mobile Applications

Mobility-Aware Resource Allocation for mmWave IAB Networks: A Multi-Agent Reinforcement Learning Approach

Heterogeneous Wireless Resources On-demand Access Distributed Decision Based on Spectrum Sensing

Multi-agent Q-learning Based Admission Control Mechanism in Heterogeneous Wireless Networks for Multiple Services.

Multi-Agent RL Enables Decentralized Spectrum Access in Vehicular Networks

Joint Spectrum and Power Allocation in Wireless Network: A Two-Stage Multi-Agent Reinforcement Learning Method

TinyQMIX: Distributed Access Control for mMTC via Multi-agent Reinforcement Learning

Multi-Agent Reinforcement Learning for Wireless Networks Against Adversarial Communications

Multi-Agent Reinforcement Learning for Wireless User Scheduling: Performance, Scalablility, and Generalization