Abstract:To combat the spectrum scarcity, non-orthogonal multiple access (NOMA) and vehicle-to-everything (V2X) systems are integrated as NOMA-V2X networks, where multiple vehicleto-vehicle (V2V) links can opportunistically reuse the spectrum licensed to vehicle-to-infrastructure (V2I) links. However, the contradictory quality of service (QoS) requirements among V2V and V2I links make the design of an effective spectrum sharing scheme to be a great challenge. The high mobility of vehicles and the extra interference brought by NOMA make the issue more complex. Hence, a matching combined multi-agent deep deterministic policy gradient (MADDPG) algorithm is proposed in the paper to maximize the sum delivery rate of V2I up-links while guaranteeing the reliability of V2V links in NOMA-V2X networks. In specific, the channel assignment is solved by oneto-many matching in advance which can be theoretically proved to converge to a stable state. While heterogeneous MADDPG is further adopted to obtain the proper power control for V2I link pairs and V2V links which are taken as different types of agents and interact with the environment independently. On the basis, a fully decentralized framework is designed for the proposed algorithm to reduce the communication overhead caused by the information synchronization. Simulation results demonstrate that by introducing matching theory into deep reinforcement learning (DRL), the sum delivery rate of V2I links can be greatly improved with less computation complexity and convergence time. Moreover, compared with orthogonal multiple access (OMA) communications, the outstanding energy and spectrum efficiency make it significant to explore NOMA in V2X networks

Resource Allocation in Uplink NOMA Systems: A Hybrid-Decision-Based Multi-Agent Deep Reinforcement Learning Approach

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

Matching Combined Heterogeneous Multi-Agent Reinforcement Learning for Resource Allocation in NOMA-V2X Networks

Deep Reinforcement Learning Based Dynamic Resource Allocation Method for NOMA in AeroMACS

Matching-Based Resource Allocation and Distributed Power Control Using Mean Field Game in the NOMA-Based UAV Networks.

Channel Assignment for Hybrid NOMA Systems with Deep Reinforcement Learning.

Power Control, User Scheduling And Resource Allocation For Downlink Noma Systems With Imperfect Channel State Information

Efficient Resource Allocation for NOMA-MEC System in Ultra-dense Network: A Mean Field Game Approach

A Convolutional Neural Network Based Resource Management Algorithm for NOMA Enhanced D2D and Cellular Hybrid Networks

Joint Admission Control and Resource Allocation for Multi-Carrier Uplink NOMA Networks

Joint Power Allocation and Channel Assignment for NOMA With Deep Reinforcement Learning

Resource Allocation for D2D Communications Underlaying a NOMA-Based Cellular Network

Multichannel Resource Allocation for Downlink Non-Orthogonal Multiple Access Systems

Dual Dynamic Scheduling for Hierarchical QoS in Uplink-NOMA: A Reinforcement Learning Approach

Resource Allocation in Uplink NOMA-IoT Networks: A Reinforcement-Learning Approach

Joint Resource Allocation Scheme Based Multi-agent DQN for Massive MIMO-NOMA Systems

A joint resource optimization allocation algorithm for NOMA‐D2D communication

Dynamic Resource Allocation for Uplink Non-Orthogonal Multiple Access Systems

Secure Resource Allocation for NOMA PLC Networks with Multi-agent DRL

Machine Learning Empowered Resource Allocation in IRS Aided MISO-NOMA Networks

A Hybrid Optimization and Deep RL Approach for Resource Allocation in Semi-GF NOMA Networks