Abstract:Non-orthogonal multiple access (NOMA) assisted semi-grant-free (SGF) transmission has been viewed as one of the promising technologies to meet massive connectivity requirements of the next-generation networks. A novel intelligent reconfigurable surface (IRS) assisted SGF NOMA transmission system is proposed, where the IRS is employed to satisfy the channel gain requirements for grant-based users (GBUs) and grant-free users (GFUs). The dynamic optimization on the sub-carrier assignment and power allocation for roaming GFUs, and the amplitude control and phase shift design for reflecting elements of the IRS, is formulated. Aiming at maximizing the long-term data rate of all GFUs, the optimization problem is first modeled as a multi-agent Markov decision problem. Then, three multi-agent deep reinforcement learning based frameworks are proposed to solve the problem under three different IRS cases, including the ideal IRS, non-ideal IRS with continuous phase shifts, and non-ideal IRS with discrete phase shifts. Specifically, for each GFU agent, a sub-carrier assignment deep Q-network (DQN) and a power allocation deep deterministic policy gradient (DDPG) are integrated to dynamically assign network resources for each GFU. For the only IRS agent, two DDPGs are integrated to dynamically assign phase shift and amplitude for each reflecting element of ideal IRS. The single DDPG for dynamically assigning continuous phase shifts, and parallel DQNs for dynamically assigning discrete phase shifts for non-ideal IRS with fixed amplitude are also proposed. Simulation results demonstrate that: 1) The network sum rates of all GFUs can achieve a significant improvement with the aid of IRS, comparing with the system without IRS. 2) The network sum rates of the NOMA assisted SGF transmissions are superior to that of OMA assisted GF transmissions.

Machine Learning Empowered Resource Allocation in IRS Aided MISO-NOMA Networks

Resource Allocation in IRSs Aided MISO-NOMA Networks: A Machine Learning Approach.

A Distributed Machine Learning-Based Approach for IRS-Enhanced Cell-Free MIMO Networks

Resource Allocation for Multi-Cell IRS-Aided NOMA Networks

Joint User Clustering And Passive Beamforming For Downlink Noma System With Reconfigurable Intelligent Surface

Intelligent Reflecting Surface Aided Multi-Cell NOMA Networks

Power Control, User Scheduling And Resource Allocation For Downlink Noma Systems With Imperfect Channel State Information

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

Resource Allocation in Intelligent Reflecting Surface Assisted NOMA Systems

Energy Efficient Power Allocation Design for Beamspace MISO Non-Orthogonal Multiple Access Systems

Resource Allocation for IRS Assisted SGF NOMA Transmission: A MADRL Approach

Joint Power Allocation and Phase Shift Design for IRS-aided NOMA-URLLC Systems.

Resource Allocation for Multiple RISs Assisted NOMA Empowered D2D Communication: A MAMP-DQN Approach

Intelligent Radio Resource Management in Reconfigurable IRS-enabled NOMA Networks

Resource Allocation for MU-MIMO Non-Orthogonal Multiple Access (NOMA) System with Interference Alignment

Exploiting Intelligent Reflecting Surfaces in NOMA Networks: Joint Beamforming Optimization

Intelligent Reflecting Surface Aided NOMA for Millimeter-Wave Massive MIMO With Lens Antenna Array

Joint Beam-Forming, User Clustering and Power Allocation for MIMO-NOMA Systems

Joint Beamforming Design in Multi-Cluster MISO NOMA Reconfigurable Intelligent Surface-Aided Downlink Communication Networks

Performance optimization for multi-IRS-assisted NOMA URLLC systems

Joint Beamforming Design in Multi-Cluster MISO NOMA Intelligent Reflecting Surface-Aided Downlink Communication Networks