Abstract:This paper investigates simultaneous transmitting and reflecting reconfigurable intelligent surface (STAR-RIS)-assisted downlink multi-user multiple-input single-output (MU-MISO) networks with the rate splitting multiple access (RSMA) scheme. A base station (BS) desires to simultaneously transmit messages to multiple users with the assistance of a STAR-RIS to enhance communication quality as well as extend the coverage of users. An optimization problem is formulated to maximize the achievable sum rate of the networks on the premise of satisfying the constraints on power budget at the BS, total common-stream rate of users, and individual users’ minimum rate requirements, via jointly optimizing the beamforming vectors, the common-stream rate allocation vector, and the transmission and reflection coefficients (TARCs) matrix. Due to the dynamic changes of communication links and the coupling of multiple variables, it is challenging to solve such a non-convex optimization problem by utilizing traditional methods. Therefore, a proximal policy optimization (PPO)-based deep reinforcement learning (DRL) algorithm is proposed, where the reward function, the action space and the state space are designed properly. A constraint-satisfaction-processing (CSP) method is employed to further adjust the optimized transmit power to make sure that the obtained optimized results satisfy the power budget constraint. Simulation results show that the proposed PPO-based DRL algorithm converges well and achieves much better performance than several baselines, such as the soft actor-critic (SAC), the deep deterministic policy gradient (DDPG), the genetic algorithm (GA), the maximum ratio transmission (MRT), the zero-forcing (ZF) and the random methods. Moreover, it demonstrates that deploying STAR-RIS greatly enhances the system sum rate and user fairness compared to deploying traditional reflecting-only RIS (RO-RIS) and without RIS. Besides, it also shows that adopting the RSMA scheme achieves more notable performance gains than the non-orthogonal multiple access (NOMA) scheme in such a network.

Sum Rate Maximization in Multi-Cell Multi-User Networks: an Inverse Reinforcement Learning-Based Approach

Inverse Reinforcement Learning Meets Power Allocation in Multi-user Cellular Networks

Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

IRL-PM: An Inverse Reinforcement Learning-based Power Minimization in Multi-User MISO Networks.

Sum-Rate Maximization in RIS-Aided Wireless-Powered D2D Communication Networks.

Downlink Sum-Rate Maximization for Rate Splitting Multiple Access (RSMA).

Multicell Power Control under QoS Requirements with CNet

Energy Efficient Transmission in Underlay CR-NOMA Networks Enabled by Reinforcement Learning

Joint Beamforming and Power Control for MIMO-NOMA with Deep Reinforcement Learning

Multi-Functional RIS for Sum-Rate Maximization in Rate-Splitting Multiple Access Networks

Multi-Agent Reinforcement Learning Based Unlicensed Resource Sharing for LTE-U Networks.

A Deep Reinforcement Learning-Based Technique for Optimal Power Allocation in Multiple Access Communications

Deep Reinforcement Learning Based Mode Selection and Power Allocation Scheme for Convergent Power-Efficient Network.

Sum-Rate Optimization For Device-To-Device Communications Over Rayleigh Fading Channel

Deep Reinforcement Learning-Assisted Optimization for Resource Allocation in Downlink OFDMA Cooperative Systems

A RIS-Assisted Multiuser MIMO Communication Method Based on Deep Reinforcement Learning

Sum-rate Maximization in STAR-RIS Assisted RSMA Networks: A PPO-based Algorithm

Deep Reinforcement Learning-Based Optimization for IRS-Assisted Cognitive Radio Systems

Resource allocation in multi-user cellular networks: A transformer-based deep reinforcement learning approach

Deep Reinforcement Learning Based Resource Allocation Algorithm in Cellular Networks

Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent