Abstract:This paper investigates simultaneous transmitting and reflecting reconfigurable intelligent surface (STAR-RIS)-assisted downlink multi-user multiple-input single-output (MU-MISO) networks with the rate splitting multiple access (RSMA) scheme. A base station (BS) desires to simultaneously transmit messages to multiple users with the assistance of a STAR-RIS to enhance communication quality as well as extend the coverage of users. An optimization problem is formulated to maximize the achievable sum rate of the networks on the premise of satisfying the constraints on power budget at the BS, total common-stream rate of users, and individual users’ minimum rate requirements, via jointly optimizing the beamforming vectors, the common-stream rate allocation vector, and the transmission and reflection coefficients (TARCs) matrix. Due to the dynamic changes of communication links and the coupling of multiple variables, it is challenging to solve such a non-convex optimization problem by utilizing traditional methods. Therefore, a proximal policy optimization (PPO)-based deep reinforcement learning (DRL) algorithm is proposed, where the reward function, the action space and the state space are designed properly. A constraint-satisfaction-processing (CSP) method is employed to further adjust the optimized transmit power to make sure that the obtained optimized results satisfy the power budget constraint. Simulation results show that the proposed PPO-based DRL algorithm converges well and achieves much better performance than several baselines, such as the soft actor-critic (SAC), the deep deterministic policy gradient (DDPG), the genetic algorithm (GA), the maximum ratio transmission (MRT), the zero-forcing (ZF) and the random methods. Moreover, it demonstrates that deploying STAR-RIS greatly enhances the system sum rate and user fairness compared to deploying traditional reflecting-only RIS (RO-RIS) and without RIS. Besides, it also shows that adopting the RSMA scheme achieves more notable performance gains than the non-orthogonal multiple access (NOMA) scheme in such a network.

SEE Maximization in RIS-Aided Network with RSMA: A PPO-SCF Method

Energy Efficiency Maximization in RIS-Assisted SWIPT Networks With RSMA: A PPO-Based Approach

Secrecy Energy Efficiency Optimization for Reconfigurable Intelligent Surface-Aided Multiuser MISO Systems

Sum Rate Maximization for Distributed Riss Assisted Probabilistic Semantic Communication

Secrecy Energy Efficiency Maximization in IRS-Assisted VLC MISO Networks with RSMA: A DS-PPO approach

Max-Min Security Energy Efficiency Optimization for RIS-Aided Cell-Free Networks

Robust Resource Allocation Algorithm for RIS-Assisted MISO Systems with Eavesdroppers

Fair Non-Orthogonal Multiple Access Communication Systems With Reconfigurable Intelligent Surface

Energy Efficient Rate Splitting Multiple Access (RSMA) with Reconfigurable Intelligent Surface.

Robust Security Energy Efficiency Optimization for RIS-Aided Cell-Free Networks with Multiple Eavesdroppers.

Spectral Efficiency Maximization for Probabilistic Semantic Communication with Rate Splitting

Multi-Functional RIS for Sum-Rate Maximization in Rate-Splitting Multiple Access Networks

Intelligent Omni-Surface Aided Rate Splitting Multiple Access

Distributed Active-Passive Reconfigurable Intelligent Surface Assisted MISO Secure Communications

Secure Beamforming Design for RIS-Assisted Integrated Sensing and Communication Systems

Downlink Sum-Rate Maximization for Rate Splitting Multiple Access (RSMA).

Robust and Outage-Constrained Energy Efficiency Optimization in RIS-Assisted NOMA Networks

Secrecy Rate Maximization of RIS-assisted SWIPT Systems: A Two-Timescale Beamforming Design Approach

Deep Reinforcement Learning for Secrecy Energy Efficiency Maximization in RIS-Assisted Networks

Sum-rate Maximization in STAR-RIS Assisted RSMA Networks: A PPO-based Algorithm

Sum-Rate Maximization for Active RIS-Aided Downlink RSMA System