Abstract:This paper investigates reconfigurable intelligent surface (RIS)-assisted simultaneous wireless information and power transfer (SWIPT) networks with rate splitting multiple access (RSMA). An energy efficiency (EE) maximization problem is formulated subject to the power budget at the transmitter and the quality of service (QoS) requirements of both information communication and energy harvesting, where the beamforming vectors, the power splitting (PS) ratios, the common message rates, and the discrete phase shifts are jointly optimized. To tackle the non-convex problem with both discrete and continuous variables, a deep reinforcement learning-based approach is proposed with the proximal policy optimization (PPO) framework. Different from traditional optimization approaches which optimizes the beamforming vectors and phase shifts separately and alternatively, our proposed PPO-based approach optimizes all the variables in unison. Besides, to perform beamforming design in action space, the beamforming vectors for the common stream and the private stream are respectively designed based on the maximum-ratio transmission and the zero forcing to enhance both energy and information transmission. To evaluate the performance of the PPO-based approach, a successive convex approximation (SCA) and Dinkelbach's method based solution scheme (named SCA-D scheme) is also presented. Simulation results show that the system EE obtained by the proposed PPO-based approach is close to that obtained by the SCA-D scheme while outperforming various benchmarks. The RSMA contributes to the EE of the system greatly compared with traditional scheme. As for the case of time-varying channels, the proposed PPO-based approach is with much smaller running time by only sacrificing a slight EE performance compared with the SCA-D scheme.

Learning-Aided Resource Allocation for Pattern Division Multiple Access-Based SWIPT Systems

A Wireless Resources Allocation Method for D2MD Communication under IMT-A System

Cross-layer Resource Allocation for the Downlink of SDMA Systems

Delay-Aware Power Control for Downlink Multi-User MIMO Via Constrained Deep Reinforcement Learning.

Energy-Efficient Resource Allocation with Imperfect CSI in NOMA-based D2D Networks with SWIPT

Power Allocation in Downlink PDMA Systems.

Energy-Efficient Resource Allocation in D2D Underlaid Cellular Uplinks.

Power Allocation for Full-Duplex Communication Systems Based on Deep Deterministic Policy Gradient

Joint Pattern Assignment and Power Allocation in PDMA

Optimal Energy Allocation and Multiuser Scheduling in SWIPT Systems with Hybrid Power Supply

Joint Energy Allocation and Multiuser Scheduling in SWIPT Systems with Energy Harvesting.

Power Allocation in PDMA Systems with Imperfect Channel State Information

Resource Allocation in PDMA with Wireless Information and Power Transmission

A Deep Reinforcement Learning-Based Technique for Optimal Power Allocation in Multiple Access Communications

Machine Intelligence at the Edge With Learning Centric Power Allocation

Situation-Aware Resource Allocation for Multi-Dimensional Intelligent Multiple Access: A Proactive Deep Learning Framework

Resource Allocation for NOMA-MEC Systems in Ultra-Dense Networks: A Learning Aided Mean-Field Game Approach

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

Learning Centric Power Allocation for Edge Intelligence

Energy Efficiency Maximization in RIS-Assisted SWIPT Networks With RSMA: A PPO-Based Approach

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks