Abstract:This paper investigates simultaneous wireless information and power transfer (SWIPT)-enabled cell-free massive multiple-input multiple-output (CF-mMIMO) networks with power splitting (PS) receivers and non-orthogonal multiple access (NOMA). By exploiting the conjugated beamforming method, the closed-form expressions of the information rate and the total harvested power at each user equipment (UE) are derived. To improve the system spectral efficiency, a sum rate maximization problem is formulated subjecting to the quality of service requirement at each UE and the power budget constraint at each access point by optimizing the UE clustering, the power control coefficients, and the PS ratios. To solve the formulated non-convex and mixed combinatorial problem, a machine learning-based approach is designed. Particularly, the UE clustering is first optimized by using a K-means based method and then the power control coefficients and the PS ratios are jointly optimized by a proposed multi-agent deep Q-network (MA-DQN) based method. The impact of the discount factor of the MA-DQN based method on the derived result is discussed. It is proved that by setting the discount factor as zero, the performance loss is negligible. Based on this observation, a zero-discount MA-DQN (0-γ MA-DQN) based method is further proposed to improve the computational efficiency. Also, the computational complexity of the proposed machine learning-based approach is analyzed. Simulation results show that the proposed machine learning-based approach outperforms various existing approaches. Moreover, it indicates that CF-mMIMO and NOMA could enhance the propagation performance of SWIPT while the proposed machine learning-based approach could facilitate resource allocation.

Joint Cooperative Clustering and Power Control for Energy-Efficient Cell-Free XL-MIMO with Multi-Agent Reinforcement Learning

Double-Layer Power Control for Mobile Cell-Free XL-MIMO with Multi-Agent Reinforcement Learning

Cell-Free XL-MIMO Meets Multi-Agent Reinforcement Learning: Architectures, Challenges, and Future Directions

Uplink Power Control for Extremely Large-Scale MIMO with Multi-Agent Reinforcement Learning and Fuzzy Logic

Mobile Cell-Free Massive MIMO with Multi-Agent Reinforcement Learning: A Scalable Framework

Deep reinforcement learning based joint cooperation clustering and downlink power control for cell-free massive MIMO

Energy-efficient access point clustering and power allocation in cell-free massive MIMO networks: a hierarchical deep reinforcement learning approach

Joint User Association and Power Control for Cell-Free Massive MIMO

Multi-agent Reinforcement Learning-based Joint Precoding and Phase Shift Optimization for RIS-aided Cell-Free Massive MIMO Systems

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Cooperative Multi-Target Positioning for Cell-Free Massive MIMO with Multi-Agent Reinforcement Learning

Multi-agent Reinforcement Learning for Energy Saving in Multi-Cell Massive MIMO Systems

Distributed Collaborative User Positioning for Cell-Free Massive MIMO with Multi-Agent Reinforcement Learning

Learning-Based Intelligent Reflecting Surface-Aided Cell-Free Massive MIMO Systems

Multi-Agent Reinforcement Learning for Multi-Cell Spectrum and Power Allocation

Network-Assisted Full-Duplex Cell-Free mmWave Networks: Hybrid MIMO Processing and Multi-Agent DRL-Based Power Allocation

SWIPT-enabled Cell-Free Massive MIMO-NOMA Networks: A Machine Learning-based Approach

Multi-Agent Reinforcement Learning for Distributed Joint Communication and Computing Resource Allocation over Cell-Free Massive MIMO-enabled Mobile Edge Computing Network

Downlink Power Control for Cell-Free Massive MIMO with Deep Reinforcement Learning

Energy-Delay-Aware Power Control for Reliable Transmission of Dynamic Cell-Free Massive MIMO