Abstract:We consider a dense small cell (DSC) network where multi-antenna small cell base stations (SBSs) transmit data to single-antenna users over a shared frequency band. To enhance capacity, a state-of-the-art technique known as noncoherent joint transmission (JT) is applied, enabling users to receive data from multiple coordinated SBSs. However, the sum rate maximization problem with noncoherent JT is inherently nonconvex and NP-hard. While existing optimization-based noncoherent JT algorithms can provide near-optimal performance, they require global channel state information (CSI) and multiple iterations, which makes them difficult to be implemeted in DSC <a class="link-external link-http" href="http://networks.To" rel="external noopener nofollow">this http URL</a> overcome these challenges, we first prove that the optimal beamforming structure is the same for both the power minimization problem and the sum rate maximization problem, and then mathematically derive the optimal beamforming structure for both problems by solving the power minimization problem.The optimal beamforming structure can effectively reduces the variable <a class="link-external link-http" href="http://dimensions.By" rel="external noopener nofollow">this http URL</a> exploiting the optimal beamforming structure, we propose a deep deterministic policy gradient-based distributed noncoherent JT scheme to maximize the system sum <a class="link-external link-http" href="http://rate.In" rel="external noopener nofollow">this http URL</a> the proposed scheme, each SBS utilizes global information for training and uses local CSI to determine beamforming vectors. Simulation results demonstrate that the proposed scheme achieves comparable performance with considerably lower computational complexity and information overhead compared to centralized iterative optimization-based techniques, making it more attractive for practical deployment.

Distributed Coordinated Beamforming Based on Multi-Agent Reinforcement Learning in Multicell MISO Systems

Two-Timescale Hybrid Analog-Digital Beamforming for Mmwave Full-Duplex MIMO Multiple-Relay Aided Systems

Deep Reinforcement Learning for Distributed Dynamic Coordinated Beamforming in Massive MIMO Cellular Networks

A Novel Model-Assisted Decentralized Multi-Agent Reinforcement Learning for Joint Optimization of Hybrid Beamforming in Massive MIMO mmWave Systems

An Efficient Multi-Agent Optimization Approach for Coordinated Massive MIMO Beamforming.

Distributed Noncoherent Joint Transmission Based on Multi-Agent Reinforcement Learning for Dense Small Cell MISO Systems

Joint Deep Reinforcement Learning and Unfolding: Beam Selection and Precoding for Mmwave Multiuser MIMO with Lens Arrays

Joint Beamforming Design and Blocklength Optimization for Low-Latency Multi-User MISO URLLC Systems

Deep Reinforcement Learning for Multi-user Massive MIMO with Channel Aging

Multi-Agent Reinforcement Learning for Multi-Cell Spectrum and Power Allocation

Deep Learning Based Joint Beam Selection and Precoding Design for Mmwave Systems with Lens Arrays

Joint User Pairing and Beamforming Design for NOMA-Aided CFMM-ISAC Systems

Learning-Based Intelligent Reflecting Surface-Aided Cell-Free Massive MIMO Systems

Traffic-Aware Hierarchical Beam Selection for Cell-Free Massive MIMO

Distributed Robust Multi-Cell Coordinated Beamforming with Imperfect CSI: An ADMM Approach

A Robust Deep Learning-Based Beamforming Design for RIS-Assisted Multiuser MISO Communications with Practical Constraints

Joint Cooperative Clustering and Power Control for Energy-Efficient Cell-Free XL-MIMO with Multi-Agent Reinforcement Learning

Multi-agent Reinforcement Learning for Energy Saving in Multi-Cell Massive MIMO Systems

Double-Layer Power Control for Mobile Cell-Free XL-MIMO with Multi-Agent Reinforcement Learning

Distributed Cooperative Multicell Beamforming Based on a Viewpoint of Layered Channel

Cooperative Multi-Target Positioning for Cell-Free Massive MIMO with Multi-Agent Reinforcement Learning