Abstract:We consider a dense small cell (DSC) network where multi-antenna small cell base stations (SBSs) transmit data to single-antenna users over a shared frequency band. To enhance capacity, a state-of-the-art technique known as noncoherent joint transmission (JT) is applied, enabling users to receive data from multiple coordinated SBSs. However, the sum rate maximization problem with noncoherent JT is inherently nonconvex and NP-hard. While existing optimization-based noncoherent JT algorithms can provide near-optimal performance, they require global channel state information (CSI) and multiple iterations, which makes them difficult to be implemeted in DSC <a class="link-external link-http" href="http://networks.To" rel="external noopener nofollow">this http URL</a> overcome these challenges, we first prove that the optimal beamforming structure is the same for both the power minimization problem and the sum rate maximization problem, and then mathematically derive the optimal beamforming structure for both problems by solving the power minimization problem.The optimal beamforming structure can effectively reduces the variable <a class="link-external link-http" href="http://dimensions.By" rel="external noopener nofollow">this http URL</a> exploiting the optimal beamforming structure, we propose a deep deterministic policy gradient-based distributed noncoherent JT scheme to maximize the system sum <a class="link-external link-http" href="http://rate.In" rel="external noopener nofollow">this http URL</a> the proposed scheme, each SBS utilizes global information for training and uses local CSI to determine beamforming vectors. Simulation results demonstrate that the proposed scheme achieves comparable performance with considerably lower computational complexity and information overhead compared to centralized iterative optimization-based techniques, making it more attractive for practical deployment.

Reinforcement Learning Based RSS-Threshold Optimization for D2D-Aided HTC/MTC in Dense NOMA Systems

Machine Learning-Based Resource Optimization for D2D Communication Underlaying Networks

Energy-Efficient D2D Communications Underlaying NOMA-Based Networks with Energy Harvesting.

Energy-Efficient Resource Allocation with Imperfect CSI in NOMA-based D2D Networks with SWIPT

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

Resource Allocation for D2D Communications Underlaying a NOMA-Based Cellular Network

Robust and Outage-Constrained Energy Efficiency Optimization in RIS-Assisted NOMA Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

AoI-Oriented Resource Allocation for NOMA-Based Wireless Powered Cognitive Radio Networks Based on Multi-Agent Deep Reinforcement Learning

Robust Transmission Design for Multicell D2D Underlaid Cellular Networks

Reinforcement Learning for User Clustering in NOMA-Enabled Uplink IoT.

Deep Reinforcement Learning Based Multidimensional Resource Management for Energy Harvesting Cognitive NOMA Communications

Adaptive Coordinated Direct and Relay Transmission for NOMA Networks: A Joint Downlink-Uplink Scheme

A joint resource optimization allocation algorithm for NOMA‐D2D communication

A Deep Reinforcement Learning based Approach for NOMA-based Random Access Network with Truncated Channel Inversion Power Control

Deep Learning Based Power Optimizing for NOMA Based Relay Aided D2D Transmissions

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Distributed Noncoherent Joint Transmission Based on Multi-Agent Reinforcement Learning for Dense Small Cell MISO Systems

A Multi-Agent Reinforcement Learning Approach for Massive Access in NOMA-URLLC Networks

Adaptive Aggregate Transmission for Device-to-Multi-Device Aided Cooperative NOMA Networks

Active RIS-aided EH-NOMA Networks: A Deep Reinforcement Learning Approach