Abstract:To accommodate the explosive wireless traffics, massive multiple-input multiple-output (MIMO) is regarded as one of the key enabling technologies for next-generation communication systems. In massive MIMO cellular networks, coordinated beamforming (CBF), which jointly designs the beamformers of multiple base stations (BSs), is an efficient method to enhance the network performance. In this paper, we investigate the sum rate maximization problem in a massive MIMO mobile cellular network, where in each cell a multi-antenna BS serves multiple mobile users simultaneously via downlink beamforming. Although existing optimization-based CBF algorithms can provide near-optimal solutions, they require realtime and global channel state information (CSI), in addition to their high computation complexity. It is almost impossible to apply them in practical wireless networks, especially highly dynamic mobile cellular networks. Motivated by this, we propose a deep reinforcement learning based distributed dynamic coordinated beamforming (DDCBF) framework, which enables each BS to determine the beamformers with only local CSI and some historical information from other BSs.Besides, the beamformers can be calculated with a considerably lower computational complexity by exploiting neural networks and expert knowledge, i.e., a solution structure observed from the iterative procedure of the weighted minimum mean square error (WMMSE) algorithm. Moreover, we provide extensive numerical simulations to validate the effectiveness of the proposed DRL-based approach. With lower computational complexity and less required information, the results show that the proposed approach can achieve comparable performance to the centralized iterative optimization algorithms.

Learning Adaptive Beamforming Policy for Different Optimization Problems

Deep Learning Based Joint Beam Selection and Precoding Design for Mmwave Systems with Lens Arrays

Joint Deep Reinforcement Learning and Unfolding: Beam Selection and Precoding for Mmwave Multiuser MIMO with Lens Arrays

An Efficient Multi-Agent Optimization Approach for Coordinated Massive MIMO Beamforming.

Learning to Optimize Resource in Dynamic Wireless Environment Via Meta-Gating Graph Neural Network

Robust Adaptive Beam-Forming Optimization Method Based on Diagonal-Loading and MSE Criterion

Transfer Learning and Meta Learning Based Fast Downlink Beamforming Adaptation

Deep Learning Aided Beamforming for Downlink Non-Orthogonal Multiple Access Systems

Rapid and Power-Aware Learned Optimization for Modular Receive Beamforming

Optimization of Broadcast Beams in Massive MIMO: Learning from A Digital Twin.

Learning-Based Massive Beamforming

Deep Reinforcement Learning for Distributed Coordinated Beamforming in Massive MIMO

A Penalty-Dual Learning Framework for Multi-User QoS-Constrained Beamforming

Constrained Deep Neural Network Based Hybrid Beamforming for Millimeter Wave Massive MIMO Systems.

A Data and Model-Driven Deep Learning Approach to Robust Downlink Beamforming Optimization

Deep Learning Based Joint Multi-User MISO Power Allocation and Beamforming Design

Multitask Deep Learning-Based Multiuser Hybrid Beamforming for Mm-Wave Orthogonal Frequency Division Multiple Access Systems

Joint Coordinated Beamforming and Power Splitting Ratio Optimization in MU-MISO SWIPT-Enabled HetNets: A Multi-Agent DDQN-Based Approach

Millimeter-Wave Networking in the Sky: A Machine Learning and Mean Field Game Approach for Joint Beamforming and Beam-Steering

Hybrid Precoding for Mmwave MU-MISO System with Deep Reinforcement Learning and Model-Driven Deep Learning

Deep Reinforcement Learning for Distributed Dynamic Coordinated Beamforming in Massive MIMO Cellular Networks