Hybrid Precoding for Mmwave MU-MISO System with Deep Reinforcement Learning and Model-Driven Deep Learning

Shupeng Ji,Xiao Li,Ning Gao,Shi Jin
DOI: https://doi.org/10.1109/icct59356.2023.10419517
2023-01-01
Abstract:This paper investigates the hybrid pre coding in the millimeter wave (mmWave) multi-user multiple-input single-output (MU-MISO) systems. The beam selection and digital precoding are jointly designed for maximizing the sum rate. This problem involves both discrete and continuous optimization, making it a challenging mixed-integer non-linear programming (MINLP) problem to solve. To achieve comparable performance with respect to traditional numerical optimization methods with low complexity, this paper proposes a beam selection network based on deep reinforcement learning (DRL) and a digital precoding network based on model-driven deep learning (DL). Double Q-learning, dueling network architectures and prioritized experience replay are introduced into the DRL based beam selection for improvements. Simulation results demonstrate that the proposed joint optimization algorithm can achieve the performance approaching the numerical optimization algorithms with lower computational complexity. Additionally, the networks trained under a specific antenna configuration is found to be applicable to scenarios with different transmitting antennas.
What problem does this paper attempt to address?