Adaptive Mm Wave Beam Tracking in 3D Scenes Via Multi - Agent Deep Q Learning.

Yuncheng Lu,Fan Meng,Yongming Huang,Zhaohua Lu,Fei Yu
DOI: https://doi.org/10.1109/wcsp55476.2022.10039477
2022-01-01
Abstract:Beamforming is indispensable for millimeter wave massive multi-input multi-output systems, meanwhile, the over-head cost of channel state information acquisition can be consid-erable especially in dynamic environments. To reduce beam training overhead, we propose an adaptive distributed beam tracking algorithm using multi-agent deep Q learning for dynamic channel sensing. By online learning of users' movement trajectories as prior, the proposed algorithm learn to scan a beam subspace to maximize the average effective achievable sum-rate, without prior knowledges of dynamic channels. Considering practical implement, we develop a simplified training scheme of deep Q network, to reduce the training complexity. Simulation results demonstrate the effectiveness and superiority of the designed method.
What problem does this paper attempt to address?