User-Centric Association in Ultra-Dense mmWave Networks via Deep Reinforcement Learning

Qing Xue,Yao Sun,Jian Wang,Gang Feng,Li Yan,Shaodan Ma
DOI: https://doi.org/10.1109/lcomm.2021.3108013
IF: 3.5529
2021-11-01
IEEE Communications Letters
Abstract:For ultra-dense networks, user-centric architecture is regarded as a promising candidate to offer mobile users better quality of service. One of the main challenges of user-centric architecture is exploring efficient scheme for user association in the ultra-dense network. In this letter, we study dynamic user-centric association (UCA) problem for ultra-dense millimeter wave (mmWave) networks to provide reliable connectivity and high achievable data rate. We consider time-varying network environments and propose a deep Q-network based UCA scheme to find the optimal association policy based on the historical experience. Simulation results are presented to verify the performance gain of our proposed scheme.
telecommunications
What problem does this paper attempt to address?