Abstract:Heterogeneous network (HetNet) is a promising solution to satisfy the unprecedented demand for higher data rate in the next generation mobile networks. Different from the traditional single-layer cellular networks, how to provide the best service to the user equipments (UEs) under the limited resource is an urgent problem to solve. In order to efficiently address the above challenge and strive towards high network energy efficiency, the joint optimization problem of user association and power control in orthogonal frequency division multiple access (OFDMA) based uplink HetNets is studied. Considering the non-convex and non-linear characteristics of the problem, a multi-agent deep Q-learning Network (DQN) method is studied to solve the problem. Different from the traditional methods, such as game theory, fractional programming and convex optimization, which need more and accurate network information in practice, the multi-agent DQN method requires less communication information of the environment. Moreover, for the communication environment dynamics, the maximum long-term overall network utility with a new reward function while ensuring the UE's quality of service (QoS) requirements is achieved by using the multi-agent DQN method. Then, according to the application scenario, the action space, state space and reward function of the multi-agent DQN based framework are redefined and formulated. Simulation results demonstrate that the multi-agent DQN method has the best performance on convergence and energy efficiency compared with the traditional reinforcement learning (Q-learning). (C) 2020 Elsevier B.V. All rights reserved.

Deep Q-Learning Based Dynamic Resource Allocation for Self-Powered Ultra-Dense Networks

Deep Q-Network Based Resource Allocation for UAV-assisted Ultra-Dense Networks

Deep Reinforcement Learning Based Dynamic Resource Allocation in 5G Ultra-Dense Networks

Deep Deterministic Policy Gradient Based Dynamic Power Control for Self-Powered Ultra-Dense Networks

User Association and Power Allocation Based on Q-Learning in Ultra Dense Heterogeneous Networks

A Model-Driven Deep Reinforcement Learning Heuristic Algorithm for Resource Allocation in Ultra-Dense Cellular Networks

Deep-Reinforcement-Learning-Based Resource Allocation in ultra-dense network.

Deep Learning Based Dynamic Uplink Power Control For Noma Ultra-Dense Network System

Deep-learning Based System-Level Energy Efficiency Maximization in Ultra-Dense Micro Cell Networks

Energy-Efficient Ultra-Dense Network with Deep Reinforcement Learning

A Self-Organizing Resource Allocation Strategy Based on Q-learning Approach in Ultra-Dense Networks

Downlink Transmit Power Control in Ultra-Dense UAV Network Based on Mean Field Game and Deep Reinforcement Learning

Learning-Based Joint User-AP Association and Resource Allocation in Ultra Dense Network

Dynamic user-centric multi-dimensional resource allocation for a wide-area coverage signaling cell based on DQN

A DQN-Based Handover Management for SDN-Enabled Ultra-Dense Networks

Power Allocation in Multi-Cell Networks Using Deep Reinforcement Learning

A Power Allocation Scheme Based on Deep Reinforcement Learning in HetNets.

Game-theoretic Hierarchical Resource Allocation in Ultra-Dense Networks

A deep reinforcement learning for user association and power control in heterogeneous networks

Energy-Efficient Resource Allocation in Ultra-Dense Networks with EMBB and URLLC Users Coexistence

Collaborative Multi-BS Power Management for Dense Radio Access Network using Deep Reinforcement Learning