Abstract:This paper considers a downlink resource-allocation problem in distributed interference orthogonal frequency-division multiple access (OFDMA) systems under maximal power constraints. As the upcoming fifth-generation (5G) wireless networks are increasingly complex and heterogeneous, it is challenging for resource allocation tasks to optimize the system performance metrics and guarantee user service requests simultaneously. Because of the non-convex optimization problems, using existing approaches to find the optimal resource allocation is computationally expensive. Recently, model-free reinforcement learning (RL) techniques have become alternative approaches in wireless networks to solve non-convex and NP-hard optimization problems. In this paper, we study a deep Q-learning (DQL)-based approach to address the optimization of transmit power control for users in multi-cell interference networks. In particular, we have applied a DQL algorithm for resource allocation to maximize the overall system throughput subject to the maximum power and SINR constraints in a flat frequency channel. We first formulate the optimization problem as a non-cooperative game model, where the multiple BSs compete for spectral efficiencies by improving their achievable utility functions while ensuring the quality of service (QoS) requirements to the corresponding receivers. Then, we develop a DRL-based resource allocation model to maximize the system throughput while satisfying the power and spectral efficiency requirements. In this setting, we define the state-action spaces and the reward function to explore the possible actions and learning outcomes. The numerical simulations demonstrate that the proposed DQL-based scheme outperforms the traditional model-based solution.

Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

Power Allocation in Multi-User Cellular Networks with Deep Q Learning Approach.

Power Allocation in Multi-Cell Networks Using Deep Reinforcement Learning

Deep Reinforcement Learning Based Power Allocation for D2D Network

A Deep Reinforcement Learning-Based Technique for Optimal Power Allocation in Multiple Access Communications

Downlink Power Control for Cell-Free Massive MIMO with Deep Reinforcement Learning

Deep Multi-Agent Reinforcement Learning for Resource Allocation in D2D Communication Underlaying Cellular Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Resource Allocation and Power Control Policy for Device-to-Device Communication Using Multi-Agent Reinforcement Learning

Distributed Multi-Cell Power Control with NAF Reinforcement Learning.

A Multi-agent Reinforcement Learning Based Power Control Algorithm for D2D Communication Underlaying Cellular Networks

Inverse Reinforcement Learning Meets Power Allocation in Multi-user Cellular Networks

Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks.

Multi-Agent Deep Reinforcement Learning-Based Power Control and Resource Allocation for D2D Communications

Power Allocation for Device-to-Multi-Device Enabled HetNets - A Deep Reinforcement Learning Approach.

Multi-Agent Deep Reinforcement Learning for Uplink Power Control in Multi-Cell Systems

Multi-agent Reinforcement Learning-based User Scheduling and Resource Allocation in Cell-free Networks.

Sum Rate Maximization in Multi-Cell Multi-User Networks: an Inverse Reinforcement Learning-Based Approach

Power Control Based on DRL Algorithm for D2D-Enabled Networks

Deep Reinforcement Learning-Assisted Optimization for Resource Allocation in Downlink OFDMA Cooperative Systems

Deep Reinforcement Learning for Distributed Dynamic Power Allocation in Wireless Networks.