Abstract:Deep reinforcement learning (DRL) methods have emerged as a feasible solution for addressing the power resource allocation problem in ultra-dense small-cell networks (UDSCNs). In this paper, we propose a novel actor-critic-based low-coupling policy optimization (LCPO) framework. Our framework aims to achieve practicality by employing a design that consists of training and execution modules with low coupling. By adopting policy optimization methods, including advantage actor-critic (A2C) and proximal policy optimization (PPO) with state-dependent exploration (SDE) technique, LCPO demonstrates stable performance. In this study, we define the research problem of power resource allocation in UDSCNs and present the mathematical algorithm employed in the LCPO framework. We compare the performance of LCPO with other algorithms, such as deep deterministic policy gradient (DDPG) and fractional programming (FP) algorithms. Through extensive simulations, our proposed LCPO framework outperforms DDPG and FP algorithms in terms of both performance and execution time. Furthermore, to provide an up-to-date overview of the current state-of-the-art, we incorporate recent research papers in the field. The inclusion of these papers enhances the relevance of our study and allows readers to gain insights into the latest advancements in power resource allocation in UDSCNs. The results of our research highlight the effectiveness of the LCPO framework in addressing the power resource allocation problem in UDSCNs. The proposed framework offers superior performance compared to existing algorithms, making it a promising solution for optimizing power allocation in UDSCNs.

Deep Deterministic Policy Gradient Based Dynamic Power Control for Self-Powered Ultra-Dense Networks

Deep Q-Learning Based Dynamic Resource Allocation for Self-Powered Ultra-Dense Networks

Power Allocation for Full-Duplex Communication Systems Based on Deep Deterministic Policy Gradient

Power Allocation in Ultra-Dense Networks Through Deep Deterministic Policy Gradient

Deep Deterministic Policy Gradient with Prioritized Sampling for Power Control

Downlink Transmit Power Control in Ultra-Dense UAV Network Based on Mean Field Game and Deep Reinforcement Learning

Joint EH Time and Transmit Power Optimization Based on DDPG for EH Communications

Deep Reinforcement Learning-Assisted Energy Harvesting Wireless Networks

Deep Learning Based Dynamic Uplink Power Control For Noma Ultra-Dense Network System

Deep Reinforcement Learning Based Energy Efficient Resource Allocation for Wireless Powered Edge Computing Network

Learning Deterministic Policy with Target for Power Control in Wireless Networks

Deep Deterministic Policy Gradient Based Computation Offloading in Wireless-Powered MEC Networks.

Energy-Efficient Ultra-Dense Network with Deep Reinforcement Learning

Deep Reinforcement Learning-based Power Control and Bandwidth Allocation Policy for Weighted Cost Minimization in Wireless Networks

Downlink Power Control for Cell-Free Massive MIMO with Deep Reinforcement Learning

Low-Coupling Policy Optimization Framework for Power Allocation in Ultra-Dense Small-Cell Networks

Deep Reinforcement Learning for Energy-Efficient Power Control in Heterogeneous Networks

Deep Reinforcement Learning Based Dynamic Power and Beamforming Design for Time-Varying Wireless Downlink Interference Channel

Deep Learning Based Online Power Control for Large Energy Harvesting Networks

A DDPG-based Transfer Learning Optimization Framework for User Association and Power Control in HetNet

A General DRL-based Optimization Framework of User Association and Power Control for HetNet.