Abstract:With the high development of wireless communication techniques, it is widely used in various fields for convenient and efficient data transmission. Different from commonly used assumption of the time-invariant wireless channel, we focus on the research on the time-varying wireless downlink channel to get close to the practical situation. Our objective is to gain the maximum value of sum rate in the time-varying channel under the some constraints about cut-off signal-to-interference and noise ratio (SINR), transmitted power and beamforming. In order to adapt the rapid changing channel, we abandon the frequently used algorithm convex optimization and deep reinforcement learning algorithms are used in this paper. From the view of the ordinary measures such as power control, interference incoordination and beamforming, continuous changes of measures should be put into consideration while sparse reward problem due to the abortion of episodes as an important bottleneck should not be ignored. Therefore, with the analysis of relevant algorithms, we proposed two algorithms, Deep Deterministic Policy Gradient algorithm (DDPG) and hierarchical DDPG, in our work. As for these two algorithms, in order to solve the discrete output, DDPG is established by combining the Actor-Critic algorithm with Deep Q-learning (DQN), so that it can output the continuous actions without sacrificing the existed advantages brought by DQN and also can improve the performance. Also, to address the challenge of sparse reward, we take advantage of meta policy from the idea of hierarchical theory to divide one agent in DDPG into one meta-controller and one controller as hierarchical DDPG. Our simulation results demonstrate that the proposed DDPG and hierarchical DDPG performs well from the views of coverage, convergence and sum rate performance.

Power Allocation for Full-Duplex Communication Systems Based on Deep Deterministic Policy Gradient

Deep Learning Based Power Allocation for Workload Driven Full-Duplex D2D-Aided Underlaying Networks

A Continuous Policy Learning Approach for Hybrid Offloading in Backscatter Communication.

Power Allocation in Ultra-Dense Networks Through Deep Deterministic Policy Gradient

A Novel Power Allocation Algorithm for D2D Communications Underlaying Full-Duplex Cellular Networks

Joint User Pairing, Resource Block Allocation, And Power Control For Full-Duplex Cellular Networks

Deep Reinforcement Learning Based Dynamic Power and Beamforming Design for Time-Varying Wireless Downlink Interference Channel

Deep Deterministic Policy Gradient Based Dynamic Power Control for Self-Powered Ultra-Dense Networks

Joint EH Time and Transmit Power Optimization Based on DDPG for EH Communications

Deep Reinforcement Learning Based Dynamic Power and Beamforming Design for Time-Varying Wireless Downlink Interference Channel

Power Allocation Optimization for Full-Duplex D2D Communications Underlaying Cellular Networks

Deep Learning Based Resource Allocation for Full-Duplex-Enabled Two-Way Device-To-Device Communications

Multi-Objective Power Optimization for Full Duplex System Based on Chebyshev Weighting

Deep Reinforcement Learning Based Power Allocation for D2D Network

Power Minimization of Full Duplex Communication System Based on Interference Exploit

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

A Power Allocation Algorithm To Maximize Capacity In A Full-Duplex Multi-Carrier System

Optimal Power Allocation for Bi-Directional Full Duplex Underlay Cognitive Radio Networks

Power Allocation for Full-Duplex Relaying Based D2D Communication Underlaying Cellular Networks

Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

Downlink Power Control for Cell-Free Massive MIMO with Deep Reinforcement Learning