Abstract:Cloud Radio Access Networks (C-RANs) have the potential to enable growing data traffic in 5G networks. However, with the complex states, resource allocation in C-RANs is time-consuming and computational-expensive, making it challenging to meet the demands of energy efficiency and low latency in real-time wireless applications. In this paper, we propose a gradient boosting decision tree (GBDT)-based deep Q-network (DQN) framework for solving the dynamic resource allocation (DRA) problem in a real-time C-RAN, where the heavy computation to solve SOCP problems is cut down and significant power consumption can be saved. First, we apply the GBDT to the regression task to approximate the solutions of second order cone programming (SOCP) problem formulated from beamforming design which consumes heavy computing resources by traditional algorithms. Then, we design a deep Q-network (DQN), coming from a common deep reinforcement learning, to autonomously generate the robust policy that controls the status of remote radio heads (RRHs) and saves the power consumption in long term. The DQN deploys deep neural networks (DNN) to solve the problem of innumerable states in the real-time C-RAN system and generates the policy by observing the state and the reward engendered by GBDT. The generated policy is error-tolerant considering that the gradient boosting regression may not be strictly subject to the constraints of the original problem. Simulation results validate its advantages in terms of the performance and computational complexity for power consumption saving compared with existing methods.

Collaborative Multi-BS Power Management for Dense Radio Access Network using Deep Reinforcement Learning

Deep Reinforcement Learning for Energy Saving in Radio Access Network

Deep Reinforcement Learning Based Mode Selection and Power Allocation Scheme for Convergent Power-Efficient Network.

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Downlink Transmit Power Control in Ultra-Dense UAV Network Based on Mean Field Game and Deep Reinforcement Learning

Energy Efficient Transmission in Underlay CR-NOMA Networks Enabled by Reinforcement Learning

Power Consumption Optimization Using Gradient Boosting Aided Deep Q-Network in C-RANs

Power Allocation in Multi-Cell Networks Using Deep Reinforcement Learning

Deep Reinforcement Learning Method for Energy Efficient Resource Allocation in Next Generation Wireless Networks.

Deep Reinforcement Learning for Energy-Efficient Power Control in Heterogeneous Networks

Energy Saving Through a Learning Framework in Greener Cellular Radio Access Networks.

Energy-Efficient Ultra-Dense Network with Deep Reinforcement Learning

Deep Reinforcement Learning for Distributed Dynamic Power Allocation in Wireless Networks.

Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

Distributed Multi-Cell Power Control with NAF Reinforcement Learning.

Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks.

Power Allocation in Multi-User Cellular Networks with Deep Q Learning Approach.

Multiobjective Deep Reinforcement Learning Based Joint Beamforming and Power Allocation in UAV Assisted Cellular Communication

A Deep Reinforcement Learning-Based Technique for Optimal Power Allocation in Multiple Access Communications

Static Deep Q-learning for Green Downlink C-RAN

Design and Evaluation of Deep Reinforcement Learning for Energy Saving in Open RAN