Abstract:To meet the ever increasing mobile traffic demand in 5G era, base stations (BSs) have been densely deployed in radio access networks (RANs) to increase the network coverage and capacity. However, as the high density of BSs is designed to accommodate peak traffic, it would consume an unnecessarily large amount of energy if BSs are on during off-peak time. To save the energy consumption of cellular networks, an effective way is to deactivate some idle base stations that do not serve any traffic demand. In this paper, we develop a traffic-aware dynamic BS sleep control framework, named DeepBSC, which presents a novel data-driven learning approach to determine the BS active/sleep modes while meeting lower energy consumption and satisfactory Quality of Service (QoS) requirements. Specifically, the traffic demands are predicted by the proposed GS-STN model, which leverages the geographical and semantic spatial-temporal correlations of mobile traffic. With accurate mobile traffic forecasting, the BS sleep control problem is cast as a Markov Decision Process that is solved by Actor-Critic reinforcement learning methods. To reduce the variance of cost estimation in the dynamic environment, we propose a benchmark transformation method that provides robust performance indicator for policy update. To expedite the training process, we adopt a Deep Deterministic Policy Gradient (DDPG) approach, together with an explorer network, which can strengthen the exploration further. Extensive experiments with a real-world dataset corroborate that our proposed framework significantly outperforms the existing methods.

Human Behavior Based Learning Framework for Small Cell Placement in 5G Networks Using Hypergraph Construction.

Human Behavior Based Learning Framework for Spectrum Allocation in Downlink CoMP for 5G Networks

Downlink Multi-User Scheduling with Zero-Forcing Precoding in Cognitive Hetnets: from Performance Tradeoff Perspective.

Human-Behavior and QoE-Aware Dynamic Channel Allocation for 5G Networks: A Latent Contextual Bandit Learning Approach

Learning-based Coexistence in Two-tier Heterogeneous Networks with Cognitive Small Cells.

Game-Based Approach for QoS Provisioning and Interference Management in Heterogeneous Networks

Automated Small-Cell Deployment for Heterogeneous Cellular Networks

Deployment of 5G Networking Infrastructure with Machine Type Communication Considerations

User Association and Base Station Sleep Management in Dense Heterogeneous Cellular Networks.

User-cell Association in Heterogenous Small Cell Networks: A Context-Aware Approach

A Self-Organizing Resource Allocation Strategy Based on Q-learning Approach in Ultra-Dense Networks

A Novel Network Selection Approach in 5G Heterogeneous Networks Using Q-Learning

Efficient Resource Allocation Scheme to Maximise Number of Users with Quality of Service Demands in Small Cells

Downlink Heterogeneous Small Cell Networks with Cell Associations in K-floor Indoor Scenarios

Q-Learning Based Selection Strategies for Load Balance and Energy Balance in Heterogeneous Networks

When QoE Meets Learning: A Distributed Traffic-Processing Framework for Elastic Resource Provisioning in HetNets

A Learning Approach for Traffic Offloading in Stochastic Heterogeneous Cellular Networks.

Deep Reinforcement Learning With Spatio-Temporal Traffic Forecasting for Data-Driven Base Station Sleep Control

Q-Learning Based Aerial Base Station Placement for Fairness Enhancement in Mobile Networks

Learning-based small cell base station selection scheme involving location privacy in service migration

Q-learning Based Resource Allocation for Hybrid Services with Self-similar Traffic