Abstract:This paper first provides a brief survey on existing traffic offloading techniques in wireless networks. Particularly as a case study, we put forward an online reinforcement learning framework for the problem of traffic offloading in a stochastic heterogeneous cellular network (HCN), where the time-varying traffic in the network can be offloaded to nearby small cells. Our aim is to minimize the total discounted energy consumption of the HCN while maintaining the quality-of-service (QoS) experienced by mobile users. For each cell (i.e., a macro cell or a small cell), the energy consumption is determined by its system load, which is coupled with system loads in other cells due to the sharing over a common frequency band. We model the energy-aware traffic offloading problem in such HCNs as a discrete-time Markov decision process (DTMDP). Based on the traffic observations and the traffic offloading operations, the network controller gradually optimizes the traffic offloading strategy with no prior knowledge of the DTMDP statistics. Such a model-free learning framework is important, particularly when the state space is huge. In order to solve the curse of dimensionality, we design a centralized Q-learning with compact state representation algorithm, which is named QC-learning. Moreover, a decentralized version of the QC-learning is developed based on the fact the macro base stations (BSs) can independently manage the operations of local small-cell BSs through making use of the global network state information obtained from the network controller. Simulations are conducted to show the effectiveness of the derived centralized and decentralized QC-learning algorithms in balancing the tradeoff between energy saving and QoS satisfaction.

Energy-efficient Dynamic Traffic Offloading in HetNets

Downlink Energy Efficiency Modeling And Optimization For Ultra Cellular Hetnet

Energy-efficient traffic offloading in Macro-Pico networks

Dynamic Offloading Schemes for Mobile Cloud Computing Services in Heterogeneous Networks

Energy-Aware Traffic Offloading for Green Heterogeneous Networks

D2D Communication Assisted Traffic Offloading for Massive Connections in HetNets.

Energy-efficient Traffic Offloading for Mobile Users in Two-Tier Heterogeneous Wireless Networks

Energy-Efficiency Oriented Traffic Offloading in Wireless Networks: A Brief Survey and a Learning Approach for Heterogeneous Cellular Networks

Resource Allocation Scheme for Energy Saving in Heterogeneous Networks

Traffic Aware Offloading for BS Sleeping in Heterogeneous Networks

Traffic Offloading in Heterogeneous Networks with Energy Harvesting Personal Cells-Network Throughput and Energy Efficiency.

Cellular Offloading in Heterogeneous Mobile Networks with D2d Communication Assistance

Resource Allocation for Energy Efficiency Optimization in Heterogeneous Networks

Joint Downlink and Uplink Edge Computing Offloading in Ultra-Dense HetNets

Local Delay and Energy Efficiency Analysis in HetNets with Random DTX Scheme.

Downlink Energy Efficiency of Power Allocation and Wireless Backhaul Bandwidth Allocation in Heterogeneous Small Cell Networks

Discontinuous Reception Based Energy-Efficient User Association for 5G Heterogeneous Networks

Offloading on the Edge: Analysis and Optimization of Local Data Storage and Offloading in HetNets

Energy-aware and QoS-aware Load Balancing for HetNets Powered by Renewable Energy

Performance Analysis of Heterogeneous Networks With Wireless Caching and Full Duplex Relaying

Interference management for energy saving in Heterogeneous Networks