Traffic-Aware Online Network Selection in Heterogeneous Wireless Networks

qihui wu,zhiyong du,panlong yang,Yu-Dong Yao,jinlong wang
DOI: https://doi.org/10.1109/TVT.2015.2394431
2016-01-01
Abstract:We focus on the network selection problem in heterogeneous wireless networks. Many traditional approaches select the best network according to quality of service (QoS) related criteria, which neglects diverse user demands. We aim to select networks maximizing the quality of experience (QoE) of users. When the availability and dynamics of network state information are considered, most of the existing approaches can not make effective selection decisions since they are vulnerable to the uncertainty in network state information. To address this issue, we introduce the idea of online learning for network selection. In this paper, we formulate the network selection problem as a continuous time multi-armed bandit (CT-MAB) problem. A traffic-aware online network selection algorithm (ONES) is designed to match typical traffic types of users with respective optimal networks in terms of QoE. Moreover, we found that the correlation among multiple traffic network selections can be exploited to improve the learning capability. This motivates us to propose another two more efficient algorithms: decoupled online network selection algorithm (D-ONES) and virtual multiplexing ONES (VM-ONES). Simulation results demonstrate that our online network selection algorithms attain around 10% gain in QoE reward rate over non learning-based algorithms and learning based algorithms without QoE considerations.
What problem does this paper attempt to address?