Thompson Sampling-Based Dynamic Spectrum Access in Non-Stationary Environments

Shuai Ye,Tianyu Wang,Shaowei Wang
DOI: https://doi.org/10.1109/tccn.2023.3237578
2022-01-01
Abstract:In dynamic spectrum access (DSA), unlicensed secondary users can estimate the idle probability of each primary channel by using historical sensing results and access the channel with the highest idle probability for opportunistic transmission. Most of the existing works assume that each primary channel is associated with a constant idle probability, which can be accurately estimated by sensing the channel multiple times. However, due to the rapid traffic change and irregular user mobility, primary channels can be highly dynamic and the associated idle probability is generally time-varying. In this paper, we consider DSA in non-stationary environments where the idle probabilities of primary channels vary with time. Specifically, we propose a DSA scheme based on the Thompson sampling method with a change-detection technique, which is capable of detecting the variation of channel statistics and adjusting the channel access strategy accordingly. Numerical results show that the proposed algorithm outperforms the existing algorithms in terms of successful transmission ratio in various settings.
What problem does this paper attempt to address?