Abstract:Making judicious channel access and transmission scheduling decisions is essential for improving performance as well as energy and spectral efficiency in multichannel wireless systems. This problem has been a subject of extensive study in the past decade, and the resulting dynamic and opportunistic channel access schemes can bring potentially significant improvement over traditional schemes. However, a common and severe limitation of these dynamic schemes is that they almost always require some form of a priori knowledge of the channel statistics. A natural remedy is a learning framework, which has also been extensively studied in the same context, but a typical learning algorithm in this literature seeks only the best static policy, with performance measured by weak regret, rather than learning a good dynamic channel access policy. There is thus a clear disconnect between what an optimal channel access policy can achieve with known channel statistics that actively exploits temporal, spatial and spectral diversity, and what a typical existing learning algorithm aims for, which is the static use of a single channel devoid of diversity gain. In this paper we bridge this gap by designing learning algorithms that track known optimal or sub-optimal dynamic channel access and transmission scheduling policies, thereby yielding performance measured by a form of strong regret, the accumulated difference between the reward returned by an optimal solution when a priori information is available and that by our online algorithm. We do so in the context of two specific algorithms that appeared in [1] and [2], respectively, the former for a multiuser single-channel setting and the latter for a single-user multichannel setting. In both cases we show that our algorithms achieve sub-linear regret uniform in time and outperforms the standard weak-regret learning algorithms.

Dynamic Spectrum Access in Time-varying Environment: Distributed Learning Beyond Expectation Optimization

Dynamic channel selection in unknown environment based on graphical game and multi-Q learning

A Prediction And Learning Based Approach To Network Selection In Dynamic Environments

Joint Spectrum Sensing and Access for Stable Dynamic Spectrum Aggregation.

Interference-aware spectrum resource management in dynamic environment: strategic learning with higher-order statistic optimization

Dynamic Spectrum Access with Uncertain Wireless Environment: A Probabilistic Based Update Approach

Multi-user Dynamic Spectrum Access Based on Reinforcement Learning

Dynamic Spectrum Access Algorithm Based on Graphical Game in Distributed Wireless Network

Toward Optimal Adaptive Wireless Communications in Unknown Environments.

Fast Efficient Spectrum Allocation and Heterogeneous Network Selection Based on Modified Dynamic Evolutionary Game.

Distributive opportunistic spectrum access for cognitive radio using correlated equilibrium and no-regret learning

An Online Approach to Dynamic Channel Access and Transmission Scheduling

Joint Spectrum Sensing and Access Evolutionary Game in Cognitive Radio Networks.

QoE-oriented Partially Overlapping Channel Access in Wireless Networks: a Game-Theoretic Learning Approach

Dynamic Spectrum Access in Cognitive Radio Networks Using Deep Reinforcement Learning and Evolutionary Game

Distributed Learning for Optimal Spectrum Access in Dense Device-to-Device Ad-Hoc Networks

A Multi-Stage Dynamic Spectrum Sharing Framework in Cognitive Radio Networks

Toward Order Optimal Channel Access in Unknown Environments: an Online Learning Method

Spatial Spectrum Access Game

Energy-efficient dynamic spectrum access using no-regret learning

Joint Channel And Power Allocation In Dynamic Cognitive Small Cell Networks Using Asymmetric Graphical Game