Abstract:Making judicious channel access and transmission scheduling decisions is essential for improving performance as well as energy and spectral efficiency in multichannel wireless systems. This problem has been a subject of extensive study in the past decade, and the resulting dynamic and opportunistic channel access schemes can bring potentially significant improvement over traditional schemes. However, a common and severe limitation of these dynamic schemes is that they almost always require some form of a priori knowledge of the channel statistics. A natural remedy is a learning framework, which has also been extensively studied in the same context, but a typical learning algorithm in this literature seeks only the best static policy, with performance measured by weak regret, rather than learning a good dynamic channel access policy. There is thus a clear disconnect between what an optimal channel access policy can achieve with known channel statistics that actively exploits temporal, spatial and spectral diversity, and what a typical existing learning algorithm aims for, which is the static use of a single channel devoid of diversity gain. In this paper we bridge this gap by designing learning algorithms that track known optimal or sub-optimal dynamic channel access and transmission scheduling policies, thereby yielding performance measured by a form of strong regret, the accumulated difference between the reward returned by an optimal solution when a priori information is available and that by our online algorithm. We do so in the context of two specific algorithms that appeared in [1] and [2], respectively, the former for a multiuser single-channel setting and the latter for a single-user multichannel setting. In both cases we show that our algorithms achieve sub-linear regret uniform in time and outperforms the standard weak-regret learning algorithms.

Online Learning in Decentralized Multiuser Resource Sharing Problems

Decentralized Online Learning: Take Benefits from Others’ Data without Sharing Your Own to Track Global Trend

Distributed Online Learning via Cooperative Contextual Bandits

Decentralized Online Learning Methods Based on Weight-Balancing over Time-Varying Digraphs

Decentralized Scheduling with QoS Constraints: Achieving O(1) QoS Regret of Multi-Player Bandits

Online Learning Demands in Max-min Fairness

Distributed Social Learning With Imperfect Information

Distributed Online Private Learning of Convex Nondecomposable Objectives

Pricing Mechanism for Resource Sustainability in Competitive Online Learning Multi-Agent Systems

Impact of Decentralized Learning on Player Utilities in Stackelberg Games

Decentralized Nash Equilibria Learning for Online Game with Bandit Feedback

Distributed Online Learning for Joint Regret with Communication Constraints

An Online Approach to Dynamic Channel Access and Transmission Scheduling

Coordinated Online Learning for Multi-Agent Systems with Coupled Constraints and Perturbed Utility Observations

Projection-free Decentralized Online Learning for Submodular Maximization over Time-Varying Networks

Online Learning over a Decentralized Network Through ADMM

Scale-Robust Timely Asynchronous Decentralized Learning

Online Discrete Optimization in Social Networks in the Presence of Knightian Uncertainty

Active Learning for Fair and Stable Online Allocations

Online Learning Schemes for Power Allocation in Energy Harvesting Communications

Decentralized Online Learning for Noncooperative Games in Dynamic Environments