Abstract:Designing efficient channel access schemes for wireless communications withoutany prior knowledge about the nature of environments has been a very challenging issue, espe cially when the channel states distribution of all spectrum resour ces could be entirely or partially stochastic and/or adversarial at different time and locations. In this paper, we propose an adaptive channel access algorithm for wireless communicat ions in unknown environments based on the theory of multi-armed bandits (MAB) problems. By automatically tuning two control parameters, i.e., learning rate and exploration probabili ty, our algorithms are capable of finding the optimal channel access strategies and achieving the almost optimal learning perfo rmance over time under our defined four typical regimes for general unknown environments, e.g., the stochastic regime where ch annels follow some unknown i.i.d. process, the adversarial re gime where all channels are suffered by adversarial jamming attack, the mixed stochastic and adversarial regime where a subset o f channels are attacked and the contaminated stochastic regi me where occasionally adversarial events contaminate the sto chastic channel process, etc. To reduce the implementation time and space complexity, we further develop an enhanced algorithmby exploiting the internal structure of the selection of channel access strategy. We conduct extensive simulations in all these reg imes to validate our theoretical analysis. The quantitative performance studies indicate the superior throughput gain and the flexibility of our algorithm in practice, which is resilient to both oblivious and adaptive jamming attacks with different intelligence and any attacking strength that ranges from no-attack to the full-attack of all spectrum resources.

Dynamic Spectrum Access with Uncertain Wireless Environment: A Probabilistic Based Update Approach

A Bayesian game model for joint pricing and spectrum allocation strategy of femtocell service providers

Robust Dynamic Spectrum Access in Uncertain Channels: A Fuzzy Payoffs Game Approach

Dynamic Spectrum Access in Time-varying Environment: Distributed Learning Beyond Expectation Optimization

Joint Spectrum Sensing and Access for Stable Dynamic Spectrum Aggregation.

M ay 2 01 5 Towards Optimal Adaptive Wireless Communications in Unknown Environments

Energy-Aware Opportunistic Channel Access With Decentralized Channel State Information

Dynamic Spectrum Access Algorithm Based on Graphical Game in Distributed Wireless Network

Dynamic Spectrum Access with QoS Guarantee for Wireless Networks: A Markov Approach.

Toward Optimal Adaptive Wireless Communications in Unknown Environments.

Multi-user Dynamic Spectrum Access Based on Reinforcement Learning

Opportunistic Spectrum Access for Energy-Constrained Cognitive Radios

An indirect reciprocity game theoretic framework for dynamic spectrum access

Spatial Spectrum Access Game

Adaptive mechanism design and game theoretic analysis of auction-driven dynamic spectrum access in cognitive radio networks

Dynamic spectrum access for multi-type buyers in cognitive radio networks

Users Coexistence Game over licensed and unlicensed bands

Markov-Based Optimal Access Probability for Dynamic Spectrum Access in Cognitive Radio Networks

Dynamic Spectrum Negotiation with Asymmetric Information.

Efficient and Strategyproof Spectrum Allocations in Multichannel Wireless Networks

Interference-aware spectrum resource management in dynamic environment: strategic learning with higher-order statistic optimization