Abstract:In this paper, we consider the design of efficient strategies that allow multiple secondary users to choose channels with unknown idle probabilities to sense and access without centralized control. Due to the limited sensing capability of CR, the secondary user cannot sense all the channels simultaneously. How to design intelligent sensing strategy is crucial to track the varying spectrum opportunities. However, the availability probability of each channel is not known a prior. The need to learning the information creates a fundamental trade-off between exploration and exploitation. First, the scenario in which a single cognitive user wishes to opportunistically exploit the availability of idle spectrum is considered. An index based strategy from the classical multi-armed bandit problem is efficient to achieve asymptotically optimal performance. Then, the multiuser case is considered. However, the index based strategy for the single user cannot be applied to multiuser scenario directly. If so, collisions among secondary users degrade the overall network performance greatly. We find that randomized selection of the channel to sense is essential to avoid collisions. We extend the exploration and exploitation idea to the multiuser scenario and come up with a randomization based mixed strategy which takes the activity of other secondary users into consideration in the learning process and at the same time achieves exploration and exploitation tradeoff. Numerical simulation results show that the proposed scheme can achieve near optimal in terms of total network performance as the centralized scenario without any information exchange among cognitive users.

Finding Optimal Action Point for Multi-Stage Spectrum Access in Cognitive Radio Networks

Delay Sensitive Communications over Cognitive Radio Networks

Admission Control and Channel Allocation for Supporting Real-Time Applications in Cognitive Radio Networks

Optimal Action Point for Dynamic Spectrum Utilization under Rayleigh Fading.

A POMDP-based optimal spectrum sensing and access scheme for cognitive radio networks with hardware limitation

Observation Vs Statistics: Near Optimal Online Channel Access In Cognitive Radio Networks

Analysis of cognitive radio spectrum access with finite primary users and infinite secondary users

Spa: Almost Optimal Accessing Of Nonstochastic Channels In Cognitive Radio Networks

Exploration Vs Exploitation for Distributed Channel Access in Cognitive Radio Networks: A Multi-User Case Study.

Routing and Resource Allocation with Collision Constraint in Multi-Hop Cognitive Radio Networks

Cognitive spectrum access with joint opportunistic power and rate control in fading channels

Optimal Resource Allocation for Cognitive Radio Networks with Imperfect Spectrum Sensing

On Throughput Maximization in Multichannel Cognitive Radio Networks Via Generalized Access Strategy.

Design and Analysis of Distributed Hopping-Based Channel Access in Multi-Channel Cognitive Radio Systems with Delay Constraints

Optimal Cooperative Sensing Scheme Under Time-Varying Channel for Cognitive Radio Networks

Multislot Simultaneous Spectrum Sensing And Energy Harvesting In Cognitive Radio

Cross-Layer Optimized Call Admission Control in Cognitive Radio Networks

Almost Optimal Dynamically-Ordered Channel Sensing and Accessing for Cognitive Networks.

Optimal Spectrum Sensing Policy with Traffic Classification in RF-Powered CRNs

Decentralized POMDP-based cognitive radio network spectrum access algorithm

Optimal Energy-Delay Tradeoff for Opportunistic Spectrum Access in Cognitive Radio Networks