Abstract:In this paper, we consider the design of efficient strategies that allow multiple secondary users to choose channels with unknown idle probabilities to sense and access without centralized control. Due to the limited sensing capability of CR, the secondary user cannot sense all the channels simultaneously. How to design intelligent sensing strategy is crucial to track the varying spectrum opportunities. However, the availability probability of each channel is not known a prior. The need to learning the information creates a fundamental trade-off between exploration and exploitation. First, the scenario in which a single cognitive user wishes to opportunistically exploit the availability of idle spectrum is considered. An index based strategy from the classical multi-armed bandit problem is efficient to achieve asymptotically optimal performance. Then, the multiuser case is considered. However, the index based strategy for the single user cannot be applied to multiuser scenario directly. If so, collisions among secondary users degrade the overall network performance greatly. We find that randomized selection of the channel to sense is essential to avoid collisions. We extend the exploration and exploitation idea to the multiuser scenario and come up with a randomization based mixed strategy which takes the activity of other secondary users into consideration in the learning process and at the same time achieves exploration and exploitation tradeoff. Numerical simulation results show that the proposed scheme can achieve near optimal in terms of total network performance as the centralized scenario without any information exchange among cognitive users.

Spectrum Prediction and Channel Selection for Sensing-Based Spectrum Sharing Scheme Using Online Learning Techniques.

Learning-based channel selection and system performance of dynamic spectrum access

Sensing-Based Spectrum Sharing in Cognitive Radio Networks

Multislot Simultaneous Spectrum Sensing And Energy Harvesting In Cognitive Radio

A Learning-Based Two-Stage Spectrum Sharing Strategy with Multiple Primary Transmit Power Levels

A Primary Traffic Aware Opportunistic Spectrum Sensing for Cognitive Radio Networks

Secondary User and Power Allocation in Spectrum Sensing of Multi-Channel Cognitive Radio

Reinforcement Learning Enabled Cooperative Spectrum Sensing in Cognitive Radio Networks.

Joint Spectrum Sensing and Transmission Strategy for Energy-Efficient Cognitive Radio Networks

Spectrum Entropy Prediction Assisted Channel Selection for Secondary Users.

Machine Learning Techniques for Spectrum Sensing when Primary User Has Multiple Transmit Powers

Learning Multiple Primary Transmit Power Levels for Smart Spectrum Sharing

Queuing-Theoretical Multi-User Dynamic Spectrum Allocation & Sharing Mechanism in Multi-Channel Cognitive Radio Networks

Prediction-based MAC-layer Sensing in Cognitive Radio Networks

Spectrum Access In Cognitive Radio Using A Two Stage Reinforcement Learning Approach

On-demand Spectrum Sharing by Flexible Time-Slotted Cognitive Radio Networks.

Multi-Slot Cooperative Spectrum Sensing Method with Optimization in Cognitive Radio

A Multi-Channel Sensing Order Optimization Algorithm Based on Markov Prediction

Efficient Secondary Access with Intelligent Spectrum Sensing in Cognitive Radio Networks

Opportunistic Spectrum Access to 3G Wireless CDMA Networks for Cognitive Radio

Exploration Vs Exploitation for Distributed Channel Access in Cognitive Radio Networks: A Multi-User Case Study.