Abstract:In this paper, we consider the design of efficient strategies that allow multiple secondary users to choose channels with unknown idle probabilities to sense and access without centralized control. Due to the limited sensing capability of CR, the secondary user cannot sense all the channels simultaneously. How to design intelligent sensing strategy is crucial to track the varying spectrum opportunities. However, the availability probability of each channel is not known a prior. The need to learning the information creates a fundamental trade-off between exploration and exploitation. First, the scenario in which a single cognitive user wishes to opportunistically exploit the availability of idle spectrum is considered. An index based strategy from the classical multi-armed bandit problem is efficient to achieve asymptotically optimal performance. Then, the multiuser case is considered. However, the index based strategy for the single user cannot be applied to multiuser scenario directly. If so, collisions among secondary users degrade the overall network performance greatly. We find that randomized selection of the channel to sense is essential to avoid collisions. We extend the exploration and exploitation idea to the multiuser scenario and come up with a randomization based mixed strategy which takes the activity of other secondary users into consideration in the learning process and at the same time achieves exploration and exploitation tradeoff. Numerical simulation results show that the proposed scheme can achieve near optimal in terms of total network performance as the centralized scenario without any information exchange among cognitive users.

Dynamic Chinese Restaurant Game in cognitive radio networks

Dynamic Chinese Restaurant Game: Theory and Application to Cognitive Radio Networks

Delay Sensitive Communications over Cognitive Radio Networks

Multi-Channel Sensing and Access Game: Bayesian Social Learning with Negative Network Externality

Sequential multi-channel access game in distributed cognitive radio networks

Analysis of cognitive radio spectrum access with finite primary users and infinite secondary users

Joint Spectrum Sensing and Access Evolutionary Game in Cognitive Radio Networks.

Dynamic Spectrum Access in Cognitive Radio Networks Using Deep Reinforcement Learning and Evolutionary Game

Dynamic Channel Allocation-Based Call Admission Control in Cognitive Radio Networks

Joint Scheduling and Cooperative Sensing in Cognitive Radios: A Game Theoretic Approach

Learning-based channel selection and system performance of dynamic spectrum access

Learning for Dynamic Bidding in Cognitive Radio Resources

Queueing Game For Spectrum Access in Cognitive Radio Networks

Exploration Vs Exploitation for Distributed Channel Access in Cognitive Radio Networks: A Multi-User Case Study.

Dynamic Interference Minimization Routing Game for On-Demand Cognitive Pilot Channel

On the Queue Dynamics of Multiuser Multichannel Cognitive Radio Networks

Chinese Restaurant Game - Part II: Applications to Wireless Networking, Cloud Computing, and Online Social Networking

EMERGING APPLICATIONS, SERVICES, AND ENGINEERING FOR COGNITIVE CELLULAR SYSTEMS

Multi-Agent Reinforcement Learning for Dynamic Spectrum Access.

A survey of dynamic spectrum allocation based on reinforcement learning algorithms in cognitive radio networks

A Multi-Stage Dynamic Spectrum Sharing Framework in Cognitive Radio Networks