Abstract:The problem of opportunistic spectrum access in cognitive radio networks CRNs is considered in this paper. Especially, we discuss designing distributed learning protocols for non-cooperative secondary users SUs to efficiently utilise the spectrum opportunities. It is well known that the SUs' selfish behaviors will result in a network collapse. Each SU is thus enabled to form conjectures over how the competing SUs would respond to its decision-makings and believes that they alter future spectrum access strategies in proportion to its own current strategy variation. The conjectural belief adapts in accordance with local observations. The interaction among SUs is modelled as a stochastic learning procedure, in which each autonomous SU behaves as an intelligent agent. In this way, all SUs can independently 'learn' the behaviors of their competitors, optimise the opportunistic spectrum access strategies and finally achieve the goal of reciprocity in CRNs. Based on the belief model, two learning mechanisms, that is, the best response learning algorithm and the gradient ascent learning algorithm, are proposed to stabilise the opportunistic CRNs. We also theoretically prove that the SUs' stochastic behaviors and beliefs converge to the conjectural equilibrium under some conditions rising from the learning procedure. Numerical results are provided to evaluate the performance of the proposed mechanisms, and show that the achieved system performance gain outperforms the multi-agent Q-learning scheme and the Nash equilibrium scheme when there are numerous SUs in the CRN. Copyright © 2014 John Wiley & Sons, Ltd.

Network Selection in Cognitive Heterogeneous Networks Using Stochastic Learning

A User-Preference-Aware Terminal-Controlled Access Network Selection Scheme in Heterogeneous Wireless Networks.

A Heterogeneous Wireless Network Selection Algorithm Based on Non-Cooperative Game Theory

Collaborative spectrum sharing based on information pooling for cognitive radio networks with channel heterogeneity

Network Selection Strategy for Cognitive Radios with Heterogeneous Primary Networks

A novel access network selection algorithm for heterogeneous wireless network

Pricing-Based Spectrum Leasing For Cognitive Networks With Channel Quality Diversity

A Distributed Network Selection Method Based on Minority Game for LTE in Unlicensed Bands.

Adaptive Channel Allocation Spectrum Etiquette for Cognitive Radio Networks

Study on Network Selection for Next-Generation Heterogeneous Wireless Networks

Reciprocal Learning For Cognitive Medium Access

Traffic-Aware Online Network Selection in Heterogeneous Wireless Networks

A Chinese restaurant game for learning and decision making in cognitive radio networks

Learning and decision making with negative externality for opportunistic spectrum access

Reinforcement Learning Enhanced Iterative Power Allocation in Stochastic Cognitive Wireless Mesh Networks

Reciprocity Inspired Learning for Opportunistic Spectrum Access in Cognitive Radio Networks

A Novel Network Selection Approach in 5G Heterogeneous Networks Using Q-Learning

Heterogeneous Network Selection Algorithm for Novel 5G Services Based on Evolutionary Game

Reciprocally opportunistic spectrum access

Learning with Handoff Cost Constraint for Network Selection in Heterogeneous Wireless Networks

Cooperative Spectrum Allocation for Cognitive Radio Network: an Evolutionary Approach