Abstract:Recently, many opportunistic spectrum sensing and access protocols have been proposed for cognitive radio networks (CRNs), For achieving optimized spectrum usage, existing solutions model the spectrum sensing and access problem as a partially observed Markov decision process (POMDP) and assume that the information states and/or the primary users' (PUs) traffic statistics are known a priori to the secondary users (SUs). While theoretically sound, these existing approaches may not be effective in practice due to two main concerns. First, the assumptions they made are not practical, as before the communication starts, PUs' traffic statistics may not be readily available to the SUs. Secondly and more seriously, existing approaches are extremely vulnerable to malicious jamming attacks. A cognitive attacker can always jam the channels to be accessed by leveraging the same statistic information and stochastic dynamic decision making process that the SUs would follow. To address the above concerns, we formulate the problem of anti-jamming multichannel access in CRNs and solve it as a non-stochastic multi-armed bandit (NS-MAB) problem, where the secondary sender and receiver adaptively choose their arms (i. e., sending and receiving channels) to operate. The proposed protocol enables them to hop to the same set of channels with high probability in the presence of jamming. We analytically show the convergence of the learning algorithms, i. e., the performance difference between the secondary sender and receiver's optimal strategies is no more than $O \big({20k \over \sqrt{\varepsilon}}\sqrt{Tn\ln n}\,\big)$. Extensive simulations are conducted to validate the theoretical analysis and show that the proposed protocol is highly resilient to various jamming attacks.

Channel Selection in Cognitive Radio Networks: A Switchable Bayesian Learning Automata Approach.

Joint Routing and Channel Assignment with Switching Interval Maximization for Cognitive Radio Networks

Subcarrier Assignment Schemes Based on Q-Learning in Wideband Cognitive Radio Networks.

Opportunistic Channel Selection Approach under Collision Probability Constraint in Cognitive Radio Systems

Model free dynamic sensing order selection for imperfect sensing multichannel cognitive radio networks: A Q-learning approach

Dynamic Channel Allocation-Based Call Admission Control in Cognitive Radio Networks

Constrained Bayesian Active Learning of Interference Channels in Cognitive Radio Networks

An Intelligent Bayesian Inference Based Learning Automaton Approach for Traffic Management in Radio Access Network

Almost Optimal Dynamically-Ordered Channel Sensing and Accessing for Cognitive Networks.

Reciprocal Learning For Cognitive Medium Access

On the Performance of Channel Assembling and Fragmentation in Cognitive Radio Networks

Toward Order Optimal Channel Access in Unknown Environments: an Online Learning Method

Multimedia over Cognitive Radio Networks: Towards a Cross-Layer Scheduling under Bayesian Traffic Learning

Exploration Vs Exploitation for Distributed Channel Access in Cognitive Radio Networks: A Multi-User Case Study.

Channel Assignment in Cognitive Radio Networks: A Joint Utility and Stable Matching Approach

Multi-agent Q-Learning of Channel Selection in Multi-user Cognitive Radio Systems: A Two by Two Case

Learning-based channel selection and system performance of dynamic spectrum access

Dynamic Chinese Restaurant Game in cognitive radio networks

Network Selection Strategy for Cognitive Radios with Heterogeneous Primary Networks

Novel Channel-Hopping Schemes for Cognitive Radio Networks.

Anti-jamming communication in cognitive radio networks with unknown channel statistics