Abstract:Recently, many opportunistic spectrum sensing and access protocols have been proposed for cognitive radio networks (CRNs), For achieving optimized spectrum usage, existing solutions model the spectrum sensing and access problem as a partially observed Markov decision process (POMDP) and assume that the information states and/or the primary users' (PUs) traffic statistics are known a priori to the secondary users (SUs). While theoretically sound, these existing approaches may not be effective in practice due to two main concerns. First, the assumptions they made are not practical, as before the communication starts, PUs' traffic statistics may not be readily available to the SUs. Secondly and more seriously, existing approaches are extremely vulnerable to malicious jamming attacks. A cognitive attacker can always jam the channels to be accessed by leveraging the same statistic information and stochastic dynamic decision making process that the SUs would follow. To address the above concerns, we formulate the problem of anti-jamming multichannel access in CRNs and solve it as a non-stochastic multi-armed bandit (NS-MAB) problem, where the secondary sender and receiver adaptively choose their arms (i. e., sending and receiving channels) to operate. The proposed protocol enables them to hop to the same set of channels with high probability in the presence of jamming. We analytically show the convergence of the learning algorithms, i. e., the performance difference between the secondary sender and receiver's optimal strategies is no more than $O \big({20k \over \sqrt{\varepsilon}}\sqrt{Tn\ln n}\,\big)$. Extensive simulations are conducted to validate the theoretical analysis and show that the proposed protocol is highly resilient to various jamming attacks.

Anti-jamming Transmissions with Learning in Heterogenous Cognitive Radio Networks

Learning-Based Multi-Domain Anti-Jamming Communication with Unknown Information

Intelligent Power Control for Spectrum Sharing in Cognitive Radios: A Deep Reinforcement Learning Approach

Anti-jamming communication in cognitive radio networks with unknown channel statistics

Context-aware Coordinated Anti-jamming Communications: A Multi-pattern Stochastic Learning Approach

Reinforcement Learning Enhanced Iterative Power Allocation in Stochastic Cognitive Wireless Mesh Networks

Hopping-Based Channel Access in Cognitive Radio Systems

Reinforcement Learning based Anti-jamming Frequency Hopping Strategies Design for Cognitive Radar

Jamming-Resilient Dynamic Spectrum Access for Cognitive Radio Networks

Intelligent Power Control for Spectrum Sharing: A Deep Reinforcement Learning Approach.

Game Theory-Based Anti-Jamming Strategies for Frequency Hopping Wireless Communications

Convert Harm into Benefit: A Coordination-Learning Based Dynamic Spectrum Anti-Jamming Approach

Intelligent Anti-Jamming Communication for Wireless Sensor Networks: A Multi-Agent Reinforcement Learning Approach

A Channel Usage Probability Awareness Anti-Jamming Channel Hopping Protocol for Cognitive Radio Networks

A Fuzzy Learning Anti-Jamming Approach With Incomplete Information

Joint Spectrum Sensing and Access Evolutionary Game in Cognitive Radio Networks.

Game-Theoretic Learning Anti-Jamming Approaches in Wireless Networks

Intelligent Reflecting Surface Assisted Anti-Jamming Communications Based on Reinforcement Learning

A Joint Sensing and Transmission Power Control Policy for RF Energy Harvesting Cognitive Radio Networks

Multi-Agent Reinforcement Learning for Dynamic Spectrum Access.

Joint Spectrum Sensing and Transmission Strategy for Energy-Efficient Cognitive Radio Networks