Abstract:A novel LEarning-based Spectrum Sensing and Access (LESSA) framework is proposed, wherein a cognitive radio (CR) learns a time-frequency correlation model underlying spectrum occupancy of licensed users (LUs) in a radio ecosystem; concurrently, it devises an approximately optimal spectrum sensing and access policy under sensing constraints. A Baum-Welch algorithm is proposed to learn a parametric Markov transition model of LU spectrum occupancy based on noisy spectrum measurements. Spectrum sensing and access are cast as a Partially-Observable Markov Decision Process, approximately optimized via randomized point-based value iteration. Fragmentation, Hamming-distance state filters and Monte-Carlo methods are proposed to alleviate the inherent computational complexity, and a weighted reward metric to regulate the trade-off between CR throughput and LU interference. Numerical evaluations demonstrate that LESSA performs within 5 percent of a genie-aided upper bound with foreknowledge of LU spectrum occupancy, and outperforms state-of-the-art algorithms across the entire trade-off region: 71 percent over correlation-based clustering, 26 percent over Neyman-Pearson detection, 6 percent over the Viterbi algorithm, and 9 percent over an adaptive Deep Q-Network. LESSA is then extended to a distributed Multi-Agent setting (MA-LESSA), by proposing novel neighbor discovery and channel access rank allocation. MA-LESSA improves CR throughput by 43 percent over cooperative TD-SARSA, 84 percent over cooperative greedy distributed learning, and 3x over non-cooperative learning via g-statistics and ACKs. Finally, MA-LESSA is implemented on the DARPA SC2 platform, manifesting superior performance over competitors in a real-world TDWR-UNII WLAN emulation; its implementation feasibility is further validated on a testbed of ESP32 radios, exhibiting 96 percent success probability.

Spectrum Occupancy Prediction for Realistic Traffic Scenarios: Time Series versus Learning-Based Models

Analysis of Spectrum Occupancy Using Machine Learning Algorithms

Spectrum occupancy prediction using LSTM models for cognitive radio applications

Spectrum Hole Prediction Based On Historical Data: A Neural Network Approach

Prediction and Modeling of Spectrum Occupancy for Dynamic Spectrum Access Systems

Spectrum Sensing with Small-Sized Data Sets in Cognitive Radio: Algorithms and Analysis.

Analytical and Learning-Based Spectrum Sensing Time Optimization in Cognitive Radio Systems

Spatio-temporal Spectrum Load Prediction using Convolutional Neural Network and ResNet

A Primary Traffic Aware Opportunistic Spectrum Sensing for Cognitive Radio Networks

Learning-based Spectrum Sensing and Access in Cognitive Radios via Approximate POMDPs

Artificial neural network design for improved spectrum sensing in cognitive radio

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Spectrum Prediction and Channel Selection for Sensing-Based Spectrum Sharing Scheme Using Online Learning Techniques.

Deep learning application for sensing available spectrum for cognitive radio: An ECRNN approach

Deep learning-based spectrum sensing and modulation categorization for efficient data transmission in Cognitive Radio

1-D Convolutional Neural Network-Based Models for Cooperative Spectrum Sensing

Historical Spectrum Sensing Data Mining for Cognitive Radio Enabled Vehicular Ad-Hoc Networks

Adversarial Learning-Based Spectrum Sensing in Cognitive Radio

A Energy Prediction Based Spectrum Sensing Approach for Cognitive Radio Networks

Machine Learning Techniques for Spectrum Sensing when Primary User Has Multiple Transmit Powers

Context-Aware Spectrum Decision and Prediction Using Crowd-Sensing