Abstract:A novel LEarning-based Spectrum Sensing and Access (LESSA) framework is proposed, wherein a cognitive radio (CR) learns a time-frequency correlation model underlying spectrum occupancy of licensed users (LUs) in a radio ecosystem; concurrently, it devises an approximately optimal spectrum sensing and access policy under sensing constraints. A Baum-Welch algorithm is proposed to learn a parametric Markov transition model of LU spectrum occupancy based on noisy spectrum measurements. Spectrum sensing and access are cast as a Partially-Observable Markov Decision Process, approximately optimized via randomized point-based value iteration. Fragmentation, Hamming-distance state filters and Monte-Carlo methods are proposed to alleviate the inherent computational complexity, and a weighted reward metric to regulate the trade-off between CR throughput and LU interference. Numerical evaluations demonstrate that LESSA performs within 5 percent of a genie-aided upper bound with foreknowledge of LU spectrum occupancy, and outperforms state-of-the-art algorithms across the entire trade-off region: 71 percent over correlation-based clustering, 26 percent over Neyman-Pearson detection, 6 percent over the Viterbi algorithm, and 9 percent over an adaptive Deep Q-Network. LESSA is then extended to a distributed Multi-Agent setting (MA-LESSA), by proposing novel neighbor discovery and channel access rank allocation. MA-LESSA improves CR throughput by 43 percent over cooperative TD-SARSA, 84 percent over cooperative greedy distributed learning, and 3x over non-cooperative learning via g-statistics and ACKs. Finally, MA-LESSA is implemented on the DARPA SC2 platform, manifesting superior performance over competitors in a real-world TDWR-UNII WLAN emulation; its implementation feasibility is further validated on a testbed of ESP32 radios, exhibiting 96 percent success probability.

Development of Radio Environment Map Enabled Case- and Knowledge-Based Learning Algorithms for IEEE 802.22 WRAN Cognitive Engines

Service Discovery and Device Identification in Cognitive Radio Networks

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

Fully reconfigurable cognitive OFDMA testbed

Cognitive radio realities

Cognitive radio networking and communications: an overview

Multi-antenna cognitive radio systems: Environmental learning and channel training

Key Issues Towards Beyond Lte-Advanced Systems with Cognitive Radio

Cognitive Radio on Tv Bands: A New Approach to Provide Wireless Connectivity for Rural Areas

Emerging cognitive radio technology: Principles, challenges and opportunities

A Multi-Agent Reinforcement Learning Testbed for Cognitive Radio Applications

A Real Time Testbed for the Evaluation of Cognitive Radio MAC

A Sequential Sensing Data Transmission and Fusion Approach for Large Scale Cognitive Radios

Learning-based Spectrum Sensing and Access in Cognitive Radios via Approximate POMDPs

Exploration Vs Exploitation for Distributed Channel Access in Cognitive Radio Networks: A Multi-User Case Study.

AI-Powered Real-Time Channel Awareness and 5G NR Radio Access Network Scheduling Optimization

Analysis on Deployment Parameters of Secondary Users in Cognitive Radio Networks

Optimization For Df Relaying Cognitive Radio Networks With Multiple Energy Access Points

A Usage Aware Dynamic Spectrum Access Scheme for Interweave Cognitive Radio Network by Exploiting Deep Reinforcement Learning

Efficient Resource Allocation for Cognitive Radio Networks with Cooperative Relays