Abstract:Cooperative spectrum sensing (CSS) technology has been widely studied to enhance the spectrum sharing efficiency spatially and temporally in cognitive radio networks (CRNs), where the secondary users (SUs) can opportunistically reuse the channels already licensed to the primary users (PUs) for transmission by sensing spectrum holes. SUs are endowed with the global awareness of channels state by cooperating with each other without sweeping across the whole frequency bands. Since the channels occupation of PUs changes dynamically, the accurate sensing and swift information sharing are crucial for CRNs. The paper proposes a multi-agent deep reinforcement learning (DRL) based CSS method to help SUs efficiently finding a vacant channel by the cooperation with their partners. 1) Two partner selection algorithms are proposed named as Reliable Partner CSS and Adaptive Partner CSS, respectively. For the former, the partner selection is facilitated based on the historical sensing accuracy of SUs. While the latter takes the comprehensive consideration of both the reliability and geographical distribution of SUs to further improve the sensing accuracy. 2) Multi-agent deep deterministic policy gradient (MADDPG) is adopted to resist the dynamically varying channels condition as well as the high-dimension solution space. With the feature of 'centralized training and decentralized execution', each SU learns to interact with the environment and select a vacant channel for transmission by its partial observation, which greatly reduces the communication overhead caused by the cooperative spectrum sensing. 3) Numerical simulation demonstrates the convergence and availability of the proposed algorithms. No matter Reliable Partner CSS or Adaptive Partner CSS, the sensing accuracy can be greatly enhanced comparing with other non-cooperative or centralized learning approaches. Besides, the attention mechanism is introduced to MADDPG for Adaptive Partner CSS to reveal the behavior of SUs by the visualization of attention weight, which helps to partially interpret the 'black box' issue of DRL.

SNR Wall for Cooperative Spectrum Sensing Using Generalized Energy Detector

On SNR wall phenomenon under cooperative energy detection in spectrum sensing

Cooperative Spectrum Sensing over Generalized Fading Channels Based on Energy Detection

A Weighted Cooperative Spectrum Sensing in Cognitive Radio Networks

Soft Decision Cooperative Spectrum Sensing Based Upon Noise Uncertainty Estimation

Performance analysis of spectrum sensing schemes based on energy detector in generalized Gaussian noise

Normalized Energy Detection Based Cooperative Spectrum Sensing with Reporting Errors in Heterogeneous Cognitive Radio Networks

A Study of SNR Wall Phenomenon under Cooperative Energy Spectrum Sensing

Attention Enhanced Multi-Agent Reinforcement Learning for Cooperative Spectrum Sensing in Cognitive Radio Networks

Cooperative spectrum sensing with enhanced energy detection under GAUSSIAN noise uncertainty in cognitive radios

Energy Detection Based Spectrum Sensing for Cognitive Radios in Noise of Uncertain Power

Spectrum Sensing Based on Hybrid Spectrum Handoff in Cognitive Radio Networks

Energy-Efficient Optimal Sensing and Resource Allocation of Soft Cooperative Spectrum Sensing in CRNs

A Robust RIS-Enabled Spectrum Sensing Algorithm for Cognitive Radio Networks

An efficient cooperative spectrum sensing algorithm in time domain

A Spectrum Sensing Scheme Based on Subspace Filtering

Sensor Selection Based on Dempster-Shafer Evidence Theory under Collaborative Spectrum Sensing in Cognitive Radio Sensor Networks.

Spectrum Sensing in Cognitive Radios Based on Enhanced Energy Detector

A Spectrum Sensing Data Falsification Countermeasure Strategy in Energy-Efficient CRN

SNR-based Weighted Cooperative Spectrum Sensing in Cognitive Radio Networks

SNR Wall and Cooperative Spectrum Sensing in Cognitive Radio under Noise Uncertainty