Abstract:Cooperative spectrum sensing (CSS) technology has been widely studied to enhance the spectrum sharing efficiency spatially and temporally in cognitive radio networks (CRNs), where the secondary users (SUs) can opportunistically reuse the channels already licensed to the primary users (PUs) for transmission by sensing spectrum holes. SUs are endowed with the global awareness of channels state by cooperating with each other without sweeping across the whole frequency bands. Since the channels occupation of PUs changes dynamically, the accurate sensing and swift information sharing are crucial for CRNs. The paper proposes a multi-agent deep reinforcement learning (DRL) based CSS method to help SUs efficiently finding a vacant channel by the cooperation with their partners. 1) Two partner selection algorithms are proposed named as Reliable Partner CSS and Adaptive Partner CSS, respectively. For the former, the partner selection is facilitated based on the historical sensing accuracy of SUs. While the latter takes the comprehensive consideration of both the reliability and geographical distribution of SUs to further improve the sensing accuracy. 2) Multi-agent deep deterministic policy gradient (MADDPG) is adopted to resist the dynamically varying channels condition as well as the high-dimension solution space. With the feature of 'centralized training and decentralized execution', each SU learns to interact with the environment and select a vacant channel for transmission by its partial observation, which greatly reduces the communication overhead caused by the cooperative spectrum sensing. 3) Numerical simulation demonstrates the convergence and availability of the proposed algorithms. No matter Reliable Partner CSS or Adaptive Partner CSS, the sensing accuracy can be greatly enhanced comparing with other non-cooperative or centralized learning approaches. Besides, the attention mechanism is introduced to MADDPG for Adaptive Partner CSS to reveal the behavior of SUs by the visualization of attention weight, which helps to partially interpret the 'black box' issue of DRL.

Adaptation to the Primary User CSI in Cognitive Radio Sensing and Access

Channel-Adaptive Sensing Strategy for Cognitive Radio Ad Hoc Networks

Joint Spectrum Sensing and Resource Allocation Scheme in Cognitive Radio Networks with Spectrum Sensing Data Falsification Attack.

Adaptive Spectrum Detecting Algorithm in Cognitive Radio

A Weighted Cooperative Spectrum Sensing in Cognitive Radio Networks

Attention Enhanced Multi-Agent Reinforcement Learning for Cooperative Spectrum Sensing in Cognitive Radio Networks

Selective Sensing And Access Strategy To Maximize Throughput In Cognitive Radio Sensor Network

Secondary User and Power Allocation in Spectrum Sensing of Multi-Channel Cognitive Radio

Optimization Of Collaborating Secondary Users In A Cooperative Sensing Under Noise Uncertainty

Efficient Secondary Access with Intelligent Spectrum Sensing in Cognitive Radio Networks

Optimal Cooperative Spectrum Sensing in Multi-Channel Cognitive Radio Networks

A Novel Weighed Cooperative Bandwidth Spectrum Sensing for Spectrum Occupancy of Cognitive Radio Network

Variable bandwidth spectrum access for secondary user in cognitive radio networks.

Sensing-Throughput Tradeoff in Spectrum Handoff-Based Cognitive Radio

Energy-efficient Cooperative Spectrum Sensing over Imperfect Reporting Channels with Collision Constraint

Optimal Sensing Based Resource Allocation in Multiuser Cognitive Radio Networks

Optimization of cooperative spectrum sensing with sensing user selection in cognitive radio networks

CSI-aided MAC with Multiuser Diversity for Cognitive Radio Networks

Robust Performance of Spectrum Sensing in Cognitive Radio Networks

Intelligent Spectrum Resource Allocation Based on Joint Optimization in Heterogeneous Cognitive Radio

Selective Sensing and Transmission for Multi-Channel Cognitive Radio Networks