Abstract:Cooperative spectrum sensing (CSS) technology has been widely studied to enhance the spectrum sharing efficiency spatially and temporally in cognitive radio networks (CRNs), where the secondary users (SUs) can opportunistically reuse the channels already licensed to the primary users (PUs) for transmission by sensing spectrum holes. SUs are endowed with the global awareness of channels state by cooperating with each other without sweeping across the whole frequency bands. Since the channels occupation of PUs changes dynamically, the accurate sensing and swift information sharing are crucial for CRNs. The paper proposes a multi-agent deep reinforcement learning (DRL) based CSS method to help SUs efficiently finding a vacant channel by the cooperation with their partners. 1) Two partner selection algorithms are proposed named as Reliable Partner CSS and Adaptive Partner CSS, respectively. For the former, the partner selection is facilitated based on the historical sensing accuracy of SUs. While the latter takes the comprehensive consideration of both the reliability and geographical distribution of SUs to further improve the sensing accuracy. 2) Multi-agent deep deterministic policy gradient (MADDPG) is adopted to resist the dynamically varying channels condition as well as the high-dimension solution space. With the feature of 'centralized training and decentralized execution', each SU learns to interact with the environment and select a vacant channel for transmission by its partial observation, which greatly reduces the communication overhead caused by the cooperative spectrum sensing. 3) Numerical simulation demonstrates the convergence and availability of the proposed algorithms. No matter Reliable Partner CSS or Adaptive Partner CSS, the sensing accuracy can be greatly enhanced comparing with other non-cooperative or centralized learning approaches. Besides, the attention mechanism is introduced to MADDPG for Adaptive Partner CSS to reveal the behavior of SUs by the visualization of attention weight, which helps to partially interpret the 'black box' issue of DRL.

Cognitive Radio Spectrum Sensing Framework Based on Multi-Agent Arc Hitecture for 5G Networks.

Intelligent Multi-Agent Based C-RAN Architecture for 5G Radio Resource Management.

ON COLLABORATION MECHANISM OF MULTIUSER COOPERATIVE SPECTRUM SENSING IN COGNITIVE RADIO NETWORK

Energy-Efficient Spectrum Sensing by Optimal Periodic Scheduling in Cognitive Radio Networks

Survey on Spectrum Allocation Algorithms for Cognitive Radio Networks

Intelligent Cognitive Radio in 5G: AI-Based Hierarchical Cognitive Cellular Networks

Spectrum sensing opportunities in cognitive radios

Attention Enhanced Multi-Agent Reinforcement Learning for Cooperative Spectrum Sensing in Cognitive Radio Networks

A cooperative wideband spectrum sensing framework in the frequency domain for resource allocation with 5G-NR

Advances on Spectrum Sensing for Cognitive Radio Networks: Theory and Applications

A New Cooperative Spectrum Sensing Scheme for Cognitive Ad-Hoc Networks

A Framework of Access Network Architecture for 4G Systems Based on Cognitive Radio

Spectrum Sensing and Access in Cognitive Radio Networks

A General Framework for Spectrum Sensing Using Dedicated Spectrum Sensor Networks

Communication-oriented cooperative spectrum sensing in cognitive radio

Self-Organize Network Architecture for Multi-agent Cognitive Radio Systems.

5G-Based Wideband Cognitive Radio System Design with Cooperative Spectrum Sensing

Enhanced 5G Cognitive Radio Networks Based on Spectrum Sharing and Spectrum Aggregation

Fast and Robust Spectrum Sensing for Cognitive Radio Enabled IoT.

Multiband Spectrum Sensing and Power Allocation for aCognitive Radio-Enabled Smart Grid

Cognitive radio network management