Abstract:Reconfigurable wireless network can flexibly provide efficient spectrum access service and keep stable operation in highly dynamic environment. In this paper, a primary-prioritized recurrent deep reinforcement learning algorithm for dynamic spectrum access based on cognitive radio (CR) technology is proposed. The spectrum Markov state is modeled to capture the evolution behavior to achieve the priority queuing of the primary users and the secondary users. According to the spectrum access strategies of the secondary users under different optimal criteria, we can obtain the best tradeoff benefits of spectrum access fairness and throughput. Furthermore, we proposed a learning-based algorithm for dynamic spectrum access, which allows the secondary users to modify their parameters to select the optimal access policy to maximize network throughput utilization. The Dueling Deep <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.838ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 791.5 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-51" x="0" y="0"></use></g></svg></span>-Network (Dueling DQN) with prioritized experience replay combined with recurrent neural network is used to improve the convergence speed. Extensive experimental results demonstrate that the proposed RDRL scheme outperforms the existing Dueling DQN and DQN schemes in terms of convergence speed and channel throughput.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-51" d="M399 -80Q399 -47 400 -30T402 -11V-7L387 -11Q341 -22 303 -22Q208 -22 138 35T51 201Q50 209 50 244Q50 346 98 438T227 601Q351 704 476 704Q514 704 524 703Q621 689 680 617T740 435Q740 255 592 107Q529 47 461 16L444 8V3Q444 2 449 -24T470 -66T516 -82Q551 -82 583 -60T625 -3Q631 11 638 11Q647 11 649 2Q649 -6 639 -34T611 -100T557 -165T481 -194Q399 -194 399 -87V-80ZM636 468Q636 523 621 564T580 625T530 655T477 665Q429 665 379 640Q277 591 215 464T153 216Q153 110 207 59Q231 38 236 38V46Q236 86 269 120T347 155Q372 155 390 144T417 114T429 82T435 55L448 64Q512 108 557 185T619 334T636 468ZM314 18Q362 18 404 39L403 49Q399 104 366 115Q354 117 347 117Q344 117 341 117T337 118Q317 118 296 98T274 52Q274 18 314 18Z"></path></defs></svg>

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Deep Reinforcement Learning for Distributed and Uncoordinated Cognitive Radios Resource Allocation

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC Assisted Railway IoT Networks

Deep Reinforcement Learning for Distributed Uncoordinated Cognitive Radios Resource Allocation

Learning from Peers: Deep Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G RAN Slicing

Meta Federated Reinforcement Learning for Distributed Resource Allocation

RDRL: A Recurrent Deep Reinforcement Learning Scheme for Dynamic Spectrum Access in Reconfigurable Wireless Networks

A Self-Organizing Resource Allocation Strategy Based on Q-learning Approach in Ultra-Dense Networks

Deep Reinforcement Learning Optimal Transmission Algorithm for Cognitive Internet of Things with RF Energy Harvesting

Distributed DRL-based Downlink Power Allocation for Hybrid RF/VLC Networks

Resource Allocation Using Gradient Boosting Aided Deep Q-Network for IoT in C-RANs

Meta-Gating Framework for Fast and Continuous Resource Optimization in Dynamic Wireless Environments

A Cognitive Multi-Carrier Radar for Communication Interference Avoidance Via Deep Reinforcement Learning

Graph Reinforcement Learning for Radio Resource Allocation

Deep Reinforcement Learning Based Multidimensional Resource Management for Energy Harvesting Cognitive NOMA Communications

Deep Reinforcement Learning Based Resource Allocation for Content Distribution in Fog Radio Access Networks

Empowering cognitive radio networks: residual inception–enriched recurrent convolutional neural network–driven QOS enhancement and energy efficiency strategy

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

Dynamic Spectrum Sharing Based on Deep Reinforcement Learning in Mobile Communication Systems

Computation Offloading and Resource Allocation in F-RANs: A Federated Deep Reinforcement Learning Approach