Abstract:The combination of energy harvesting (EH), cognitive radio (CR), and non-orthogonal multiple access (NOMA) is a promising solution to improve energy efficiency and spectral efficiency of the upcoming beyond fifth generation network (B5G), especially for support the wireless sensor communications in Internet of things (IoT) system. However, how to realize intelligent frequency, time, and energy resource allocation to support better performances is an important problem to be solved. In this paper, we study joint spectrum, energy, and time resource management for the EH-CR-NOMA IoT systems. Our goal is to minimize the number of data packets losses for all secondary sensing users (SSU), while satisfying the constraints on the maximum charging battery capacity, maximum transmitting power, maximum buffer capacity, and minimum data rate of primary users (PU) and SSUs. Due to the non-convexity of this optimization problem and the stochastic nature of the wireless environment, we propose a distributed multidimensional resource management algorithm based on deep reinforcement learning (DRL). Considering the continuity of the resources to be managed, the deep deterministic policy gradient (DDPG) algorithm is adopted, based on which each agent (SSU) can manage its own multidimensional resources without collaboration. In addition, a simplified but practical action adjuster (AA) is introduced for improving the training efficiency and battery performance protection. The provided results show that the convergence speed of the proposed algorithm is about 4 times faster than that of DDPG, and the average number of packet losses (ANPL) is about 8 times lower than that of the greedy algorithm.

Energy Efficient Transmission in Underlay CR-NOMA Networks Enabled by Reinforcement Learning

A Dynamic Power Allocation Scheme in Power-Domain NOMA Using Actor-Critic Reinforcement Learning.

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Cooperative Game Aided Spectrum Sharing in Underlay Cognitive Radio Networks Employing NOMA Schemes

Distributed Sequential Coalition Formation Algorithm for Spectrum Allocation in Underlay Cognitive Radio Networks.

No-Pain No-Gain: DRL Assisted Optimization in Energy-Constrained CR-NOMA Networks

Energy Efficiency Optimization for NOMA-Based Cognitive Radio with Energy Harvesting.

Deep Reinforcement Learning Method for Energy Efficient Resource Allocation in Next Generation Wireless Networks.

AoI-Oriented Resource Allocation for NOMA-Based Wireless Powered Cognitive Radio Networks Based on Multi-Agent Deep Reinforcement Learning

A Q-Learning-Based Resource Allocation for Downlink Non-Orthogonal Multiple Access Systems Considering QoS.

Deep Reinforcement Learning Based Multidimensional Resource Management for Energy Harvesting Cognitive NOMA Communications

Optimal Resource Allocation for RF-Powered Underlay Cognitive Radio Networks with Ambient Backscatter Communication

Reinforcement Learning Enhanced Iterative Power Allocation in Stochastic Cognitive Wireless Mesh Networks

Resource Allocation for Cognitive Radio Inspired Non-Orthogonal Multiple Access Networks: A Quantum Soft Actor-Critic Method

Downlink Resource Allocation for NOMA-based Hybrid Spectrum Access in Cognitive Network

A Graph Convolutional Network-Based Deep Reinforcement Learning Approach for Resource Allocation in a Cognitive Radio Network

Resource Allocation in Uplink NOMA-IoT Networks: A Reinforcement-Learning Approach

Power Allocation for Cognitive Wireless Mesh Networks by Applying Multi-agent Q-learning Approach

Energy Efficiency Optimization in Cognitive Radio Inspired Non-Orthogonal Multiple Access.

Learning-Assisted Energy Minimization for MEC Systems With Noncompletely Overlapping NOMA

Joint Power Allocation and Channel Assignment for NOMA With Deep Reinforcement Learning