Abstract:The combination of energy harvesting (EH), cognitive radio (CR), and non-orthogonal multiple access (NOMA) is a promising solution to improve energy efficiency and spectral efficiency of the upcoming beyond fifth generation network (B5G), especially for support the wireless sensor communications in Internet of things (IoT) system. However, how to realize intelligent frequency, time, and energy resource allocation to support better performances is an important problem to be solved. In this paper, we study joint spectrum, energy, and time resource management for the EH-CR-NOMA IoT systems. Our goal is to minimize the number of data packets losses for all secondary sensing users (SSU), while satisfying the constraints on the maximum charging battery capacity, maximum transmitting power, maximum buffer capacity, and minimum data rate of primary users (PU) and SSUs. Due to the non-convexity of this optimization problem and the stochastic nature of the wireless environment, we propose a distributed multidimensional resource management algorithm based on deep reinforcement learning (DRL). Considering the continuity of the resources to be managed, the deep deterministic policy gradient (DDPG) algorithm is adopted, based on which each agent (SSU) can manage its own multidimensional resources without collaboration. In addition, a simplified but practical action adjuster (AA) is introduced for improving the training efficiency and battery performance protection. The provided results show that the convergence speed of the proposed algorithm is about 4 times faster than that of DDPG, and the average number of packet losses (ANPL) is about 8 times lower than that of the greedy algorithm.

An efficient energy saving scheme using reinforcement learning for 5G and beyond in H-CRAN

A Reinforcement Learning Framework for Autonomous Cell Activation and Customized Energy-Efficient Resource Allocation in C-RANs.

Relational Reinforcement Learning Based Autonomous Cell Activation in Cloud-RANs

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Multi-objective Resource Allocation for 5G Using Hierarchical Reinforcement Learning

Autonomous Cell Activation for Energy Saving in Cloud-Rans Based on Dueling Deep Q-network

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Hierarchical Reinforcement Learning for RIS-Assisted Energy-Efficient RAN

Deep Reinforcement Learning for Network Energy Saving in 6G and Beyond Networks

Using Reinforcement Learning to Reduce Energy Consumption of Ultra-Dense Networks With 5G Use Cases Requirements

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

Energy Optimization in Ultra-Dense Radio Access Networks via Traffic-Aware Cell Switching

Transfer Learning for Autonomous Cell Activation Based on Relational Reinforcement Learning With Adaptive Reward

Optimization of Energy Efficiency for Uplink Murllc over Multiple Cells Using Cooperative Multi-Agent Reinforcement Learning

Reinforcement Learning for Energy Optimization with 5G Communications in Vehicular Social Networks

Transfer Reinforcement Learning for 5G-NR mm-Wave Networks

Deep Reinforcement Learning Based Multidimensional Resource Management for Energy Harvesting Cognitive NOMA Communications

Design and Evaluation of Deep Reinforcement Learning for Energy Saving in Open RAN

Deep Reinforcement Learning for Edge Computing and Resource Allocation in 5G Beyond

Learning from Peers: Deep Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G RAN Slicing

Power Optimization in Device-to-Device Communications: A Deep Reinforcement Learning Approach with Dynamic Reward.