Abstract:With the rapid deployment of the Internet of Things (IoT), fifth-generation (5G) and beyond 5G networks are required to support massive access of a huge number of devices over limited radio spectrum radio. In wireless networks, different devices have various quality-of-service (QoS) requirements, ranging from ultra-reliable low latency communications (URLLC) to high transmission data rates. In this context, we present a joint energy-efficient subchannel assignment and power control approach to manage massive access requests while maximizing network energy efficiency (EE) and guaranteeing different QoS requirements. The latency constraint is transformed into a data rate constraint which makes the optimization problem tractable before modelling it as a multi-agent reinforcement learning problem. A distributed cooperative massive access approach based on deep reinforcement learning (DRL) is proposed to address the problem while meeting both reliability and latency constraints on URLLC services in massive access scenario. In addition, transfer learning and cooperative learning mechanisms are employed to enable communication links to work cooperatively in a distributed manner, which enhances the network performance and access success probability. Simulation results clearly show that the proposed distributed cooperative learning approach outperforms other existing approaches in terms of meeting EE and improving the transmission success probability in massive access scenario.

Q-Learning Algorithm for VoLTE Closed-Loop Power Control in Indoor Small Cells

A Framework for Automated Cellular Network Tuning with Reinforcement Learning

Tradeoff Between Network Energy Consumption and Terminal Energy Consumption Via Small Cell Power Control

Deep Q-Learning for Self-Organizing Networks Fault Management and Radio Performance Improvement

A Deep Reinforcement Learning-Based Power Control Scheme for the 5G Wireless Systems

Reinforcement Learning-Based Computing and Transmission Scheduling for LTE-U-Enabled IoT

Reinforcement Learning-Based Interference Control for Ultra-Dense Small Cells.

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Power Control of 5G-Connected Vehicular Network Using PPO-Based Deep Reinforcement Learning Algorithm

Optimization of Energy Efficiency for Uplink Murllc over Multiple Cells Using Cooperative Multi-Agent Reinforcement Learning

A Cooperative Q-learning Approach for Real-time Power Allocation in Femtocell Networks

Multi-Agent Reinforcement Learning Based Unlicensed Resource Sharing for LTE-U Networks.

A Multi-agent Reinforcement Learning Based Power Control Algorithm for D2D Communication Underlaying Cellular Networks

Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

BiLSTM Based Reinforcement Learning for Resource Allocation and User Association in LTE-U Networks

An efficient energy saving scheme using reinforcement learning for 5G and beyond in H-CRAN

Inverse Reinforcement Learning Meets Power Allocation in Multi-user Cellular Networks

Distributed interference management using Q-Learning in Cognitive Femtocell networks: New USRP-based Implementation

Static Deep Q-learning for Green Downlink C-RAN

Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination

A Novel Open Loop Power Control Method in LTE Uplink