Abstract:Joint modulation-coding scheme (MCS) adaptation and resource block (RB) allocation is an effective approach to guarantee different quality of service (QoS) requirements of all UEs under dynamic network environments. In this article, we consider a fifth generation (5G) cellular network with time-varying wireless channels, in which the BS serves multiple user equipments (UEs) under limited available RBs. We aim to minimize the total RB consumption subject to the rigorous constraints of each UE's QoS requirement. To attain this objective, this paper puts forth an online learning technique, referred to as integrated Deep Reinforcement learning and stable Matching (DeepRM), in the sense that the MCS adaptation and RB allocation decisions are conducted without acquiring the real-time channel quality indicator (CQI) feedback. DeepRM is a closed-loop framework, where the output of deep reinforcement learning (DRL) is imported into the stable matching to guide optimal RB allocation whilst the output of stable matching is fed into the DRL framework to assist efficient MCS decision-making. Specifically, in DeepRM, we first develop a powerful DRL algorithm, termed as Action-and-Reward Branching Deep Q-network (ARBDQ), by incorporating the action branch architecture into conventional DRL and modifying the traditional deep neural network training mechanism, to perform judicious MCS decisions on different links in parallel. Then, a new many-to-one stable matching algorithm, called adaptive deferred acceptance, is exploited to dynamically adjust the RB quota of each UE in a computationally efficient fashion. Simulation results demonstrate that compared with ACO-HM, OLLA-ADA, and ARBDQ-Random algorithms, DeepRM induces much less RB consumption while guaranteeing the QoS requirements of all UEs in various network scenarios. Furthermore, under miscellaneous QoS requirement, number of UEs, and CQI reporting period setups, DeepRM is more robust than other baselines.

Joint AMC and Resource Allocation for Mobile Wireless Networks Based on Distributed MARL

Joint User Association and Resource Allocation for Mmwave Communication: A Neural Network Approach.

Joint MCS Adaptation and RB Allocation in Cellular Networks Based on Deep Reinforcement Learning with Stable Matching

Joint Subchannel, Rate and Power Allocation in OFDMA-Based Cognitive Wireless Mesh Network

Resource Allocation with Fairness in Cognitive Multi-hop Cellular Networks.

Mobility-Aware Resource Allocation for mmWave IAB Networks: A Multi-Agent Reinforcement Learning Approach

Multiple Link Access and Dynamic Resource Allocation Algorithm in Heterogeneous Wireless Networks

Deep-Reinforcement-Learning-Based Resource Allocation in ultra-dense network.

Joint QoS Control and Bitrate Selection for Video Streaming Based on Multi-agent Reinforcement Learning

Joint Resource Allocation for V2X Communications with Multi-Type Mean-Field Reinforcement Learning

Multi-agent Reinforcement Learning-based User Scheduling and Resource Allocation in Cell-free Networks.

Joint Spectrum and Power Allocation in Wireless Network: A Two-Stage Multi-Agent Reinforcement Learning Method

Deep Reinforcement Learning-based Resource Allocation for 5G Machine-type Communication in Active Distribution Networks with Time-varying Interference

Joint Resource Management for MC-NOMA: A Deep Reinforcement Learning Approach

Joint Resource Allocation for UAV-assisted V2X Communication with Mean Field Multi-Agent Reinforcement Learning

Multi-Agent Reinforcement Learning for Multi-Cell Spectrum and Power Allocation

Joint Rate and Fairness Improvement Based on Adaptive Weighted Graph Matrix for Uplink SCMA With Randomly Distributed Users

Evaluation of a New Adaptive Resource Management Scheme for Multiclass Wireless and Mobile Networks

Collaborative Optimization of Wireless Communication and Computing Resource Allocation based on Multi-Agent Federated Weighting Deep Reinforcement Learning

Resource Allocation in Uplink NOMA Systems: A Hybrid-Decision-Based Multi-Agent Deep Reinforcement Learning Approach