Abstract:This paper investigates the coexistence of the New Radio-based access to Unlicensed spectrum (NR-U) network and the Wireless Gigabit (WiGig) network in unlicensed millimeter-wave (mmWave) bands. To enable the NR-U network to achieve equitable and harmonious spectrum sharing with WiGig systems, we develop two new classes of user equipment (UE) scheduling schemes by exploiting the deep reinforcement learning (DRL) technique. Specifically, we first propose the distributed deep reinforcement learning scheduling (DeepDS) scheme, wherein multiple deep neural networks (DNNs) are used to make decisions for different panels in an independent fashion. Thereafter, to reduce the computational cost of adopting multiple DNNs, we design the centralized deep reinforcement learning scheduling (DeepCS) scheme that introduces the shared DNN framework to perform decisions for all panels in parallel at one time. The objective of both DeepDS and DeepCS is to maximize the total data rate of the NR-U network with as little interference to WiGig systems as possible, while satisfying the quality of service (QoS) requirement for each UE. We first formulate this problem into the constrained Markov decision process framework. To address the multi-constraint issue, we put forth a new DRL algorithm that incorporates the Lagrangian primal-dual optimization into the deep Q-network framework, referred to as adaptive multi-constraint deep Q-network (AMC-DQN). With AMC-DQN, both DeepDS and DeepCS can achieve their goals even without acquiring prior operations about the WiGig network. Simulation results show that compared with the state-of-the-art omniLBT and dirLBT, both DeepDS and DeepCS yield significant performance benefits in terms of the total network data rate. We also demonstrate the ability of DeepDS and DeepCS to satisfy the QoS requirements of different UEs and their robustness against various simulation setups. Furthermore, compared with DeepDS, DeepCS can save a large amount of computational cost although at the expense of a slightly lower data rate.

Experience-Driven Wireless D2D Network Link Scheduling: A Deep Learning Approach.

Wireless D2D Network Link Scheduling Based on Graph Embedding

Age of Information-Based Scheduling for Wireless D2D Systems with a Deep Learning Approach

Wireless Link Scheduling for D2D Communications with Graph Embedding Technique

Age of Information-based Scheduling for Wireless Device-to-Device Communications Using Deep Learning

Graph Embedding Based Wireless Link Scheduling with Few Training Samples

A Deep Learning Approach for Maximum Activity Links in D2D Communications

Machine Learning-Based Resource Optimization for D2D Communication Underlaying Networks

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

Deep Learning based Wireless Resource Allocation with Application to Vehicular Networks

Learning to Branch: Accelerating Resource Allocation in Wireless Networks

Integrated Resource Scheduling for User Experience Enhancement: A Heuristically Accelerated DRL

Realtime Scheduling and Power Allocation Using Deep Neural Networks

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Buffer-Aware Wireless Scheduling Based On Deep Reinforcement Learning

Double Deep Q-Network Based Distributed Resource Matching Algorithm for D2D Communication

Deep Learning for Wireless Networked Systems: a joint Estimation-Control-Scheduling Approach

Deep-Learning-Based Resource Allocation for Time-Sensitive Device-to-Device Networks

Deep Reinforcement Learning-Based Scheduling for NR-U/WiGig Coexistence in Unlicensed Mmwave Bands

Deep Reinforcement Learning-Based Adaptive Scheduling for Wireless Time-Sensitive Networking

Deep Reinforcement Learning Based Power Allocation for D2D Network