Abstract:Device-to-device (D2D) technology, which allows direct communications between proximal devices, is widely acknowledged as a promising candidate to alleviate the mobile traffic explosion problem. In this paper, we consider an overlay D2D network, in which multiple D2D pairs coexist on several orthogonal spectrum bands, i.e., channels. Due to spectrum scarcity, the number of D2D pairs is typically more than that of available channels, and thus multiple D2D pairs may use a single channel simultaneously. This may lead to severe co-channel interference and degrade network performance. To deal with this issue, we formulate a joint channel selection and power control optimization problem, with the aim to maximize the weighted-sum-rate (WSR) of the D2D network. Unfortunately, this problem is non-convex and NP-hard. To solve this problem, we first adopt the state-of-art fractional programming (FP) technique and develop an FP-based algorithm to obtain a near-optimal solution. However, the FP-based algorithm requires instantaneous global channel state information (CSI) for centralized processing, resulting in poor scalability and prohibitively high signalling overheads. Therefore, we further propose a distributed deep reinforcement learning (DRL)-based scheme, with which D2D pairs can autonomously optimize channel selection and transmit power by only exploiting local information and outdated nonlocal information. Compared with the FP-based algorithm, the DRL-based scheme can achieve better scalability and reduce signalling overheads significantly. Simulation results demonstrate that even without instantaneous global CSI, the performance of the DRL-based scheme can approach closely to that of the FP-based algorithm.

Intelligent Dual Active Protocol Stack Handover based on Double DQN Deep Reinforcement Learning for 5G mmWave Networks

Enhancing Handover for 5G mmWave Mobile Networks Using Jump Markov Linear System and Deep Reinforcement Learning

Double‐deep Q‐learning‐based handover management in mmWave heterogeneous networks with dual connectivity

Autonomous handover parameter optimisation for 5G cellular networks using deep deterministic policy gradient

Learning-based Load Balancing Handover in Mobile Millimeter Wave Networks

Deep Learning-Based Intelligent Dual Connectivity for Mobility Management in Dense Network.

Authentication and Resource Allocation Strategies during Handoff for 5G IoVs Using Deep Learning

A novel handover scheme for millimeter wave network: An approach of integrating reinforcement learning and optimization

Millimeter-Wave Network Handover Control Based on Multi-Agent System

Handover Protocol Learning for LEO Satellite Networks: Access Delay and Collision Minimization

DeepPath: Multi-path Traffic Scheduling Algorithm for 5G High Dynamic Network

Adaptive double thresholds handover mechanism in small cell LTE-A network

Deep-Mobility: A Deep Learning Approach for an Efficient and Reliable 5G Handover

Dual-Connectivity Handover Scheme for a 5G-Enabled Ambulance

Handover Control in Wireless Systems via Asynchronous Multi-User Deep Reinforcement Learning

Early-Scheduled Handover Preparation in 5G NR Millimeter-Wave Systems

An Autonomous Transmission Scheme Using Dueling DQN for D2D Communication Networks

A Speed-Aware Joint Handover Approach for Clusters of D2D Devices.

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Spectrum-efficient user grouping and resource allocation based on deep reinforcement learning for mmWave massive MIMO-NOMA systems

Optimal Handover Policy for Mmwave Cellular Networks: A Multi-Armed Bandit Approach