Abstract:Device-to-device (D2D) technology, which allows direct communications between proximal devices, is widely acknowledged as a promising candidate to alleviate the mobile traffic explosion problem. In this paper, we consider an overlay D2D network, in which multiple D2D pairs coexist on several orthogonal spectrum bands, i.e., channels. Due to spectrum scarcity, the number of D2D pairs is typically more than that of available channels, and thus multiple D2D pairs may use a single channel simultaneously. This may lead to severe co-channel interference and degrade network performance. To deal with this issue, we formulate a joint channel selection and power control optimization problem, with the aim to maximize the weighted-sum-rate (WSR) of the D2D network. Unfortunately, this problem is non-convex and NP-hard. To solve this problem, we first adopt the state-of-art fractional programming (FP) technique and develop an FP-based algorithm to obtain a near-optimal solution. However, the FP-based algorithm requires instantaneous global channel state information (CSI) for centralized processing, resulting in poor scalability and prohibitively high signalling overheads. Therefore, we further propose a distributed deep reinforcement learning (DRL)-based scheme, with which D2D pairs can autonomously optimize channel selection and transmit power by only exploiting local information and outdated nonlocal information. Compared with the FP-based algorithm, the DRL-based scheme can achieve better scalability and reduce signalling overheads significantly. Simulation results demonstrate that even without instantaneous global CSI, the performance of the DRL-based scheme can approach closely to that of the FP-based algorithm.

Reinforcement Learning-Based Interference Control for Ultra-Dense Small Cells.

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Joint Interference Alignment and Power Control for Dense Networks Via Deep Reinforcement Learning

Interference Coordination for Autonomous Small Cell Networks Based on Distributed Learning.

Tradeoff Between Network Energy Consumption and Terminal Energy Consumption Via Small Cell Power Control

Decentralized Learning Based Indoor Interference Mitigation for 5G-and-beyond Systems

Reinforcement Learning-Based Computing and Transmission Scheduling for LTE-U-Enabled IoT

Deep reinforcement learning based joint cooperation clustering and downlink power control for cell-free massive MIMO

A Deep Reinforcement Learning-Based Power Control Scheme for the 5G Wireless Systems

Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination

Energy Optimization in Ultra-Dense Radio Access Networks via Traffic-Aware Cell Switching

Joint Deep Reinforcement Learning and Unsupervised Learning for Channel Selection and Power Control in D2D Networks

Secure and Reliable Downlink Transmission for Energy-Efficient User-Centric Ultra-Dense Networks: An Accelerated DRL Approach

Downlink Power Control for Cell-Free Massive MIMO with Deep Reinforcement Learning

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Energy-Efficient Ultra-Dense Network with Deep Reinforcement Learning

Joint Cooperative Clustering and Power Control for Energy-Efficient Cell-Free XL-MIMO with Multi-Agent Reinforcement Learning

A Self-Organizing Resource Allocation Strategy Based on Q-learning Approach in Ultra-Dense Networks

Multi-Agent Deep Reinforcement Learning for Computation Offloading and Interference Coordination in Small Cell Networks

Interference Avoidance in Hotspot Areas for Cell-Free Millimeter-Wave Massive MIMO Systems

Deep Reinforcement Learning for Energy-Efficient Power Control in Heterogeneous Networks