Abstract:Device-to-device (D2D) technology, which allows direct communications between proximal devices, is widely acknowledged as a promising candidate to alleviate the mobile traffic explosion problem. In this paper, we consider an overlay D2D network, in which multiple D2D pairs coexist on several orthogonal spectrum bands, i.e., channels. Due to spectrum scarcity, the number of D2D pairs is typically more than that of available channels, and thus multiple D2D pairs may use a single channel simultaneously. This may lead to severe co-channel interference and degrade network performance. To deal with this issue, we formulate a joint channel selection and power control optimization problem, with the aim to maximize the weighted-sum-rate (WSR) of the D2D network. Unfortunately, this problem is non-convex and NP-hard. To solve this problem, we first adopt the state-of-art fractional programming (FP) technique and develop an FP-based algorithm to obtain a near-optimal solution. However, the FP-based algorithm requires instantaneous global channel state information (CSI) for centralized processing, resulting in poor scalability and prohibitively high signalling overheads. Therefore, we further propose a distributed deep reinforcement learning (DRL)-based scheme, with which D2D pairs can autonomously optimize channel selection and transmit power by only exploiting local information and outdated nonlocal information. Compared with the FP-based algorithm, the DRL-based scheme can achieve better scalability and reduce signalling overheads significantly. Simulation results demonstrate that even without instantaneous global CSI, the performance of the DRL-based scheme can approach closely to that of the FP-based algorithm.

Deep Reinforcement Learning for Energy-Efficient Power Control in Heterogeneous Networks

Deep Reinforcement Learning for Multi-Agent Power Control in Heterogeneous Networks

Intelligent Cloud-Edge Collaborations Assisted Energy-Efficient Power Control in Heterogeneous Networks

Lightweight Cloud-Edge Collaborations for Intelligent Power Control in Energy-Efficient Heterogeneous Networks

Cooperative Hierarchical Deep Reinforcement Learning based Joint Sleep, Power, and RIS Control for Energy-Efficient HetNet

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Collaborative Multi-BS Power Management for Dense Radio Access Network using Deep Reinforcement Learning

A Power Allocation Scheme Based on Deep Reinforcement Learning in HetNets.

Deep Reinforcement Learning for Distributed Dynamic Power Allocation in Wireless Networks.

Deep Reinforcement Learning Based Mode Selection and Power Allocation Scheme for Convergent Power-Efficient Network.

Joint Interference Alignment and Power Control for Dense Networks Via Deep Reinforcement Learning

Cooperative Hierarchical Deep Reinforcement Learning based Joint Sleep and Power Control in RIS-aided Energy-Efficient RAN

Distributed Deep Reinforcement Learning-Based Spectrum and Power Allocation for Heterogeneous Networks

Hierarchical Radio Resource Optimization for Heterogeneous Networks with Enhanced Inter-Cell Interference Coordination (Eicic)

DRAG: Deep Reinforcement Learning Based Base Station Activation in Heterogeneous Networks

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Deep Reinforcement Learning-Assisted Energy Harvesting Wireless Networks

Power Control in Energy Harvesting Multiple Access System with Reinforcement Learning.

Deep Reinforcement Learning based Modulation and Coding Scheme Selection in Cognitive Heterogeneous Networks

Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks.

Deep Reinforcement Learning for Power Control in Next-Generation WiFi Network Systems