Abstract:Device-to-device (D2D) technology, which allows direct communications between proximal devices, is widely acknowledged as a promising candidate to alleviate the mobile traffic explosion problem. In this paper, we consider an overlay D2D network, in which multiple D2D pairs coexist on several orthogonal spectrum bands, i.e., channels. Due to spectrum scarcity, the number of D2D pairs is typically more than that of available channels, and thus multiple D2D pairs may use a single channel simultaneously. This may lead to severe co-channel interference and degrade network performance. To deal with this issue, we formulate a joint channel selection and power control optimization problem, with the aim to maximize the weighted-sum-rate (WSR) of the D2D network. Unfortunately, this problem is non-convex and NP-hard. To solve this problem, we first adopt the state-of-art fractional programming (FP) technique and develop an FP-based algorithm to obtain a near-optimal solution. However, the FP-based algorithm requires instantaneous global channel state information (CSI) for centralized processing, resulting in poor scalability and prohibitively high signalling overheads. Therefore, we further propose a distributed deep reinforcement learning (DRL)-based scheme, with which D2D pairs can autonomously optimize channel selection and transmit power by only exploiting local information and outdated nonlocal information. Compared with the FP-based algorithm, the DRL-based scheme can achieve better scalability and reduce signalling overheads significantly. Simulation results demonstrate that even without instantaneous global CSI, the performance of the DRL-based scheme can approach closely to that of the FP-based algorithm.

Optimizing Deep-Space DTN Congestion Control Via Deep Reinforcement Learning

Deep Reinforcement Learning for Smart City Communication Networks

RAN Information-Assisted TCP Congestion Control Using Deep Reinforcement Learning with Reward Redistribution

Experience-driven Networking: A Deep Reinforcement Learning based Approach

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Deep Reinforcement Learning for Router Selection in Network with Heavy Traffic

Reinforcement Learning for Cognitive Delay/Disruption Tolerant Network Node Management in an LEO-based Satellite Constellation

Deep Reinforcement Learning-aided Transmission Design for Energy-efficient Link Optimization in Vehicular Communications

Multi-Tier Deep Reinforcement Learning for Non-Terrestrial Networks

RAN Information-assisted TCP Congestion Control via DRL with Reward Redistribution

Deep-Reinforcement-Learning-Based Intelligent Routing Strategy for FANETs

Deep Reinforcement Learning for Congestion Control and Routing Optimization in LEO Satellite Networks

Enabling efficient routing for traffic engineering in SDN with Deep Reinforcement Learning

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Distributed Deep Reinforcement Learning for Resource Allocation in Digital Twin Networks

Toward Enhanced Reinforcement Learning-Based Resource Management via Digital Twin: Opportunities, Applications, and Challenges

DECC: Achieving Low Latency in Data Center Networks with Deep Reinforcement Learning

IEACC: an Intelligent Edge-Aided Congestion Control Scheme for Named Data Networking with Deep Reinforcement Learning.

Enabling Scalable Routing in Software-Defined Networks With Deep Reinforcement Learning on Critical Nodes

Deep Reinforcement Learning for Wireless Scheduling in Distributed Networked Control

Secure and Reliable Downlink Transmission for Energy-Efficient User-Centric Ultra-Dense Networks: An Accelerated DRL Approach