Abstract:Device-to-device (D2D) technology enables direct communication between adjacent devices within cellular networks. Due to its high data rate, low latency, and performance improvement in spectrum and energy efficiency, it has been widely investigated and applied as a critical technology in 5G New Radio (NR). In addition to conventional overlay and underlay D2D communications, cooperative D2D communication, which can achieve a win-win situation between cellular users (CUs) and D2D users (DUs) through cooperative relaying technique, has attracted extensive attention from academic and industrial circles in the past decade. This paper delves into optimizing joint spectrum allocation, power control, and link-matching between multiple CUs and DUs for cooperative D2D communications, using weighted sum energy efficiency (WSEE) as the performance metric to address the challenges of green communication and sustainable development. This integer programming problem can be decomposed into a classic weighted bipartite graph matching and a series of nonconvex spectrum allocation and power control problems between potentially matched cellular and D2D link pairs. To address this issue, we propose a hybrid centralized-distributed scheme based on deep reinforcement learning (DRL) and the Kuhn-Munkres (KM) algorithm. Leveraging the latter, the CUs and DUs autonomously optimize spectrum allocation and power control by only utilizing local information. Then, the base station (BS) determines the link matching. Simulation results reveal that it achieves near-optimal performance and significantly enhances the network convergence speed with low signaling overheads. In addition, we also propose and utilize cooperative link sets for corresponding D2D links to accelerate the proposed scheme and reduce signaling exchange further.

Deep Reinforcement-Learning Based Power and Beamforming Coordination for IoT Underlying 5G Networks

Power Allocation for Device-to-device Underlay Communication with Femtocell Using Stackelberg Game

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination

Efficient Initial Access with Deep Reinforcement Learning Based Beam Sweeping in Wireless Cellular Communication Systems

Pricing-Based Interference Coordination for D2D Communications in Cellular Networks

Machine Learning-Based Resource Optimization for D2D Communication Underlaying Networks

Cognitive radio enhanced interference coordination for femtocell networks

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Decentralized Interference Coordination for D2d Communication Underlying Cellular Networks

Hybrid Beamforming for RIS-Empowered Multi-hop Terahertz Communications: A DRL-based Method

Reinforcement Learning-Based Interference Control for Ultra-Dense Small Cells.

Joint Resource Allocation and Power Control for D2D Communication with Deep Reinforcement Learning in MCC

Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks

Deep Reinforcement Learning for Energy-Efficient Beamforming Design in Cell-Free Networks

Deep Reinforcement Learning for Distributed Dynamic Coordinated Beamforming in Massive MIMO Cellular Networks

Joint Interference Alignment and Power Control for Dense Networks Via Deep Reinforcement Learning

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

Deep reinforcement learning based joint cooperation clustering and downlink power control for cell-free massive MIMO

Joint Interference Alignment and Power Allocation Based on Stackelberg Game in Device-to-Device Communications Underlying Cellular Networks

Cellular Network Power Allocation Algorithm Based on Deep Reinforcement Learning and Artificial Intelligence