Abstract:Device-to-device (D2D) technology enables direct communication between adjacent devices within cellular networks. Due to its high data rate, low latency, and performance improvement in spectrum and energy efficiency, it has been widely investigated and applied as a critical technology in 5G New Radio (NR). In addition to conventional overlay and underlay D2D communications, cooperative D2D communication, which can achieve a win-win situation between cellular users (CUs) and D2D users (DUs) through cooperative relaying technique, has attracted extensive attention from academic and industrial circles in the past decade. This paper delves into optimizing joint spectrum allocation, power control, and link-matching between multiple CUs and DUs for cooperative D2D communications, using weighted sum energy efficiency (WSEE) as the performance metric to address the challenges of green communication and sustainable development. This integer programming problem can be decomposed into a classic weighted bipartite graph matching and a series of nonconvex spectrum allocation and power control problems between potentially matched cellular and D2D link pairs. To address this issue, we propose a hybrid centralized-distributed scheme based on deep reinforcement learning (DRL) and the Kuhn-Munkres (KM) algorithm. Leveraging the latter, the CUs and DUs autonomously optimize spectrum allocation and power control by only utilizing local information. Then, the base station (BS) determines the link matching. Simulation results reveal that it achieves near-optimal performance and significantly enhances the network convergence speed with low signaling overheads. In addition, we also propose and utilize cooperative link sets for corresponding D2D links to accelerate the proposed scheme and reduce signaling exchange further.

A Multi-agent Reinforcement Learning Based Power Control Algorithm for D2D Communication Underlaying Cellular Networks

D2D Power Control Based on Supervised and Unsupervised Learning

Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

Tradeoff Between Network Energy Consumption and Terminal Energy Consumption Via Small Cell Power Control

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Machine Learning-Based Resource Optimization for D2D Communication Underlaying Networks

Double Deep Q-Network Based Distributed Resource Matching Algorithm for D2D Communication

Power Optimization in Device-to-Device Communications: A Deep Reinforcement Learning Approach with Dynamic Reward.

Downlink Resource Allocation and Power Control for Device-to-Device Communication Underlaying Cellular Networks.

Power Allocation Algorithm Based on Machine Learning for Device-to-Device Communication in Cellular Network

Joint Deep Reinforcement Learning and Unsupervised Learning for Channel Selection and Power Control in D2D Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Joint Resource Allocation and Power Control for D2D Communication with Deep Reinforcement Learning in MCC

Energy-Efficient Resource Allocation in D2D Underlaid Cellular Uplinks.

Distributed Power Control for Energy Saving in Device-to-Device Communication Underlaying Cellular Network from Game Perspective

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

Power Control of Full-Duplex D2D Communication Underlying Cellular Networks.

Deep Reinforcement Learning for Multi-Agent Power Control in Heterogeneous Networks

Distributed Power Allocation for Device-to-device Communications Underlaying Cellular Networks

D2D Power Control Based on Hierarchical Extreme Learning Machine.

Hybrid Centralized-Distributed Resource Allocation for Device-to-Device Communication Underlaying Cellular Networks