Abstract:Device-to-device (D2D) technology enables direct communication between adjacent devices within cellular networks. Due to its high data rate, low latency, and performance improvement in spectrum and energy efficiency, it has been widely investigated and applied as a critical technology in 5G New Radio (NR). In addition to conventional overlay and underlay D2D communications, cooperative D2D communication, which can achieve a win-win situation between cellular users (CUs) and D2D users (DUs) through cooperative relaying technique, has attracted extensive attention from academic and industrial circles in the past decade. This paper delves into optimizing joint spectrum allocation, power control, and link-matching between multiple CUs and DUs for cooperative D2D communications, using weighted sum energy efficiency (WSEE) as the performance metric to address the challenges of green communication and sustainable development. This integer programming problem can be decomposed into a classic weighted bipartite graph matching and a series of nonconvex spectrum allocation and power control problems between potentially matched cellular and D2D link pairs. To address this issue, we propose a hybrid centralized-distributed scheme based on deep reinforcement learning (DRL) and the Kuhn-Munkres (KM) algorithm. Leveraging the latter, the CUs and DUs autonomously optimize spectrum allocation and power control by only utilizing local information. Then, the base station (BS) determines the link matching. Simulation results reveal that it achieves near-optimal performance and significantly enhances the network convergence speed with low signaling overheads. In addition, we also propose and utilize cooperative link sets for corresponding D2D links to accelerate the proposed scheme and reduce signaling exchange further.

Deep Deterministic Policy Gradient for Relay Selection and Power Allocation in Cooperative Communication Network

Power Allocation for Full-Duplex Communication Systems Based on Deep Deterministic Policy Gradient

Delay-Aware Power Control for Downlink Multi-User MIMO Via Constrained Deep Reinforcement Learning.

Wireless Channel Prediction for Multi-user Physical Layer with Deep Reinforcement Learning

Partial Channel State Information Based Cooperative Relaying And Partner Selection

A Simple Cooperative Diversity Method Based on Deep-Learning-Aided Relay Selection

Novel Deep Reinforcement Learning‐based Delay‐constrained Buffer‐aided Relay Selection in Cognitive Cooperative Networks

Deep Reinforcement Learning-Based Relay Selection Algorithm in Free-Space Optical Cooperative Communications

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Learning Deterministic Policy with Target for Power Control in Wireless Networks

Balancing Performance and Cost for Two-Hop Cooperative Communications: Stackelberg Game and Distributed Multi-Agent Reinforcement Learning

Power Allocation Based on Multi-Agent Deep Deterministic Policy Gradient for Underwater Acoustic Communication Networks

Pareto-Optimal Multi-Agent Cooperative Caching Relying on Multi-Policy Reinforcement Learning

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Deep Reinforcement Learning based Downlink Beamforming and Phase Optimization for RIS-Aided Communication System

Optimal Resource Allocation in Wireless Control Systems via Deep Policy Gradient

Downlink Power Control for Cell-Free Massive MIMO with Deep Reinforcement Learning

Cooperative Proactive Eavesdropping Based on Deep Reinforcement Learning

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

Power Allocation for Statistical QoS Provisioning in Opportunistic Multi-Relay DF Cognitive Networks

DDPG-E2E: A Novel Policy Gradient Approach for End-to-End Communication Systems