Abstract:Device-to-device (D2D) technology enables direct communication between adjacent devices within cellular networks. Due to its high data rate, low latency, and performance improvement in spectrum and energy efficiency, it has been widely investigated and applied as a critical technology in 5G New Radio (NR). In addition to conventional overlay and underlay D2D communications, cooperative D2D communication, which can achieve a win-win situation between cellular users (CUs) and D2D users (DUs) through cooperative relaying technique, has attracted extensive attention from academic and industrial circles in the past decade. This paper delves into optimizing joint spectrum allocation, power control, and link-matching between multiple CUs and DUs for cooperative D2D communications, using weighted sum energy efficiency (WSEE) as the performance metric to address the challenges of green communication and sustainable development. This integer programming problem can be decomposed into a classic weighted bipartite graph matching and a series of nonconvex spectrum allocation and power control problems between potentially matched cellular and D2D link pairs. To address this issue, we propose a hybrid centralized-distributed scheme based on deep reinforcement learning (DRL) and the Kuhn-Munkres (KM) algorithm. Leveraging the latter, the CUs and DUs autonomously optimize spectrum allocation and power control by only utilizing local information. Then, the base station (BS) determines the link matching. Simulation results reveal that it achieves near-optimal performance and significantly enhances the network convergence speed with low signaling overheads. In addition, we also propose and utilize cooperative link sets for corresponding D2D links to accelerate the proposed scheme and reduce signaling exchange further.

Dynamic Clustering and Resource Allocation Using Deep Reinforcement Learning for Smart-Duplex Networks

Deep Reinforcement Learning for Dynamic Clustering and Resource Allocation in Smart-Duplex Networks

Deep-Reinforcement-Learning-Based Resource Allocation in ultra-dense network.

User Association and Power Allocation for User-Centric Smart-Duplex Networks via Tree-Structured Deep Reinforcement Learning

Deep Reinforcement Learning Based Dynamic Resource Allocation in 5G Ultra-Dense Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Load-Aware Distributed Resource Allocation for MF-TDMA Ad Hoc Networks: A Multi-Agent DRL Approach.

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

Deep Multi-Agent Reinforcement Learning for Resource Allocation in D2D Communication Underlaying Cellular Networks

Distributed Deep Reinforcement Learning for Resource Allocation in Digital Twin Networks

An Improved Dynamic Clustering Algorithm Based on Uplink Capacity Analysis in Ultra-Dense Network System

Flexible User Duplexing in Cell-Free Massive MIMO: A Deep Reinforcement Learning Approach

Load Balancing for Ultradense Networks: A Deep Reinforcement Learning-Based Approach.

Deep Q-Learning Based Dynamic Resource Allocation for Self-Powered Ultra-Dense Networks

Energy-Efficient Ultra-Dense Network with Deep Reinforcement Learning

Deep Reinforcement Learning for User Association and Resource Allocation in Heterogeneous Cellular Networks

Joint Flexible Duplexing and Power Allocation with Deep Reinforcement Learning in Cell-Free Massive MIMO System

An Interference Management Strategy for Dynamic TDD in Ultra-dense Networks.

Deep Q-Network Based Resource Allocation for UAV-assisted Ultra-Dense Networks

Deep reinforcement learning based joint cooperation clustering and downlink power control for cell-free massive MIMO

Secure and Reliable Downlink Transmission for Energy-Efficient User-Centric Ultra-Dense Networks: An Accelerated DRL Approach