Abstract:Device-to-device (D2D) technology enables direct communication between adjacent devices within cellular networks. Due to its high data rate, low latency, and performance improvement in spectrum and energy efficiency, it has been widely investigated and applied as a critical technology in 5G New Radio (NR). In addition to conventional overlay and underlay D2D communications, cooperative D2D communication, which can achieve a win-win situation between cellular users (CUs) and D2D users (DUs) through cooperative relaying technique, has attracted extensive attention from academic and industrial circles in the past decade. This paper delves into optimizing joint spectrum allocation, power control, and link-matching between multiple CUs and DUs for cooperative D2D communications, using weighted sum energy efficiency (WSEE) as the performance metric to address the challenges of green communication and sustainable development. This integer programming problem can be decomposed into a classic weighted bipartite graph matching and a series of nonconvex spectrum allocation and power control problems between potentially matched cellular and D2D link pairs. To address this issue, we propose a hybrid centralized-distributed scheme based on deep reinforcement learning (DRL) and the Kuhn-Munkres (KM) algorithm. Leveraging the latter, the CUs and DUs autonomously optimize spectrum allocation and power control by only utilizing local information. Then, the base station (BS) determines the link matching. Simulation results reveal that it achieves near-optimal performance and significantly enhances the network convergence speed with low signaling overheads. In addition, we also propose and utilize cooperative link sets for corresponding D2D links to accelerate the proposed scheme and reduce signaling exchange further.

Deep-Reinforcement-Learning-Based Resource Allocation for Energy Harvesting D2D Communication

Deep Multi-Agent Reinforcement Learning for Resource Allocation in D2D Communication Underlaying Cellular Networks

D2D Communication Resource Allocation Algorithm Based on Multi-Agent Reinforcement Learning

Dynamic Spectrum Allocation For Energy Harvesting-Based Underlaying D2d Communication

Double Deep Q-Network Based Distributed Resource Matching Algorithm for D2D Communication

Machine Learning-Based Resource Optimization for D2D Communication Underlaying Networks

A Resource Allocation Scheme of D2D Energy Harvesting Networks Based on Stochastic Learning

Deep Reinforcement Learning-Assisted Energy Harvesting Wireless Networks

Energy-Efficient Resource Allocation for Energy Harvesting-Powered D2D Communications Underlaying Cellular Networks

Resource Allocation for Energy Harvesting-Aided Device-to-Device Communications: A Matching Game Approach

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

Deep Reinforcement Learning Enabled Energy-Efficient Resource Allocation in Energy Harvesting Aided V2X Communication.

Multi-Agent Deep Reinforcement Learning-Based Power Control and Resource Allocation for D2D Communications

A deep reinforcement learning-based D2D spectrum allocation underlaying a cellular network

Sustainability-Driven Resource Allocation for Energy-Harvesting Powered Device-to-Device Communication

Distributed Dynamic Spectrum Access for D2D Communications Underlying Cellular Networks Using Deep Reinforcement Learning

Resource Allocation for Energy Harvesting-Powered D2D Communication Underlaying Cellular Networks

Power Allocation of Energy Harvesting Cognitive Radio Based on Deep Reinforcement Learning

Dynamic Resource Allocations Based on Q-learning for D2D Communication in Cellular Networks

Deep Q-Learning Based Dynamic Resource Allocation for Self-Powered Ultra-Dense Networks

Partially Observable Double DQN Based IoT Scheduling for Energy Harvesting.