Abstract:Device-to-device (D2D) technology enables direct communication between adjacent devices within cellular networks. Due to its high data rate, low latency, and performance improvement in spectrum and energy efficiency, it has been widely investigated and applied as a critical technology in 5G New Radio (NR). In addition to conventional overlay and underlay D2D communications, cooperative D2D communication, which can achieve a win-win situation between cellular users (CUs) and D2D users (DUs) through cooperative relaying technique, has attracted extensive attention from academic and industrial circles in the past decade. This paper delves into optimizing joint spectrum allocation, power control, and link-matching between multiple CUs and DUs for cooperative D2D communications, using weighted sum energy efficiency (WSEE) as the performance metric to address the challenges of green communication and sustainable development. This integer programming problem can be decomposed into a classic weighted bipartite graph matching and a series of nonconvex spectrum allocation and power control problems between potentially matched cellular and D2D link pairs. To address this issue, we propose a hybrid centralized-distributed scheme based on deep reinforcement learning (DRL) and the Kuhn-Munkres (KM) algorithm. Leveraging the latter, the CUs and DUs autonomously optimize spectrum allocation and power control by only utilizing local information. Then, the base station (BS) determines the link matching. Simulation results reveal that it achieves near-optimal performance and significantly enhances the network convergence speed with low signaling overheads. In addition, we also propose and utilize cooperative link sets for corresponding D2D links to accelerate the proposed scheme and reduce signaling exchange further.

Distributed DQN-based network-wide energy efficiency maximization for 5G NR-U and Wi-Fi coexistence environments

Deep Learning Based Power Allocation for Workload Driven Full-Duplex D2D-Aided Underlaying Networks

Scenario-oriented Small Cell Network Design for LTE-LAA and Wi-Fi Coexistence on 5 GHz

Coexistence Algorithms for LTE and WiFi Networks in Unlicensed Spectrum: Performance Optimization and Comparison.

Spatial-Reuse-Based Efficient Coexistence for Cellular and WiFi Systems in the Unlicensed Band

Energy-Efficient Cooperative Transmission in Ultra-Dense Millimeter-Wave Network: Multi-Agent Q-Learning Approach

Joint Bandwidth and Transmission Opportunity Allocation for the Coexistence Between NR-U and WiFi Systems in the Unlicensed Band

An Opportunistic Unlicensed Spectrum Utilization Method for LTE and WiFi Coexistence System

Energy Efficiency Optimization in Licensed-Assisted Access

Energy-Efficient Resource Allocation in D2D Underlaid Cellular Uplinks.

Optimizing Unlicensed Spectrum Sharing for LTE-U and WiFi Network Coexistence

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Energy Management in Heterogeneous Networks with Cell Activation, User Association and Interference Coordination

Bidirectional Mobile Offloading in LTE-U and WiFi Coexistence Systems

Energy Efficiency Maximization for Hybrid-Powered 5G Networks with Energy Cooperation

Discontinuous Reception Based Energy-Efficient User Association for 5G Heterogeneous Networks

Deep Reinforcement Learning for Network Energy Saving in 6G and Beyond Networks

Hybrid Centralized-Distributed Resource Allocation Based on Deep Reinforcement Learning for Cooperative D2D Communications

Enabling Energy Efficiency in 5G Network

Resource allocation for energy efficient user association in user-centric ultra-dense networks integrating NOMA and beamforming

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond