Abstract:Device-to-device (D2D) communication has been regarded as a promising solution to alleviate the mobile traffic explosion problem for its capabilities of improving system data rate and resource utilization. A reconfigurable intelligent surface (RIS) aided mobile D2D communications framework is investigated, where the RIS is deployed to improve communication quality. As the transmission distance of D2D pairs changes, the mode selection for D2D pairs and the phase shift design for RIS is essential for mobile scenarios. Therefore, we formulate a joint optimization problem of mode selection, channel assignment, power allocation, and discrete phase shift selection to maximize the average sum data rate of D2D pairs. This problem is also constrained by the maximum transmit power and the minimum data rate requirements of users, where the latter is to guarantee the fairness of D2D pairs. We first reformulate the original sequential decision-making problem into a Markov game (MG) problem to solve the challenging optimization. Furthermore, a multi-agent deep reinforcement learning (MADRL) framework is proposed, in which multiple agents cooperatively determine the joint mode selection and resource allocation strategy. The proposed MADRL-based framework combines both the multi-pass deep Q-networks (MP-DQN) algorithm and the decaying DQN algorithm to solve the optimization problem. Specifically, we adopt the MP-DQN algorithm for D2D pairs to handle the hybrid discrete-continuous action space. Moreover, the decaying DQN algorithm is invoked by the RIS agent to select discrete phase shifts. Simulation results demonstrate that the proposed algorithm can converge under different cases. The proposed MADRL-based algorithm outperforms the combination algorithm of DQN and the deep deterministic policy gradient (DDPG) in terms of system performance. Moreover, it is also shown that the average sum data rate of D2D pairs can be significantly improved by deploying the RIS and further enhanced by increasing the number of reflecting elements (REs).

Deep Reinforcement Learning for Communication and Computing Resource Allocation in RIS Aided MEC Networks

Priority-Aware Resource Allocation for RIS-assisted Mobile Edge Computing Networks: A Deep Reinforcement Learning Approach

An Efficient Computation Offloading and Resource Allocation Algorithm in RIS Empowered MEC

Deep Reinforcement Learning for Computation Rate Maximization in RIS-Enabled Mobile Edge Computing

Deep Reinforcement Learning‐Based Multireconfigurable Intelligent Surface for MEC Offloading

Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC Assisted Railway IoT Networks

Deep Reinforcement Learning for RIS-Aided Secure Mobile Edge Computing in Industrial Internet of Things

Deep Reinforcement Learning Based Computation Offloading and Resource Allocation for MEC

RIS-Empowered MEC for URLLC Systems with Digital-Twin-Driven Architecture

Security Enhancement for RIS-Aided MEC Systems with Deep Reinforcement Learning

Deep Reinforcement Learning for Energy Minimization in Multi-RIS-Aided Cell-Free MEC Networks

Meta Reinforcement Learning-Based Computation Offloading in RIS-Aided MEC-Enabled Cell-Free RAN

Deep Reinforcement Learning Empowered Joint Mode Selection and Resource Allocation for RIS-aided D2D Communications

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

Decentralized Computation Offloading for Multi-User Mobile Edge Computing: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Secure MEC Service in Vehicular Networks with Reconfigurable Intelligent Surfaces

Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach

Integrated Beamforming and Resource Allocation in RIS-Assisted Mmwave Networks Based on Deep Reinforcement Learning

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Double Riss Assisted Task Offloading for NOMA-MEC with Action-Constrained Deep Reinforcement Learning

Adaptive Resource Allocation for Mobile Edge Computing in Internet of Vehicles: A Deep Reinforcement Learning Approach