Abstract:Unmanned aerial vehicle (UAV) can be deployed as aerial base station to provide communication services for the user equipments (UEs). However, in urban environments, the links between UAV and UEs might be frequently blocked by obstacles, leading to severely adverse effects on the quality of service (QoS) of UEs. Additionally, due to the limited energy of the UAV, it might not always be feasible to re-establish the line-of-sight (LoS) links by frequently adjusting the positions of the UAV. In this context, the reconfigurable intelligent surface (RIS) is utilized to enhance the transmission range of UAV-UE links by reflecting incident signals to UEs. In this paper, we investigate the RIS-assisted UAV communication systems with the goal of maximizing the energy efficiency of the UAV through a joint optimization of the UAV's trajectory and the RIS's phase shift. The formulated optimization problem is non-convex, and challenging to solve in a polynomial time. Therefore, an effective deep reinforcement learning (DRL)-based solution, named Dueling DQN-PER is proposed, which combines the Dueling DQN algorithm with the prioritized experience replay (PER) technique. To ensure the fairness among all UEs, we design a service fairness index, and integrate it into the reward function when designing the proposed algorithm. Numerical results demonstrate that: 1) the proposed Dueling DQN-PER algorithm is capable of improving the system energy efficiency and has a better training performance than benchmark schemes; 2) by devising the service fairness index, the fairness among all UEs is ensured while enhancing the system performance in energy efficiency; 3) the RIS-assisted UAV communication systems benefit from significant energy efficiency gain over the systems without RIS.

Joint Dual-UAV Trajectory and RIS Design for ARIS-Assisted Aerial Computing in IoT

Joint Task Offloading and Resource Allocation for RIS-assisted UAV for Mobile Edge Computing Networks.

Joint Trajectory and Passive Beamforming Design for Secure UAV Networks with RIS

Fairness-Aware Computation Offloading with Trajectory Optimization and Phase-Shift Design in RIS-Assisted Multi-UAV MEC Network

Joint Association, Trajectory, Offloading, and Resource Optimization in Air and Ground Cooperative MEC Systems

Energy-Efficient Joint Trajectory and Reflecting Design in IRS-Enabled UAV Edge Computing

Energy-Efficient UAV-Mounted RIS Assisted Mobile Edge Computing

A Joint Trajectory Design, Offloading and Resource Allocation Scheme in a Multi-UAV-assisted MEC System

Joint Deployment and Resource Management for VLC-Enabled RISs-Assisted UAV Networks

Joint Trajectory-Task-Cache Optimization With Phase-Shift Design of RIS-Assisted UAV for MEC

Joint Offloading and Trajectory Design for UAV-Enabled Mobile Edge Computing Systems

Task Offloading and Energy Optimization in Hybrid UAV-Assisted Mobile Edge Computing Systems

Joint Computation Offloading with Phase-Shift Design for RIS-Assisted Multi-UAV MEC Network

Joint 3D trajectory and phase shift optimization via deep reinforcement learning for RIS-assisted UAV communication systems

Joint Optimization of Flying Trajectory and Task Offloading for UAV-Enabled MEC Networks: A Digital Twin-Assisted Hybrid Learning Approach

Multi-UAV Assisted Air–Ground Collaborative MEC System: DRL-Based Joint Task Offloading and Resource Allocation and 3D UAV Trajectory Optimization

3D-Trajectory and Phase-Shift Design for RIS-Assisted UAV Systems Using Deep Reinforcement Learning

UAV Trajectory and Energy Efficiency Optimization in RIS-Assisted Multi-User Air-to-Ground Communications Networks

Joint Task Allocation and Trajectory Optimization for Multi-UAV Collaborative Air–Ground Edge Computing

UAV-Mounted RIS-Aided Mobile Edge Computing System: A DDQN-Based Optimization Approach

Fair Integrated Sensing and Communication For Multi-UAV Enabled Internet of Things: Joint 3D Trajectory and Resource Optimization