Abstract:Unmanned aerial vehicle (UAV) can be deployed as aerial base station to provide communication services for the user equipments (UEs). However, in urban environments, the links between UAV and UEs might be frequently blocked by obstacles, leading to severely adverse effects on the quality of service (QoS) of UEs. Additionally, due to the limited energy of the UAV, it might not always be feasible to re-establish the line-of-sight (LoS) links by frequently adjusting the positions of the UAV. In this context, the reconfigurable intelligent surface (RIS) is utilized to enhance the transmission range of UAV-UE links by reflecting incident signals to UEs. In this paper, we investigate the RIS-assisted UAV communication systems with the goal of maximizing the energy efficiency of the UAV through a joint optimization of the UAV's trajectory and the RIS's phase shift. The formulated optimization problem is non-convex, and challenging to solve in a polynomial time. Therefore, an effective deep reinforcement learning (DRL)-based solution, named Dueling DQN-PER is proposed, which combines the Dueling DQN algorithm with the prioritized experience replay (PER) technique. To ensure the fairness among all UEs, we design a service fairness index, and integrate it into the reward function when designing the proposed algorithm. Numerical results demonstrate that: 1) the proposed Dueling DQN-PER algorithm is capable of improving the system energy efficiency and has a better training performance than benchmark schemes; 2) by devising the service fairness index, the fairness among all UEs is ensured while enhancing the system performance in energy efficiency; 3) the RIS-assisted UAV communication systems benefit from significant energy efficiency gain over the systems without RIS.

Joint Optimization of UAV-Carried IRS for Urban Low Altitude mmWave Communications with Deep Reinforcement Learning

Enabling Urban MmWave Communications with UAV-Carried IRS Via Deep Reinforcement Learning

Joint Beamforming and Trajectory Optimization for UAV-Assisted Double IRS Secure Transmission System: A Deep Reinforcement Learning Approach.

Joint Phase Shift Design and Resource Management for a Non-Orthogonal Multiple Access-Enhanced Internet of Vehicle Assisted by an Intelligent Reflecting Surface-Equipped Unmanned Aerial Vehicle

Joint Trajectory and Passive Beamforming Design for Intelligent Reflecting Surface-Aided UAV Communications: A Deep Reinforcement Learning Approach

Joint Trajectory and Power Optimization in Multi-Type UAVs Network with Mean Field Q-Learning.

Joint User Association, Interference Cancellation, and Power Control for Multi-IRS Assisted UAV Communications

Joint User Association, Interference Cancellation and Power Control for Multi-IRS Assisted UAV Communications

IRS Empowered UAV Wireless Communication with Resource Allocation, Reflecting Design and Trajectory Optimization

Joint 3D trajectory and phase shift optimization via deep reinforcement learning for RIS-assisted UAV communication systems

Joint Power and Trajectory Optimization for IRS-aided Master-Auxiliary-UAV-powered IoT Networks

Joint Optimization in Intelligent Reflecting Surface-Aided UAV Communication for Multiaccess Edge Computing

Trajectory and Transmit Power Optimization for IRS-Assisted UAV Communication under Malicious Jamming

Trajectory optimization of UAV-IRS assisted 6G THz network using deep reinforcement learning approach

Joint Trajectory Design and Resource Allocation for IRS-Assisted UAV Multipair Communications

Reconfigurable Intelligent Surface-Assisted mmWave multi-UAV Wireless Cellular Networks

Joint UAV trajectory and communication design with heterogeneous multi-agent reinforcement learning

Robust Trajectory and Communication Design in IRS-Assisted UAV Communication under Malicious Jamming

Joint Optimization of Multi-UAV Deployment and User Association Via Deep Reinforcement Learning for Long-Term Communication Coverage

Optimizing Spectrum and Energy Efficiency in IRS-enabled UAV-ground Communications

Joint Trajectory and Passive Beamforming Optimization in IRS-UAV Enhanced Anti-Jamming Communication Networks