Abstract:Recently, fixed-wing unmanned aerial vehicles (fixed-wing UAVs) are able to extend the communications mission time and ease of deployment due to their powerful onboard capabilities and flexibility, and reflective intelligent surfaces (RIS) are capable of reflecting links to avoid obstacles and thus improve channel gain. Therefore, RIS-assisted fixed-wing UAVs are widely used in wireless communications. Nevertheless, fixed-wing UAVs have limited energy, so improving energy efficiency is critical. This paper focuses on energy efficiency optimization problems under RIS-assisted fixed-wing UAV communications. In communications coverage systems, the flight trajectory of fixed-wing UAVs and service scheduling to ground nodes (GNs) significantly impact energy efficiency. Existing work often adopts circular trajectory and traditional deep reinforcement learning (DRL) algorithms for optimizing trajectory and service scheduling. However, circular trajectory can not adapted to the GN distribution well. In addition, the traditional DRL algorithm has two drawbacks: the efficiency of exploring the empirical process is low, and the accuracy of handling the hybrid action space needs to be higher. Thus, we propose the midpoint iteration convex hull (MICH) algorithm based on the Graham scan to design trajectories that can be adapted to the distribution of the GNs. In addition, we propose the action screening virtual and real experience (AS-VRE) mechanism and the N-steps hybrid deep q and policy network (NsHQPN) algorithm to address the low exploration efficiency and the low fetch accuracy in handling the hybrid action space. Experiments show that our proposed MICH algorithm, AS-VRE mechanism, and NsHQPN algorithm can effectively improve the system energy efficiency and outperform other baseline schemes.

Reinforcement Learning-Based Energy Efficiency Optimization for Ris-Assisted Uav Hybrid Uplink and Downlink System

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

Joint 3D trajectory and phase shift optimization via deep reinforcement learning for RIS-assisted UAV communication systems

Green Communications: RIS-Assisted Fixed-Wing UAV Coverage Scheme Based on Deep Reinforcement Learning

Energy Harvesting Reconfigurable Intelligent Surface for UAV Based on Robust Deep Reinforcement Learning

UAV Trajectory and Energy Efficiency Optimization in RIS-Assisted Multi-User Air-to-Ground Communications Networks

Joint Trajectory and Passive Beamforming Design for Secure UAV Networks with RIS

3D-Trajectory and Phase-Shift Design for RIS-Assisted UAV Systems Using Deep Reinforcement Learning

3D Deployment and Energy Efficiency Optimization Based on DRL for RIS-assisted Air-to-Ground Communications Networks

Energy-Efficient Symbiotic UAV-Enabled MEC Networks via RIS: Joint Trajectory and Phase-Shift Control Optimization

Energy-Efficient Symbiotic Cellular-UAV Communication via aerial RIS: Joint Trajectory Design and Resource Optimization.

Energy-Efficient RIS-UAV Relay with Trajectory Optimization and Fair Communication

Joint Deployment and Resource Management for VLC-Enabled RISs-Assisted UAV Networks

RIS-Assisted UAV-Enabled Wireless Powered Communications: System Modeling and Optimization

Capacity Maximization in RIS-UAV Networks: A DDQN-Based Trajectory and Phase Shift Optimization Approach

Optimal Design for Trajectory and Phase-Shift in UAV-Mounted-RIS Communications with Reinforcement Learning

Deep Reinforcement Learning-based UAV Control for Optimized Energy Efficiency and Throughput in UAV-assisted Communication

Reinforcement-learning-based Trajectory Design and Phase-shift Control in UAV-mounted-RIS Communications

Hybrid Uplink and Downlink Transmissions for Full-Duplex UAV Communication With RIS

Energy Efficiency Optimization for RIS-Assisted UAV-Enabled MEC Systems

RIS-Assisted UAV for Fresh Data Collection in 3D Urban Environments: A Deep Reinforcement Learning Approach