Abstract:Recently, fixed-wing unmanned aerial vehicles (fixed-wing UAVs) are able to extend the communications mission time and ease of deployment due to their powerful onboard capabilities and flexibility, and reflective intelligent surfaces (RIS) are capable of reflecting links to avoid obstacles and thus improve channel gain. Therefore, RIS-assisted fixed-wing UAVs are widely used in wireless communications. Nevertheless, fixed-wing UAVs have limited energy, so improving energy efficiency is critical. This paper focuses on energy efficiency optimization problems under RIS-assisted fixed-wing UAV communications. In communications coverage systems, the flight trajectory of fixed-wing UAVs and service scheduling to ground nodes (GNs) significantly impact energy efficiency. Existing work often adopts circular trajectory and traditional deep reinforcement learning (DRL) algorithms for optimizing trajectory and service scheduling. However, circular trajectory can not adapted to the GN distribution well. In addition, the traditional DRL algorithm has two drawbacks: the efficiency of exploring the empirical process is low, and the accuracy of handling the hybrid action space needs to be higher. Thus, we propose the midpoint iteration convex hull (MICH) algorithm based on the Graham scan to design trajectories that can be adapted to the distribution of the GNs. In addition, we propose the action screening virtual and real experience (AS-VRE) mechanism and the N-steps hybrid deep q and policy network (NsHQPN) algorithm to address the low exploration efficiency and the low fetch accuracy in handling the hybrid action space. Experiments show that our proposed MICH algorithm, AS-VRE mechanism, and NsHQPN algorithm can effectively improve the system energy efficiency and outperform other baseline schemes.

Resource Allocation for UAV Swarm-Assisted Green ISAC Networks Via Multi-Agent RL

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Distributed UAV Swarm for Device-Free Integrated Sensing and Communication Relying on Multi-Agent Reinforcement Learning

Deep Reinforcement Learning Based Resource Allocation and Trajectory Planning in Integrated Sensing and Communications UAV Network

Joint Deployment and Resource Management for VLC-Enabled RISs-Assisted UAV Networks

An Energy Effective RIS-Assisted Multi-UAV Coverage Scheme for Fairness-Aware Ground Terminals

Reinforcement Learning-Based UAVs Resource Allocation for Integrated Sensing and Communication (ISAC) System

Resource Allocation Based on Optimal Transport Theory in ISAC-Enabled Multi-UAV Networks

Resource Allocation in UAV-Assisted Networks: A Clustering-Aided Reinforcement Learning Approach

Green Communications: RIS-Assisted Fixed-Wing UAV Coverage Scheme Based on Deep Reinforcement Learning

Deep Q-Network Based Resource Allocation for UAV-assisted Ultra-Dense Networks

Learning-Based Over-the-Air Integrated Sensing, Communication and Computation in UAV Swarm-Enabled Intelligent Transportation Systems

Blocklength Allocation and Power Control in UAV-Assisted URLLC System via Multi-agent Deep Reinforcement Learning

Intelligent Resource Allocation Schemes for UAV-Swarm-Based Cooperative Sensing.

Joint Resource Allocation for UAV-assisted V2X Communication with Mean Field Multi-Agent Reinforcement Learning

Resource Allocation in UAV-D2D Networks: A Scalable Heterogeneous Multi-Agent Deep Reinforcement Learning Approach

Joint Multi-UAV Deployment and Resource Allocation Based on Personalized Federated Deep Reinforcement Learning.

Resource Allocation for UAVs-Enabled Mobile Social Networks

Radio Resource Management for Cellular-Connected UAV: A Learning Approach

UAV Assisted Integrated Sensing and Communications for Internet of Things: 3D Trajectory Optimization and Resource Allocation

Deep Reinforcement Learning for Channel and Power Allocation in UAV-enabled IoT Systems