Abstract:In scenarios where traditional ground base stations (BS) are unavailable, Unmanned Aerial Vehicles (UAVs) serve as aerial BS for enabling Internet of Things (IoT) communications. This paper introduces a UAV-based downlink communication model, specifically designed to address the challenge of UAVs’ limited energy resources. Our approach innovatively employs simultaneous wireless information and power transfer (SWIPT) technology, enabling the UAV to concurrently transmit information and energy to IoT devices, a crucial capability in remote or emergency areas. The core of our contribution lies in the meticulous optimization of the UAV trajectory, power splitting (PS) ratio, and communication scheduling. These optimizations are vital for maximizing energy efficiency (EE), thereby reducing the energy consumption of the UAV while ensuring high-quality communication services. The dual objectives of amplifying EE and curtailing flight time are integrated into our model, conventional solution methods fall short in addressing this non-convex optimization problem, compounded by the complexities of UAV trajectory, PS ratio, and scheduling constraints. To overcome these challenges, we reformulate the problem as a Markov Decision Process (MDP). We then leverage the powerful reward maximization capabilities of deep reinforcement learning (DRL) to enable the UAV to take optimal, energy-efficient actions in each time slot. Our simulation results are promising, indicating that the DRL algorithm effectively optimizes the UAV trajectory and significantly enhances EE. The outcomes of our research reveal a marked improvement in UAV EE along the optimized trajectory, outperforming several alternative trajectories. Furthermore, we demonstrate that a dynamic PS ratio is more effective than a fixed ratio, highlighting the superiority of our approach. This synergy of trajectory optimization and adaptive PS ratio adjustment represents a significant advancement in efficient, sustainable UAV-enabled IoT communication, particularly under challenging conditions where conventional communication infrastructures are lacking.

Three-dimensional deep reinforcement learning for trajectory and resource optimization in UAV communication systems

Deep Reinforcement Learning Based Trajectory Design and Resource Allocation for UAV-Assisted Communications

Three-Dimensional Trajectory Design for Multi-User MISO UAV Communications: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning Based 3D UAV Trajectory Design and Frequency Band Allocation.

Deep Reinforcement Learning Based Distributed 3D UAV Trajectory Design

Trajectory Design and Resource Allocation for Multi-UAV Networks: Deep Reinforcement Learning Approaches

Deep Reinforcement Learning Based Trajectory Optimization for UAV-enabled Iot with SWIPT

3D UAV Trajectory and Data Collection Optimisation via Deep Reinforcement Learning

3D-Trajectory and Phase-Shift Design for RIS-Assisted UAV Systems Using Deep Reinforcement Learning

Multi-UAV Trajectory Design and Power Control Based on Deep Reinforcement Learning.

Trajectory Optimization for 6G-UAV Based on Deep Reinforcement Learning

Trajectory Design and Generalization for UAV Enabled Networks:A Deep Reinforcement Learning Approach

Trajectory Design for UAV-Based Internet of Things Data Collection: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV

Three-Dimension Trajectory Design for Multi-UAV Wireless Network With Deep Reinforcement Learning

Deep Reinforcement Learning Approach for Joint Trajectory Design in Multi-UAV IoT Networks

3D Trajectory Design of UAV Based on Deep Reinforcement Learning in Time-varying Scenes

Trajectory Design for Multi-UAV-Assisted Data Collection: A Multi-agent Deep Reinforcement Learning Approach

Trajectory Design and Bandwidth Assignment for UAVs-enabled Communication Network with Multi - Agent Deep Reinforcement Learning.

Trajectory Planning of UAV in Wireless Powered IoT System Based on Deep Reinforcement Learning

Joint Trajectory and Power Optimization for Energy Efficient UAV Communication Using Deep Reinforcement Learning