Abstract:In scenarios where traditional ground base stations (BS) are unavailable, Unmanned Aerial Vehicles (UAVs) serve as aerial BS for enabling Internet of Things (IoT) communications. This paper introduces a UAV-based downlink communication model, specifically designed to address the challenge of UAVs’ limited energy resources. Our approach innovatively employs simultaneous wireless information and power transfer (SWIPT) technology, enabling the UAV to concurrently transmit information and energy to IoT devices, a crucial capability in remote or emergency areas. The core of our contribution lies in the meticulous optimization of the UAV trajectory, power splitting (PS) ratio, and communication scheduling. These optimizations are vital for maximizing energy efficiency (EE), thereby reducing the energy consumption of the UAV while ensuring high-quality communication services. The dual objectives of amplifying EE and curtailing flight time are integrated into our model, conventional solution methods fall short in addressing this non-convex optimization problem, compounded by the complexities of UAV trajectory, PS ratio, and scheduling constraints. To overcome these challenges, we reformulate the problem as a Markov Decision Process (MDP). We then leverage the powerful reward maximization capabilities of deep reinforcement learning (DRL) to enable the UAV to take optimal, energy-efficient actions in each time slot. Our simulation results are promising, indicating that the DRL algorithm effectively optimizes the UAV trajectory and significantly enhances EE. The outcomes of our research reveal a marked improvement in UAV EE along the optimized trajectory, outperforming several alternative trajectories. Furthermore, we demonstrate that a dynamic PS ratio is more effective than a fixed ratio, highlighting the superiority of our approach. This synergy of trajectory optimization and adaptive PS ratio adjustment represents a significant advancement in efficient, sustainable UAV-enabled IoT communication, particularly under challenging conditions where conventional communication infrastructures are lacking.

Trajectory Planning of UAV in Wireless Powered IoT System Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Trajectory Optimization for UAV-enabled Iot with SWIPT

Joint Trajectory and Power Optimization for Energy Efficient UAV Communication Using Deep Reinforcement Learning

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

Research on the UAV-aided Data Collection and Trajectory Design Based on the Deep Reinforcement Learning

Joint Optimization of Data Acquisition and Trajectory Planning for UAV-Assisted Wireless Powered Internet of Things

Deep RL-based Trajectory Planning for AoI Minimization in UAV-assisted IoT

Trajectory Planning for UAV-Assisted Data Collection in IoT Network: A Double Deep Q Network Approach

Three-dimensional deep reinforcement learning for trajectory and resource optimization in UAV communication systems

3D UAV Trajectory and Data Collection Optimisation via Deep Reinforcement Learning

AoI Oriented UAV Trajectory Planning in Wireless Powered IoT Networks

Priority-Oriented Trajectory Planning for UAV-Aided Time-Sensitive IoT Networks

Joint Power Control and UAV Trajectory Design for Information Freshness Via Deep Reinforcement Learning

AoI optimal UAV trajectory planning: A Deep Recurrent Reinforcement Learning Approach

Green Mobility Management in UAV-Assisted IoT Based on Dueling DQN

Deep Reinforcement Learning-enabled Dynamic UAV Deployment and Power Control in Multi-UAV Wireless Networks

The UAV Trajectory Optimization for Data Collection from Time-Constrained IoT Devices: A Hierarchical Deep Q-Network Approach

Joint Cluster Head Selection and Trajectory Planning in UAV-Aided IoT Networks by Reinforcement Learning with Sequential Model

Joint AoI-Aware UAVs Trajectory Planning and Data Collection in UAV-Based IoT Systems: A Deep Reinforcement Learning Approach

AoI Optimal Trajectory Planning for Cooperative UAVs: A Multi-Agent Deep Reinforcement Learning Approach

Trajectory Design for Multi-UAV-Enabled Wireless Powered Communication Networks: A Multi-Agent DRL Approach