Abstract:This article investigates the unmanned aerial vehicle (UAV)-assisted wireless powered Internet-of-Things system, where a UAV takes off from a data center, flies to each of the ground sensor nodes (SNs) in order to transfer energy and collect data from the SNs, and then returns to the data center. For such a system, an optimization problem is formulated to minimize the average Age of Information (AoI) of the data collected from all ground SNs. Since the average AoI depends on the UAV's trajectory, the time required for energy harvesting (EH) and data collection for each SN, these factors need to be optimized jointly. Moreover, instead of the traditional linear EH model, we employ a nonlinear model because the behavior of the EH circuits is nonlinear by nature. To solve this nonconvex problem, we propose to decompose it into two subproblems, i.e., a joint energy transfer and data collection time allocation problem and a UAV's trajectory planning problem. For the first subproblem, we prove that it is convex and give an optimal solution by using Karush-Kuhn-Tucker (KKT) conditions. This solution is used as the input for the second subproblem, and we solve optimally it by designing dynamic programming (DP) and ant colony (AC) heuristic algorithms. The simulation results show that the DP-based algorithm obtains the minimal average AoI of the system, and the AC-based heuristic finds solutions with near-optimal average AoI. The results also reveal that the average AoI increases as the flying altitude of the UAV increases and linearly with the size of the collected data at each ground SN.

Deep RL-based Trajectory Planning for AoI Minimization in UAV-assisted IoT

A Learning-Based Trajectory Planning of Multiple UAVs for AoI Minimization in IoT Networks

A Novel AI-Based Framework for AoI-Optimal Trajectory Planning in UAV-Assisted Wireless Sensor Networks

Traffic Learning and Proactive UAV Trajectory Planning for Data Uplink in Markovian IoT Models

Trajectory Planning for UAV-Assisted Data Collection in IoT Network: A Double Deep Q Network Approach

Deep Reinforcement Learning-Driven UAV Data Collection Path Planning: A Study on Minimizing AoI

UAV Trajectory Planning for AoI-Minimal Data Collection in UAV-Aided IoT Networks by Transformer

Model-aided Deep Reinforcement Learning for Sample-efficient UAV Trajectory Design in IoT Networks

Trajectory Design for UAV-Based Internet of Things Data Collection: A Deep Reinforcement Learning Approach

Joint Cluster Head Selection and Trajectory Planning in UAV-Aided IoT Networks by Reinforcement Learning with Sequential Model

DRL-UTPS: DRL-Based Trajectory Planning for Unmanned Aerial Vehicles for Data Collection in Dynamic IoT Network

Priority-Oriented Trajectory Planning for UAV-Aided Time-Sensitive IoT Networks

The UAV Trajectory Optimization for Data Collection from Time-Constrained IoT Devices: A Hierarchical Deep Q-Network Approach

AoI-Minimal Trajectory Planning and Data Collection in UAV-Assisted Wireless Powered IoT Networks

Research on the UAV-aided Data Collection and Trajectory Design Based on the Deep Reinforcement Learning

Three-dimensional deep reinforcement learning for trajectory and resource optimization in UAV communication systems

Joint Trajectory and Scheduling Optimization for Age of Synchronization Minimization in UAV-Assisted Networks with Random Updates

Deep Reinforcement Learning for Fresh Data Collection in UAV-assisted IoT Networks

Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV

3D UAV Trajectory and Data Collection Optimisation via Deep Reinforcement Learning

Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance