Abstract:Here, we present a deep reinforcement learning‐based scheduling method for minimizing energy usage in multi‐unmanned aerial vehicle networks with a focus on optimizing age of information in disaster‐affected areas. By introducing a hierarchical unmanned aerial vehicle deployment strategy for cooperative path planning, we provide a solution for disaster response to collect fresh data with up to 74.20% energy savings. This letter introduces an innovative approach for minimizing energy consumption in multi‐unmanned aerial vehicles (multi‐UAV) networks using deep reinforcement learning, with a focus on optimizing the age of information (AoI) in disaster environments. A hierarchical UAV deployment strategy that facilitates cooperative trajectory planning, ensuring timely data collection and transmission while minimizing energy consumption is proposed. By formulating the inter‐UAV network path planning problem as a Markov decision process, a deep Q‐network (DQN) strategy is applied to enable real‐time decision making that accounts for dynamic environmental changes, obstacles, and UAV battery constraints. The extensive simulation results, conducted in both rural and urban scenarios, demonstrate the effectiveness of employing a memory access approach within the DQN framework, significantly reducing energy consumption up to 33.25% in rural settings and 74.20% in urban environments compared to non‐memory approaches. By integrating AoI considerations with energy‐efficient UAV control, this work offers a robust solution for maintaining fresh data in critical applications, such as disaster response, where ground‐based communication infrastructures are compromised. The use of replay memory approach, particularly the online history approach, proves crucial in adapting to changing conditions and optimizing UAV operations for both data freshness and energy consumption.

Multi-UAV Path Learning for Age and Power Optimization in IoT With UAV Battery Recharge

A Learning-Based Trajectory Planning of Multiple UAVs for AoI Minimization in IoT Networks

UAV-Aided Lifelong Learning for AoI and Energy Optimization in Non-Stationary IoT Networks

Energy optimization and age of information enhancement in multi‐UAV networks using deep reinforcement learning

Deep Reinforcement Learning for Energy-Efficient Fresh Data Collection in Rechargeable UAV-assisted IoT Networks

Energy-aware Path Planning for Obtaining Fresh Updates in UAV-IoT MEC systems

Energy-AOI-Aware UAV-Assisted Data Collection: A Multi-Agent Deep Reinforcement Learning-Based Trajectory Optimization

The UAV Trajectory Optimization for Data Collection from Time-Constrained IoT Devices: A Hierarchical Deep Q-Network Approach

Multi-Task Transfer Deep Reinforcement Learning for Timely Data Collection in Rechargeable-UAV-aided IoT Networks

Reinforcement-Learning-Based Optimization on Energy Efficiency in UAV Networks for IoT

AoI-Energy-Aware UAV-Assisted Data Collection for IoT Networks: A Deep Reinforcement Learning Method

Optimization for Master-UAV-powered Auxiliary-Aerial-IRS-assisted IoT Networks: An Option-based Multi-agent Hierarchical Deep Reinforcement Learning Approach

Age of Information Optimization with Heterogeneous UAVs Based on Deep Reinforcement Learning

AoI Oriented UAV Trajectory Planning in Wireless Powered IoT Networks

Multitask Transfer Deep Reinforcement Learning for Timely Data Collection in Rechargeable-UAV-Aided IoT Networks

Multi-Objective Optimization for UAV-Assisted Wireless Powered IoT Networks Based on Extended DDPG Algorithm

Data freshness and energy-efficient UAV navigation optimization: A deep reinforcement learning approach

Rechargeable Multi-UAV Aided Seamless Coverage for QoS-Guaranteed IoT Networks

Green Mobility Management in UAV-Assisted IoT Based on Dueling DQN

Joint Optimization of Charging Station Placement and UAV Trajectory for Fresh Data Collection

Neural Combinatorial Deep Reinforcement Learning for Age-optimal Joint Trajectory and Scheduling Design in UAV-assisted Networks