Abstract:Here, we present a deep reinforcement learning‐based scheduling method for minimizing energy usage in multi‐unmanned aerial vehicle networks with a focus on optimizing age of information in disaster‐affected areas. By introducing a hierarchical unmanned aerial vehicle deployment strategy for cooperative path planning, we provide a solution for disaster response to collect fresh data with up to 74.20% energy savings. This letter introduces an innovative approach for minimizing energy consumption in multi‐unmanned aerial vehicles (multi‐UAV) networks using deep reinforcement learning, with a focus on optimizing the age of information (AoI) in disaster environments. A hierarchical UAV deployment strategy that facilitates cooperative trajectory planning, ensuring timely data collection and transmission while minimizing energy consumption is proposed. By formulating the inter‐UAV network path planning problem as a Markov decision process, a deep Q‐network (DQN) strategy is applied to enable real‐time decision making that accounts for dynamic environmental changes, obstacles, and UAV battery constraints. The extensive simulation results, conducted in both rural and urban scenarios, demonstrate the effectiveness of employing a memory access approach within the DQN framework, significantly reducing energy consumption up to 33.25% in rural settings and 74.20% in urban environments compared to non‐memory approaches. By integrating AoI considerations with energy‐efficient UAV control, this work offers a robust solution for maintaining fresh data in critical applications, such as disaster response, where ground‐based communication infrastructures are compromised. The use of replay memory approach, particularly the online history approach, proves crucial in adapting to changing conditions and optimizing UAV operations for both data freshness and energy consumption.

Energy optimization and age of information enhancement in multi‐UAV networks using deep reinforcement learning

Multi-UAV Path Learning for Age and Power Optimization in IoT With UAV Battery Recharge

AoI-Energy-Aware UAV-Assisted Data Collection for IoT Networks: A Deep Reinforcement Learning Method

Deep Reinforcement Learning for Energy-Efficient Fresh Data Collection in Rechargeable UAV-assisted IoT Networks

Neural Combinatorial Deep Reinforcement Learning for Age-optimal Joint Trajectory and Scheduling Design in UAV-assisted Networks

Autonomous Deployment and Energy Efficiency Optimization Strategy of UAV Based on Deep Reinforcement Learning

Joint Speed Control and Energy Replenishment Optimization for UAV-assisted IoT Data Collection with Deep Reinforcement Transfer Learning

Age-constrained Energy Minimization in UAV-Assisted Wireless Powered Sensor Networks: A DQN-based Approach.

Optimizing Drone Energy Use for Emergency Communications in Disasters via Deep Reinforcement Learning

QoE-Driven Adaptive Deployment Strategy of Multi-UAV Networks Based on Hybrid Deep Reinforcement Learning

Communication-Enabled Deep Reinforcement Learning to Optimise Energy-Efficiency in UAV-Assisted Networks

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

Meta-Reinforcement Learning for Timely and Energy-efficient Data Collection in Solar-powered UAV-assisted IoT Networks

Multi-Agent Deep Reinforcement Learning For Optimising Energy Efficiency of Fixed-Wing UAV Cellular Access Points

Deep Reinforcement Learning-enabled Dynamic UAV Deployment and Power Control in Multi-UAV Wireless Networks

Multitask Transfer Deep Reinforcement Learning for Timely Data Collection in Rechargeable-UAV-Aided IoT Networks

Enhancing Sustainable Data Collection with Unmanned Aerial Vehicles: A Deep Reinforcement Learning Approach

Joint Optimization of Multi-UAV-Assisted Data Collection and Energy Replenishment Via Transfer Learning Aided Deep Reinforcement Learning

Age of Information Optimization with Heterogeneous UAVs Based on Deep Reinforcement Learning

UAV Trajectory Planning in Wireless Sensor Networks for Energy Consumption Minimization by Deep Reinforcement Learning

Multi-Task Transfer Deep Reinforcement Learning for Timely Data Collection in Rechargeable-UAV-aided IoT Networks