Abstract:Unmanned-aerial-vehicle (UAV)-assisted data collection has been emerging as a prominent application due to its flexibility, mobility, and low operational cost. However, under the dynamic and uncertainty of Internet of Things data collection and energy replenishment processes, optimizing the performance for UAV collectors is a very challenging task. Thus, this article introduces a novel framework that jointly optimizes the flying speed and energy replenishment for each UAV to significantly improve the overall system performance (e.g., data collection and energy usage efficiency). Specifically, we first develop a Markov decision process to help the UAV automatically and dynamically make optimal decisions under the dynamics and uncertainties of the environment. Although traditional reinforcement learning algorithms, such as $Q$ -learning and deep $Q$ -learning, can help the UAV to obtain the optimal policy, they often take a long time to converge and require high computational complexity. Therefore, it is impractical to deploy these conventional methods on UAVs with limited computing capacity and energy resource. To that end, we develop advanced transfer learning techniques that allow UAVs to “share” and “transfer” learning knowledge, thereby reducing the learning time as well as significantly improving learning quality. Extensive simulations demonstrate that our proposed solution can improve the average data collection performance of the system up to 200% and reduce the convergence time up to 50% compared with those of conventional methods.

Green Mobility Management in UAV-Assisted IoT Based on Dueling DQN

Deep Reinforcement Learning for Energy-Efficient Fresh Data Collection in Rechargeable UAV-assisted IoT Networks

Research on the UAV-aided Data Collection and Trajectory Design Based on the Deep Reinforcement Learning

The UAV Trajectory Optimization for Data Collection from Time-Constrained IoT Devices: A Hierarchical Deep Q-Network Approach

Energy-efficient Data Collection for UAV-assisted IoT: Joint Trajectory and Resource Optimization

Trajectory Planning of UAV in Wireless Powered IoT System Based on Deep Reinforcement Learning

Multi-UAV Path Learning for Age and Power Optimization in IoT With UAV Battery Recharge

AoI-Energy-Aware UAV-Assisted Data Collection for IoT Networks: A Deep Reinforcement Learning Method

A Deep Reinforcement Learning Approach for Multi-UAV-Assisted Data Collection in Wireless Powered IoT Networks

Trajectory Planning for UAV-Assisted Data Collection in IoT Network: A Double Deep Q Network Approach

Dynamic Trajectory Design and Bandwidth Adjustment for Energy-Efficient UAV-Assisted Relaying with Deep Reinforcement Learning in MEC IoT System

UAV Autonomous Navigation for Wireless Powered Data Collection with Onboard Deep Q-Network

Rechargeable Multi-UAV Aided Seamless Coverage for QoS-Guaranteed IoT Networks

Green Offloading and Trajectory Scheduling of Rechargeable UAVs in Aerial Edge Networks

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

Deep Reinforcement Learning for Fresh Data Collection in UAV-assisted IoT Networks

Multi-UAV Dynamic Wireless Networking with Deep Reinforcement Learning

Joint Optimization of Data Acquisition and Trajectory Planning for UAV-Assisted Wireless Powered Internet of Things

Energy Efficient 3-D UAV Control for Persistent Communication Service and Fairness: A Deep Reinforcement Learning Approach

Safe DQN-Based AoI-Minimal Task Offloading for UAV-Aided Edge Computing System

Joint Speed Control and Energy Replenishment Optimization for UAV-assisted IoT Data Collection with Deep Reinforcement Transfer Learning