Abstract:With the ongoing advancement of electric power Internet of Things (IoT), traditional power inspection methods face challenges such as low efficiency and high risk. Unmanned aerial vehicles (UAVs) have emerged as a more efficient solution for inspecting power facilities due to their high maneuverability, excellent line-of-sight communication capabilities, and strong adaptability. However, UAVs typically grapple with limited computational power and energy resources, which constrain their effectiveness in handling computationally intensive and latency-sensitive inspection tasks. In response to this issue, we propose a UAV task offloading strategy based on deep reinforcement learning (DRL), which is designed for power inspection scenarios consisting of mobile edge computing (MEC) servers and multiple UAVs. Firstly, we propose an innovative UAV-Edge server collaborative computing architecture to fully exploit the mobility of UAVs and the high-performance computing capabilities of MEC servers. Secondly, we established a computational model concerning energy consumption and task processing latency in the UAV power inspection system, enhancing our understanding of the trade-offs involved in UAV offloading strategies. Finally, we formalize the task offloading problem as a multi-objective optimization issue and simultaneously model it as a Markov Decision Process (MDP). Subsequently, we proposed a task offloading algorithm based on a Deep Deterministic Policy Gradient (OTDDPG) to obtain the optimal task offloading strategy for UAVs. The simulation results demonstrated that this approach outperforms baseline methods with significant improvements in task processing latency and energy consumption.

An Adaptive Q-Value Adjustment-Based Learning Model for Reliable Vehicle-to-UAV Computation Offloading

Edge Computing Task Offloading Optimization for a UAV-assisted Internet of Vehicles Via Deep Reinforcement Learning

Task Offloading and Energy Optimization in Hybrid UAV-Assisted Mobile Edge Computing Systems

QoE-Driven Adaptive Deployment Strategy of Multi-UAV Networks Based on Hybrid Deep Reinforcement Learning

Multi-UAV Assisted Offloading Optimization: A Game Combined Reinforcement Learning Approach

Reinforcement Learning with UAV Assistance for Optimized Computation Offloading in Mobile Edge Computing

Adaptive task offloading of rechargeable UAV edge computing network based on double decision value iteration

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Energy-efficient UAV-enabled Computation Offloading for Industrial Internet of Things: a Deep Reinforcement Learning Approach

UAV-assisted MEC offloading strategy with peak AOI boundary optimization: A method based on DDQN

Q-learning based computation offloading for multi-UAV-enabled cloud-edge computing networks

A PDDQNLP Algorithm for Energy Efficient Computation Offloading in UAV-Assisted MEC

Safe DQN-Based AoI-Minimal Task Offloading for UAV-Aided Edge Computing System

GAN-powered heterogeneous multi-agent reinforcement learning for UAV-assisted task offloading

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

Deep-Reinforcement-Learning-Based Distributed Computation Offloading in Vehicular Edge Computing Networks

Task Offloading Strategy for Unmanned Aerial Vehicle Power Inspection Based on Deep Reinforcement Learning

Hybrid Multi-Server Computation Offloading in Air-Ground Vehicular Networks Empowered by Federated Deep Reinforcement Learning

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Task offloading optimization of cruising UAV with fixed trajectory

Energy-Latency Tradeoffs for Joint Optimization of Vehicle Selection and Resource Allocation in UAV-Assisted Vehicular Edge Computing