Abstract:With the ongoing advancement of electric power Internet of Things (IoT), traditional power inspection methods face challenges such as low efficiency and high risk. Unmanned aerial vehicles (UAVs) have emerged as a more efficient solution for inspecting power facilities due to their high maneuverability, excellent line-of-sight communication capabilities, and strong adaptability. However, UAVs typically grapple with limited computational power and energy resources, which constrain their effectiveness in handling computationally intensive and latency-sensitive inspection tasks. In response to this issue, we propose a UAV task offloading strategy based on deep reinforcement learning (DRL), which is designed for power inspection scenarios consisting of mobile edge computing (MEC) servers and multiple UAVs. Firstly, we propose an innovative UAV-Edge server collaborative computing architecture to fully exploit the mobility of UAVs and the high-performance computing capabilities of MEC servers. Secondly, we established a computational model concerning energy consumption and task processing latency in the UAV power inspection system, enhancing our understanding of the trade-offs involved in UAV offloading strategies. Finally, we formalize the task offloading problem as a multi-objective optimization issue and simultaneously model it as a Markov Decision Process (MDP). Subsequently, we proposed a task offloading algorithm based on a Deep Deterministic Policy Gradient (OTDDPG) to obtain the optimal task offloading strategy for UAVs. The simulation results demonstrated that this approach outperforms baseline methods with significant improvements in task processing latency and energy consumption.

What problem does this paper attempt to address?

This paper attempts to address the problem of optimizing system energy consumption and task processing delay through task offloading strategies in UAV power inspection. Specifically, UAVs face limitations in computing power and battery capacity during power facility inspections, which restricts their ability to handle compute-intensive and latency-sensitive tasks. To solve this problem, the authors propose a task offloading strategy based on Deep Reinforcement Learning (DRL), aiming to leverage the high-performance computing capabilities of Mobile Edge Computing (MEC) servers to improve the efficiency and performance of UAV power inspections. ### Main Issues 1. **Limited Computing Resources**: UAVs have limited computing power and cannot efficiently handle complex power facility inspection tasks. 2. **High Energy Consumption**: UAVs have limited battery capacity, and frequent computing tasks can quickly deplete battery energy. 3. **Latency Sensitivity**: Power facility inspection tasks often require low latency, and the data transmission delay in traditional cloud center computing models may not meet this requirement. ### Solutions 1. **Innovative UAV-Edge Server Collaborative Computing Architecture**: Fully utilize the mobility of UAVs and the high-performance computing capabilities of MEC servers to improve the efficiency and performance of power inspections. 2. **Computing Model**: Establish a computing model for system energy consumption and task processing delay, considering factors such as task requirements, UAV resource status, and communication environment to better understand the trade-offs in task offloading strategies. 3. **Multi-Objective Optimization Problem**: Formalize the task offloading problem as a multi-objective optimization problem, aiming to minimize system energy consumption and task processing delay. Use Markov Decision Process (MDP) modeling and propose an algorithm based on Deep Deterministic Policy Gradient (OTDDPG) to find the optimal task offloading strategy. ### Contributions 1. **Innovative Collaborative Computing Architecture**: Propose a UAV-Edge Server collaborative computing architecture to improve the efficiency and performance of power inspections. 2. **Computing Model**: Establish a computing model for system energy consumption and task processing delay, considering multiple key factors. 3. **Optimization Algorithm**: Propose the OTDDPG algorithm, which effectively solves the task offloading optimization problem in continuous action spaces, improving the system's adaptability and flexibility. Through these methods, the paper aims to enhance the real-time performance and energy efficiency of UAV power inspections, ensuring the stable operation of the power system.

Task Offloading Strategy for Unmanned Aerial Vehicle Power Inspection Based on Deep Reinforcement Learning

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

Energy Saving Strategy of UAV in MEC Based on Deep Reinforcement Learning

UAV-assisted Task Offloading for IoT in Smart Buildings and Environment Via Deep Reinforcement Learning

Latency-aware task offloading in UAV-assisted edge computing: Leveraging deep reinforcement learning

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

UAV-assisted task offloading system using dung beetle optimization algorithm & deep reinforcement learning

Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing

Energy-efficient task offloading and trajectory planning in UAV-enabled mobile edge computing networks

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Decentralized Computation Offloading With Cooperative UAVs: Multi-Agent Deep Reinforcement Learning Perspective

Reinforcement Learning-Based Task Offloading of MEC-Assisted UAVs in Precision Agriculture

Deep Reinforcement Learning for Scheduling and Offloading in UAV-Assisted Mobile Edge Networks

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning

Deep Reinforcement Learning-Based Mining Task Offloading Scheme for Intelligent Connected Vehicles in UAV-Aided MEC

Deep reinforcement learning based computing offloading in unmanned aerial vehicles for disaster management

Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning

Task offloading optimization of cruising UAV with fixed trajectory

Computation offloading optimization for UAV-assisted mobile edge computing: a deep deterministic policy gradient approach