Abstract:The integration of unmanned aerial vehicles (UAVs) with mobile edge computing (MEC) and Internet of Things (IoT) technology in smart farms is pivotal for efficient resource management and enhanced agricultural productivity sustainably. This paper addresses the critical need for optimizing task offloading in secure UAV-assisted smart farm networks, aiming to reduce total delay and energy consumption while maintaining robust security in data communications. We propose a multi-agent deep reinforcement learning (DRL)-based approach using a deep double Q-network (DDQN) with an action mask (AM), designed to manage task offloading dynamically and efficiently. The simulation results demonstrate the superior performance of our method in managing task offloading, highlighting significant improvements in operational efficiency by reducing delay and energy consumption. This aligns with the goal of developing sustainable and energy-efficient solutions for next-generation network infrastructures, making our approach an advanced solution for achieving both performance and sustainability in smart farming applications.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to optimize task offloading in a secure drone - assisted smart farm network in order to reduce the total latency and energy consumption while maintaining robust security of data communication. Specifically, the paper focuses on how to dynamically and efficiently manage task offloading through the multi - agent deep reinforcement learning (DRL) method under limited computing resources and energy supply, ensuring that tasks can be prioritized according to their urgency and importance. This research aims to improve the efficiency and security of smart agricultural operations and ensure timely and reliable agricultural data processing and decision - making. ### Core Problems of the Paper 1. **Task Offloading Optimization**: How to effectively perform task offloading in a drone - assisted smart farm network to reduce the total latency and energy consumption. 2. **Security Assurance**: During the task offloading process, how to ensure the security of data communication and prevent data from being eavesdropped. 3. **Priority Management**: How to prioritize tasks according to their urgency and importance to ensure that critical tasks are processed in a timely manner. ### Solutions The paper proposes a method based on multi - agent deep reinforcement learning (DRL), using deep double - Q network (DDQN) and action masking (AM) to dynamically manage task offloading. The specific steps are as follows: 1. **System Model**: - **Communication Model**: Defines the transmission processes from Internet of Things devices to drones (N2M) and from drones to edge nodes (M2Q), including the calculation of path loss, channel gain, and transmission rate. - **Computation Model**: Analyzes the time and energy consumption of local computation and edge computation to ensure that tasks are executed on the most appropriate nodes. 2. **Problem Modeling**: - Models the task offloading problem as a mixed - integer nonlinear programming (MINLP) problem, with the objective of minimizing the total cost of the system, including latency and energy consumption, while ensuring communication security. - Introduces multiple constraints, such as latency limits, minimum secrecy rate requirements, upper limits on energy usage, and computing resource limitations. 3. **Multi - agent DRL Method**: - **State Space**: Defines the state of each drone, including battery power, computing power, task set, and task priority. - **Action Masking**: Ensures that each drone can only select feasible actions in the current state. - **Action Space**: Defines the binary decision for each task, that is, whether to process locally or offload to an edge node. - **Reward Function**: Designs a global reward function to reduce system costs and guide agents to maximize long - term benefits. - **Learning Algorithm**: Implements the training and distributed execution of multi - agent DRL through steps such as experience collection, storage, coordinated mini - batch sampling, and network update. ### Simulation Results The simulation results show that the proposed multi - agent DRL framework performs excellently in managing task offloading, significantly improving operational efficiency and reducing latency and energy consumption. These results verify the effectiveness and feasibility of this method in practical applications and provide an advanced solution for the development of smart agriculture. ### Main Contributions 1. **Problem Modeling**: Proposes a priority - driven task offloading problem and models it as an NP - hard mixed - integer nonlinear programming problem. 2. **Multi - agent DRL Method**: Designs a multi - agent deep reinforcement learning method based on action masking to effectively manage task offloading. 3. **Training and Execution**: Implements the training process and the distributed execution phase, ensuring that each drone not only contributes to the overall network objective but can also independently respond to the local environment. 4. **Performance Verification**: Verifies the effectiveness of the proposed method through simulation experiments and shows its superior performance in convergence, latency reduction, and energy savings. In conclusion, through the introduction of the multi - agent DRL method, this paper successfully solves the task offloading optimization problem in the drone - assisted smart farm network and provides new ideas and technical support for achieving sustainable and efficient smart agriculture.

Sustainable Task Offloading in Secure UAV-assisted Smart Farm Networks: A Multi-Agent DRL with Action Mask Approach

Multi-Agent DRL for Task Offloading and Resource Allocation in Multi-UAV Enabled IoT Edge Network

Toward Optimal Resource Allocation: A Multi-Agent DRL Based Task Offloading Approach in Multi-UAV-Assisted MEC Networks

Decentralized Computation Offloading With Cooperative UAVs: Multi-Agent Deep Reinforcement Learning Perspective

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Multi-agent Deep Reinforcement Learning-based Task Scheduling and Resource Sharing for O-RAN-empowered Multi-UAV-assisted Wireless Sensor Networks

Reinforcement Learning-Based Deadline and Battery-Aware Offloading in Smart Farm IoT-UAV Networks

Secure Video Offloading in Multi-UAV-Enabled MEC Networks: A Deep Reinforcement Learning Approach

Task Offloading Strategy for Unmanned Aerial Vehicle Power Inspection Based on Deep Reinforcement Learning

Reinforcement Learning-Based Task Offloading of MEC-Assisted UAVs in Precision Agriculture

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

UAV-assisted Task Offloading for IoT in Smart Buildings and Environment Via Deep Reinforcement Learning

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning

Computation Offloading Via Multi-Agent Deep Reinforcement Learning in Aerial Hierarchical Edge Computing Systems

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

MADRL-Based Collaborative Computation Offloading and Resource Orchestration for Multi-Task Data Sharing in Smart Agriculture

Collaborative Computation Offloading and Resource Allocation in Multi-UAV-Assisted IoT Networks: A Deep Reinforcement Learning Approach

Multi-Agent DRL for Air-to-Ground Communication Planning in UAV-Enabled IoT Networks

GAN-powered heterogeneous multi-agent reinforcement learning for UAV-assisted task offloading

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network