Abstract:Unmanned Aerial Vehicle (UAV) is a promising technology that can serve as aerial base stations to assist Internet of Things (IoT) networks, solving various problems such as extending network coverage, enhancing network performance, transferring energy to IoT devices (IoTDs), and perform computationally-intensive tasks of IoTDs. Heterogeneous IoTDs connected to IoT networks have limited processing capability, so they cannot perform resource-intensive activities for extended periods. Additionally, IoT network is vulnerable to security threats and natural calamities, limiting the execution of real-time applications. Although there have been many attempts to solve resource scarcity through computational offloading with Energy Harvesting (EH), the emergency and vulnerability issues have still been under-explored so far. This paper proposes a blockchain and multi-agent deep reinforcement learning (MADRL) integrated framework for computation offloading with EH in a multi-UAV-assisted IoT network, where IoTDs obtain computing and energy resources from UAVs. We first formulate the optimization problem as the joint optimization problem of computation offloading and EH problems while considering the optimal resource price. And then, we model the optimization problem as a Stackelberg game to investigate the interaction between IoTDs and UAVs by allowing them to continuously adjust their resource demands and pricing strategies. In particular, the formulated problem can be addressed indirectly by a stochastic game model to minimize computation costs for IoTDs while maximizing the utility of UAVs. The MADRL algorithm solves the defined problem due to its dynamic and large-dimensional properties. Finally, extensive simulation results demonstrate the superiority of our proposed framework compared to the state-of-the-art.

UAV-assisted Task Offloading for IoT in Smart Buildings and Environment Via Deep Reinforcement Learning

Task Offloading Strategy for Unmanned Aerial Vehicle Power Inspection Based on Deep Reinforcement Learning

Edge Computing Task Offloading Optimization for a UAV-assisted Internet of Vehicles Via Deep Reinforcement Learning

Energy-efficient UAV-enabled Computation Offloading for Industrial Internet of Things: a Deep Reinforcement Learning Approach

Decentralized Computation Offloading With Cooperative UAVs: Multi-Agent Deep Reinforcement Learning Perspective

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Task Offloading and Energy Optimization in Hybrid UAV-Assisted Mobile Edge Computing Systems

Task Offloading for UAV-based Mobile Edge Computing Via Deep Reinforcement Learning

Intelligent Task Offloading and Energy Allocation in the UAV-Aided Mobile Edge-Cloud Continuum

Efficient UAV/Satellite-assisted IoT Task Offloading: A Multi-agent Reinforcement Learning Solution

Blockchain-Enabled Task Offloading with Energy Harvesting in Multi-UAV-Assisted IoT Networks: A Multi-Agent DRL Approach.

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

When UAVs Meet Cognitive Radio: Offloading Traffic under Uncertain Spectrum Environment Via Deep Reinforcement Learning

Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

Latency-aware task offloading in UAV-assisted edge computing: Leveraging deep reinforcement learning

Multi-Agent DRL for Task Offloading and Resource Allocation in Multi-UAV Enabled IoT Edge Network

UAV-Aided Partial Task Offloading for Integrated Sensing, Computation, and Communications Systems via Deep Reinforcement Learning

UAV-assisted task offloading system using dung beetle optimization algorithm & deep reinforcement learning

Deep Reinforcement Learning-Driven Adaptive Task Offloading and Resource Allocation for UAV-Assisted Mobile Edge Computing

Deep Reinforcement Learning Based Computation Offloading and Trajectory Planning for Multi-UAV Cooperative Target Search

Deep reinforcement learning based computing offloading in unmanned aerial vehicles for disaster management