Abstract:Unmanned Aerial Vehicle (UAV) is a promising technology that can serve as aerial base stations to assist Internet of Things (IoT) networks, solving various problems such as extending network coverage, enhancing network performance, transferring energy to IoT devices (IoTDs), and perform computationally-intensive tasks of IoTDs. Heterogeneous IoTDs connected to IoT networks have limited processing capability, so they cannot perform resource-intensive activities for extended periods. Additionally, IoT network is vulnerable to security threats and natural calamities, limiting the execution of real-time applications. Although there have been many attempts to solve resource scarcity through computational offloading with Energy Harvesting (EH), the emergency and vulnerability issues have still been under-explored so far. This paper proposes a blockchain and multi-agent deep reinforcement learning (MADRL) integrated framework for computation offloading with EH in a multi-UAV-assisted IoT network, where IoTDs obtain computing and energy resources from UAVs. We first formulate the optimization problem as the joint optimization problem of computation offloading and EH problems while considering the optimal resource price. And then, we model the optimization problem as a Stackelberg game to investigate the interaction between IoTDs and UAVs by allowing them to continuously adjust their resource demands and pricing strategies. In particular, the formulated problem can be addressed indirectly by a stochastic game model to minimize computation costs for IoTDs while maximizing the utility of UAVs. The MADRL algorithm solves the defined problem due to its dynamic and large-dimensional properties. Finally, extensive simulation results demonstrate the superiority of our proposed framework compared to the state-of-the-art.

Energy Efficiency Optimization of IRS and UAV-Assisted Wireless Powered Edge Networks

Task Offloading and Energy Optimization in Hybrid UAV-Assisted Mobile Edge Computing Systems

Intelligent Scheduling of UAVs and Sensors for Information Age Minimization at Wireless Powered Internet of Things

Computing Assistance from the Sky: Decentralized Computation Efficiency Optimization for Air-Ground Integrated MEC Networks

Learning-Based Energy Minimization Optimization for IRS-Assisted Master-Auxiliary-UAV-Enabled Wireless-Powered IoT Networks

Optimization for Master-UAV-powered Auxiliary-Aerial-IRS-assisted IoT Networks: An Option-based Multi-agent Hierarchical Deep Reinforcement Learning Approach

Energy Efficiency Maximization for Multi-UAV-IRS-Assisted Marine Vehicle Systems

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning

Energy-Efficient Joint Trajectory and Reflecting Design in IRS-Enabled UAV Edge Computing

Energy Consumption Modeling and Optimization of UAV-Assisted MEC Networks Using Deep Reinforcement Learning

Efficient UAV/Satellite-assisted IoT Task Offloading: A Multi-agent Reinforcement Learning Solution

Wireless Powered Metaverse: Joint Task Scheduling and Trajectory Design for Multi-Devices and Multi-UAVs

Joint Optimization of Data Acquisition and Trajectory Planning for UAV-Assisted Wireless Powered Internet of Things

Multi-Agent DRL for Task Offloading and Resource Allocation in Multi-UAV Enabled IoT Edge Network

Energy-efficient task offloading and trajectory planning in UAV-enabled mobile edge computing networks

Deep Reinforcement Learning Based Resource Allocation in Multi-UAV-Aided MEC Networks.

Green Offloading and Trajectory Scheduling of Rechargeable UAVs in Aerial Edge Networks

Multi-Objective Optimization in Air-to-Air Communication System Based on Multi-Agent Deep Reinforcement Learning

Distributed Energy-efficient Computation Offloading and Trajectory Planning in Aerial Edge Networks.

Blockchain-Enabled Task Offloading with Energy Harvesting in Multi-UAV-Assisted IoT Networks: A Multi-Agent DRL Approach.

Uav-Irs-Assisted Energy Harvesting for Edge Computing Based on Deep Reinforcement Learning