Abstract:Technological evolutions in unmanned aerial vehicle (UAV) industry have granted UAVs more computing and storage resources, leading to the vision of UAVs-assisted edge computing, in which the computing missions can be offloaded from a cellular network to a UAV cloudlet. In this paper, we propose a UAVs-assisted computation offloading paradigm, where a group of UAVs fly around, while providing value-added edge computing services. The complex computing missions are decomposed as some typical task-flows with inter-dependencies. By taking into consideration the inter-dependencies of the tasks, dynamic network states, and energy constraints of the UAVs, we formulate the average mission response time minimization problem and then model it as a Markov decision process. Specifically, each time a mission arrives or a task execution finishes, we should decide the target helper for the next task execution and the fraction of the bandwidth allocated to the communication. To separate the evaluation of the integrated decision, we propose multi-agent reinforcement learning (MARL) algorithms, where the target helper and the bandwidth allocation are determined by two agents. We design respective advantage evaluation functions for the agents to solve the multi-agent credit assignment challenge, and further extend the on-policy algorithm to off-policy. Simulation results show that the proposed MARL-based approaches have desirable convergence property, and can adapt to the dynamic environment. The proposed approaches can significantly reduce the average mission response time compared with other benchmark approaches.

UAV-Aided Partial Task Offloading for Integrated Sensing, Computation, and Communications Systems via Deep Reinforcement Learning

Edge Computing Task Offloading Optimization for a UAV-assisted Internet of Vehicles Via Deep Reinforcement Learning

Task Offloading and Energy Optimization in Hybrid UAV-Assisted Mobile Edge Computing Systems

Learning-Based Computation Offloading Approaches in UAVs-Assisted Edge Computing

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

Communication-Assisted Multi-Agent Reinforcement Learning Improves Task-Offloading in UAV-Aided Edge-Computing Networks

Decentralized Computation Offloading With Cooperative UAVs: Multi-Agent Deep Reinforcement Learning Perspective

Priority-Aware Task Offloading in UAV-Assisted Vehicular Network Via Deep Reinforcement Learning

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Latency-aware task offloading in UAV-assisted edge computing: Leveraging deep reinforcement learning

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

UAV-enabled computation migration for complex missions: A reinforcement learning approach

Competition-Awareness Partial Task Offloading and UAV Deployment for Multitier Parallel Computational Internet of Vehicles

Deep reinforcement learning based computing offloading in unmanned aerial vehicles for disaster management

Computation Offloading Via Multi-Agent Deep Reinforcement Learning in Aerial Hierarchical Edge Computing Systems

Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing

Joint Optimization of UAV Aided Covert Edge Computing Via a Deep Reinforcement Learning Framework

Deep Reinforcement Learning for Scheduling and Offloading in UAV-Assisted Mobile Edge Networks

UAV-assisted Task Offloading for IoT in Smart Buildings and Environment Via Deep Reinforcement Learning

A multi-UAV assisted task offloading and path optimization for mobile edge computing via multi-agent deep reinforcement learning