Abstract:Unmanned aerial vehicles (UAVs) have been widely used in military and civilian fields by carrying out intelligent applications with deep learning technologies, such as battlefield search and rescue; intelligence, surveillance, and reconnaissance (ISR); and smart city monitoring. Due to deeper and more complex models of deep neural networks (DNNs) and limited on-board resources in UAVs, most existing works either rely on cloud-based intelligence by transmitting original data to remote powerful cloud servers and running DNNs inference therein, or involve edge intelligence by executing lightweight DNN models on-board. Unfortunately, the former is faced with unacceptable long transmission latency and possible network instability over air-to-ground links, while the latter is restricted to relatively low accuracy via lightweight models. Although a few recent works propose to collaboratively run complex DNNs inference within a swarm of UAVs to achieve both high accuracy and low latency, they seldom consider the strong confrontation environment of the battle-field, the unreliable air-to-air links among UAVs as well as likely hardware/software breakdowns in UAV airborne computers, which could result in the failure of collaborative inference. This article proposes a novel architecture based on an observation, orientation, decision, and action (OODA) loop, called elastic collaborative edge intelligence (eCoEI), which could fully utilize the resources of computation and storage in a UAV swarm, and enable the swarm to collaboratively perform DNN inference tasks in an elastic manner in the face of any lost links. This article also designs a prototype system of the proposed eCoEI and conducts a proof-of-concept evaluation to validate its feasibility as well as effectiveness. Experimental results show that the eCoEI has an outstanding ability to deal with single point of failure and network fluctuations within a UAV swarm for collaborative edge intelligence. Finally, the main technical challenges are pointed out in the eCoEI, and an outlook on future research directions is provided.

Efficient Pipeline Collaborative DNN Inference in Resource-Constrained UAV Swarm

Reliable DNN Partitioning for UAV Swarm

Efficient Real-Time Image Recognition Using Collaborative Swarm of UAVs and Convolutional Networks

Elastic Collaborative Edge Intelligence for UAV Swarm: Architecture, Challenges, and Opportunities

Efficient Edge Intelligence under Clustering for UAV Swarm Networks

Deep Reinforcement Learning for Trajectory Path Planning and Distributed Inference in Resource-Constrained UAV Swarms

All-Sky Autonomous Computing in UAV Swarm

DNN Task Assignment in UAV Networks: A Generative AI Enhanced Multi-Agent Reinforcement Learning Approach

Intelligent Resource Allocation Schemes for UAV-Swarm-Based Cooperative Sensing.

Collaborative Computation Offloading in Multi-UAV-MEC Networks: A Reinforcement Learning Approach

Intelli-Eye: An UAV Tracking System with Optimized Machine Learning Tasks Offloading

Joint Training and Resource Allocation Optimization for Federated Learning in UAV Swarm

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

UAV-enabled computation migration for complex missions: A reinforcement learning approach

A Collaborative Inference Algorithm in Low-Earth-Orbit Satellite Network for Unmanned Aerial Vehicle

Computation Offloading and Trajectory Control for UAV-Assisted Edge Computing Using Deep Reinforcement Learning

Cooperative Knowledge-Distillation-Based Tiny DNN for UAV-Assisted Mobile-Edge Network

UAV-Aided Partial Task Offloading for Integrated Sensing, Computation, and Communications Systems via Deep Reinforcement Learning

A Federated Learning Latency Minimization Method for UAV Swarms Aided by Communication Compression and Energy Allocation

Energy-Efficient Power Control for Multiple-Task Split Inference in UAVs: A Tiny Learning-Based Approach

Multi-Agent DRL for Task Offloading and Resource Allocation in Multi-UAV Enabled IoT Edge Network