Abstract:In the last twenty years, unmanned aerial vehicles (UAVs) have garnered growing interest due to their expanding applications in both military and civilian domains. Detecting non-cooperative aerial vehicles with efficiency and estimating collisions accurately are pivotal for achieving fully autonomous aircraft and facilitating Advanced Air Mobility (AAM). This paper presents a deep-learning framework that utilizes optical sensors for the detection, tracking, and distance estimation of non-cooperative aerial vehicles. In implementing this comprehensive sensing framework, the availability of depth information is essential for enabling autonomous aerial vehicles to perceive and navigate around obstacles. In this work, we propose a method for estimating the distance information of a detected aerial object in real time using only the input of a monocular camera. In order to train our deep learning components for the object detection, tracking and depth estimation tasks we utilize the Amazon Airborne Object Tracking (AOT) Dataset. In contrast to previous approaches that integrate the depth estimation module into the object detector, our method formulates the problem as image-to-image translation. We employ a separate lightweight encoder-decoder network for efficient and robust depth estimation. In a nutshell, the object detection module identifies and localizes obstacles, conveying this information to both the tracking module for monitoring obstacle movement and the depth estimation module for calculating distances. Our approach is evaluated on the Airborne Object Tracking (AOT) dataset which is the largest (to the best of our knowledge) air-to-air airborne object dataset.

Flying Objects Detection from a Single Moving Camera

Fast Detection and Recognition Method of UAV in Sky Background

Low in Resolution, High in Precision: UAV Detection with Super-Resolution and Motion Information Extraction

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

A Small UAV Detection Method Based on Optical Flow and Visual Feature Fusion

A Vision-based UAV Tracker Aiming at Aerial Targets

Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimation

AERIAL VEHICLES DETECTION AND RECOGNITION FOR UAV VISION SYSTEM

Real-Time Detection for Small UAVs: Combining YOLO and Multi-frame Motion Analysis

Super accurate low latency object detection on a surveillance UAV

Perceiving Traffic from Aerial Images

An improved deep learning method for flying object detection and recognition

UAV Target Detection under Complex Sky Background

UAV Images Dataset for Moving Object Detection from Moving Cameras

On Onboard LiDAR-based Flying Object Detection

A Model-Free Moving Object Detection and Tracking Framework Based on UAV Data

Flying Objects Classification Based on Micro–Doppler Signature Data From UAV Borne Radar

Object Detection Deployed on UAVs for Oblique Images by Fusing IMU Information

Dense and Small Object Detection in UAV-Vision Based on a Global-Local Feature Enhanced Network

Fast and Accurate, Convolutional Neural Network Based Approach for Object Detection from UAV

FAST-Dynamic-Vision: Detection and Tracking Dynamic Objects with Event and Depth Sensing