Abstract:In the last twenty years, unmanned aerial vehicles (UAVs) have garnered growing interest due to their expanding applications in both military and civilian domains. Detecting non-cooperative aerial vehicles with efficiency and estimating collisions accurately are pivotal for achieving fully autonomous aircraft and facilitating Advanced Air Mobility (AAM). This paper presents a deep-learning framework that utilizes optical sensors for the detection, tracking, and distance estimation of non-cooperative aerial vehicles. In implementing this comprehensive sensing framework, the availability of depth information is essential for enabling autonomous aerial vehicles to perceive and navigate around obstacles. In this work, we propose a method for estimating the distance information of a detected aerial object in real time using only the input of a monocular camera. In order to train our deep learning components for the object detection, tracking and depth estimation tasks we utilize the Amazon Airborne Object Tracking (AOT) Dataset. In contrast to previous approaches that integrate the depth estimation module into the object detector, our method formulates the problem as image-to-image translation. We employ a separate lightweight encoder-decoder network for efficient and robust depth estimation. In a nutshell, the object detection module identifies and localizes obstacles, conveying this information to both the tracking module for monitoring obstacle movement and the depth estimation module for calculating distances. Our approach is evaluated on the Airborne Object Tracking (AOT) dataset which is the largest (to the best of our knowledge) air-to-air airborne object dataset.

Autonomous Vision-based UAV Landing with Collision Avoidance using Deep Learning

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

Vision-Based Mid-Air Object Detection and Avoidance Approach for Small Unmanned Aerial Vehicles s with Deep Learning and Risk Assessment

Reinforcement Learning-Based Collision Avoidance Guidance Algorithm for Fixed-Wing UAVs.

Vision-based UAV Safe Landing exploiting Lightweight Deep Neural Networks

Interpretable UAV Collision Avoidance using Deep Reinforcement Learning

Deep-Reinforcement-Learning-Based Collision Avoidance in UAV Environment

A fast, lightweight deep learning vision pipeline for autonomous UAV landing support with added robustness

Robust Autonomous Landing of UAV in Non-Cooperative Environments based on Dynamic Time Camera-LiDAR Fusion

A Multimodal Learning-based Approach for Autonomous Landing of UAV

Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimation

An ADS-B Information-Based Collision Avoidance Methodology to UAV

Autonomous Multirotor UAV Search and Landing on Safe Spots Based on Combined Semantic and Depth Information From an Onboard Camera and LiDAR

Vision-based safe autonomous UAV docking with panoramic sensors

Semantically-enhanced Deep Collision Prediction for Autonomous Navigation using Aerial Robots

Robust Autonomous Landing of UAVs in Non-Cooperative Environments Based on Comprehensive Terrain Understanding

An LGMD Based Competitive Collision Avoidance Strategy for UAV

Proactive Guidance for Accurate UAV Landing on a Dynamic Platform: A Visual–Inertial Approach

Deep-reinforcement-learning-based UAV autonomous navigation and collision avoidance in unknown environments

A Hierarchical Collision Avoidance Architecture for Multiple Fixed-Wing UAVs in an Integrated Airspace

Vision-Based Deep Reinforcement Learning of UAV-UGV Collaborative Landing Policy Using Automatic Curriculum