Abstract:The development of high-performance, low-cost unmanned aerial vehicles paired with rapid progress in vision-based perception systems herald a new era of autonomous flight systems with mission-ready capabilities. One of the key features of an autonomous UAV is a robust mid-air collision avoidance strategy. This paper proposes a vision-based in-flight collision avoidance system based on background subtraction using an embedded computing system for unmanned aerial vehicles (UAVs). The pipeline of proposed in-flight collision avoidance system is as follows: (i) subtract dynamic background subtraction to remove it and to detect moving objects, (ii) denoise using morphology and binarization methods, (iii) cluster the moving objects and remove noise blobs, using Euclidean clustering, (iv) distinguish independent objects and track the movement using the Kalman filter, and (v) avoid collision, using the proposed decision-making techniques. This work focuses on the design and the demonstration of a vision-based fast-moving object detection and tracking system with decision-making capabilities to perform evasive maneuvers to replace a high-vision system such as event camera. The novelty of our method lies in the motion-compensating moving object detection framework, which accomplishes the task with background subtraction via a two-dimensional transformation approximation. Clustering and tracking algorithms process detection data to track independent objects, and stereo-camera-based distance estimation is conducted to estimate the three-dimensional trajectory, which is then used during decision-making procedures. The examination of the system is conducted with a test quadrotor UAV, and appropriate algorithm parameters for various requirements are deduced.

A Low-Level Active Vision Framework For Collaborative Unmanned Aircraft Systems

Autonomous Flights in Dynamic Environments with Onboard Vision

Fast-Tracker 2.0: Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression.

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

A Vision-based UAV Tracker Aiming at Aerial Targets

Ensuring UAV Safety: A Vision-only and Real-time Framework for Collision Avoidance Through Object Detection, Tracking, and Distance Estimation

Real-Time Multi-Modal Active Vision for Object Detection on UAVs Equipped With Limited Field of View LiDAR and Camera

An Efficient UAV-based Artificial Intelligence Framework for Real-Time Visual Tasks

AirTrack: Onboard Deep Learning Framework for Long-Range Aircraft Detection and Tracking

Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers

Vision-based Relative Detection and Tracking for Teams of Micro Aerial Vehicles

Vision-Based In-Flight Collision Avoidance Control Based on Background Subtraction Using Embedded System

Monocular Vision-Based Obstacle Detection/Avoidance For Unmanned Aerial Vehicles

Intuitive Human-Robot Interface: A 3-Dimensional Action Recognition and UAV Collaboration Framework

Stereo Vision for Unmanned Aerial VehicleDetection, Tracking, and Motion Control

Towards Real-Time Fast Unmanned Aerial Vehicle Detection Using Dynamic Vision Sensors

Active Perception Based Formation Control for Multiple Aerial Vehicles

Drone detection, recognition, and assistance system for counter-UAV with VIS, radar, and radio sensors

Real-Time Visual Tracking of Moving Targets Using a Low-Cost Unmanned Aerial Vehicle with a 3-Axis Stabilized Gimbal System

An Efficient Artificial Intelligence Framework for UAV Systems

A Safer Vision-based Autonomous Planning System for Quadrotor UAVs with Dynamic Obstacle Trajectory Prediction and Its Application with LLMs