Abstract:The development of high-performance, low-cost unmanned aerial vehicles paired with rapid progress in vision-based perception systems herald a new era of autonomous flight systems with mission-ready capabilities. One of the key features of an autonomous UAV is a robust mid-air collision avoidance strategy. This paper proposes a vision-based in-flight collision avoidance system based on background subtraction using an embedded computing system for unmanned aerial vehicles (UAVs). The pipeline of proposed in-flight collision avoidance system is as follows: (i) subtract dynamic background subtraction to remove it and to detect moving objects, (ii) denoise using morphology and binarization methods, (iii) cluster the moving objects and remove noise blobs, using Euclidean clustering, (iv) distinguish independent objects and track the movement using the Kalman filter, and (v) avoid collision, using the proposed decision-making techniques. This work focuses on the design and the demonstration of a vision-based fast-moving object detection and tracking system with decision-making capabilities to perform evasive maneuvers to replace a high-vision system such as event camera. The novelty of our method lies in the motion-compensating moving object detection framework, which accomplishes the task with background subtraction via a two-dimensional transformation approximation. Clustering and tracking algorithms process detection data to track independent objects, and stereo-camera-based distance estimation is conducted to estimate the three-dimensional trajectory, which is then used during decision-making procedures. The examination of the system is conducted with a test quadrotor UAV, and appropriate algorithm parameters for various requirements are deduced.

Vision-based Target Tracking for UAV and Relative Depth Estimation using Optical Flow

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

Dynamic Illumination Optical Flow Computing for Sensing Multiple Mobile Robots from a Drone.

A Vision-based UAV Tracker Aiming at Aerial Targets

Real-Time Drone (UAV) Trajectory Generation and Tracking by Optical Flow

Fusing Stereopsis & Corner Sparse Optical Flow for Real-time Obstacle Avoidance of Unmanned Aerial Vehicle

Optical Flow as a Virtual Gyro and Altimeter for Safer Spacecraft Visual Inertial Target Approaches

Vision-Based Target Detection and Tracking System for a Quadcopter

Moving target tracking using sparse optical flow method

3D Target Detection and Tracking Based on Scene Flow

Object Tracking in Satellite Videos Based on a Multi-Frame Optical Flow Tracker

Vision-based target motion analysis and collision avoidance of unmanned surface vehicles

A Vision-Based Ground Moving Target Tracking System for Quadrotor UAVs

Vision-based UAV adaptive tracking control for moving targets with velocity observation

A Moving Target Detection and Localization Strategy Based on Optical Flow and Pin-hole Imaging Methods Using Monocular Vision

Vision-Based In-Flight Collision Avoidance Control Based on Background Subtraction Using Embedded System

Dynamic Target Tracking and Ingressing of a Small UAV Using Monocular Sensor Based on the Geometric Constraints

Robust Scalable Part-Based Visual Tracking for UAV with Background-Aware Correlation Filter.

Onboard Robust Visual Tracking for UAVs Using a Reliable Global-Local Object Model

Computer-Vision-Based Vibration Tracking Using a Digital Camera: A Sparse-Optical-Flow-Based Target Tracking Method

Dynamic based trajectory estimation and tracking in an uncertain environment