Abstract:The development of high-performance, low-cost unmanned aerial vehicles paired with rapid progress in vision-based perception systems herald a new era of autonomous flight systems with mission-ready capabilities. One of the key features of an autonomous UAV is a robust mid-air collision avoidance strategy. This paper proposes a vision-based in-flight collision avoidance system based on background subtraction using an embedded computing system for unmanned aerial vehicles (UAVs). The pipeline of proposed in-flight collision avoidance system is as follows: (i) subtract dynamic background subtraction to remove it and to detect moving objects, (ii) denoise using morphology and binarization methods, (iii) cluster the moving objects and remove noise blobs, using Euclidean clustering, (iv) distinguish independent objects and track the movement using the Kalman filter, and (v) avoid collision, using the proposed decision-making techniques. This work focuses on the design and the demonstration of a vision-based fast-moving object detection and tracking system with decision-making capabilities to perform evasive maneuvers to replace a high-vision system such as event camera. The novelty of our method lies in the motion-compensating moving object detection framework, which accomplishes the task with background subtraction via a two-dimensional transformation approximation. Clustering and tracking algorithms process detection data to track independent objects, and stereo-camera-based distance estimation is conducted to estimate the three-dimensional trajectory, which is then used during decision-making procedures. The examination of the system is conducted with a test quadrotor UAV, and appropriate algorithm parameters for various requirements are deduced.

Vision-based target motion analysis and collision avoidance of unmanned surface vehicles

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

A Robot Collision Avoidance Scheme Based on the Moving Obstacle Motion Prediction

Collision Avoidance and Path Point Tracking Control for Underactuated Unmanned Surface Vehicles with Unknown Model Nonlinearity

Vision-Based In-Flight Collision Avoidance Control Based on Background Subtraction Using Embedded System

Cooperative Target Enclosing Control for Multiple Unmanned Surface Vehicles with Unknown Dynamics and Safety Assurance

Fusing Stereopsis & Corner Sparse Optical Flow for Real-time Obstacle Avoidance of Unmanned Aerial Vehicle

A Vision-based UAV Tracker Aiming at Aerial Targets

Intelligent Collision Avoidance Method for Motion Obstacles of Unmanned Vehicles

Collision Risk Index, Artificial Potential Field, and Safety Zone

Monocular Vision-Based Dynamic Moving Obstacles Detection and Avoidance

Vision-Based Mid-Air Object Detection and Avoidance Approach for Small Unmanned Aerial Vehicles s with Deep Learning and Risk Assessment

Monocular Vision-Based Obstacle Detection/Avoidance For Unmanned Aerial Vehicles

A Theoretical Analysis of the Velocity Obstacle Method for Nonholonomic Vehicles and Underactuated Surface Vessels

Collision Avoidance Algorithm Based on COLREGs for Unmanned Surface Vehicle

Active Vision-Based Finite-Time Trajectory-Tracking Control of an Unmanned Surface Vehicle Without Direct Position Measurements

Vision-based Target Tracking for UAV and Relative Depth Estimation using Optical Flow

Vision-based UAV adaptive tracking control for moving targets with velocity observation

Autonomous Obstacle Avoidance Algorithm for Unmanned Surface Vehicles Based on an Improved Velocity Obstacle Method

Toward Verifiable Real-Time Obstacle Motion Prediction for Dynamic Collision Avoidance

Reactive Collision Avoidance of an Unmanned Surface Vehicle through Gaussian Mixture Model-Based Online Mapping