Abstract:The development of high-performance, low-cost unmanned aerial vehicles paired with rapid progress in vision-based perception systems herald a new era of autonomous flight systems with mission-ready capabilities. One of the key features of an autonomous UAV is a robust mid-air collision avoidance strategy. This paper proposes a vision-based in-flight collision avoidance system based on background subtraction using an embedded computing system for unmanned aerial vehicles (UAVs). The pipeline of proposed in-flight collision avoidance system is as follows: (i) subtract dynamic background subtraction to remove it and to detect moving objects, (ii) denoise using morphology and binarization methods, (iii) cluster the moving objects and remove noise blobs, using Euclidean clustering, (iv) distinguish independent objects and track the movement using the Kalman filter, and (v) avoid collision, using the proposed decision-making techniques. This work focuses on the design and the demonstration of a vision-based fast-moving object detection and tracking system with decision-making capabilities to perform evasive maneuvers to replace a high-vision system such as event camera. The novelty of our method lies in the motion-compensating moving object detection framework, which accomplishes the task with background subtraction via a two-dimensional transformation approximation. Clustering and tracking algorithms process detection data to track independent objects, and stereo-camera-based distance estimation is conducted to estimate the three-dimensional trajectory, which is then used during decision-making procedures. The examination of the system is conducted with a test quadrotor UAV, and appropriate algorithm parameters for various requirements are deduced.

Reactive Obstacle Avoidance for Highly Maneuverable Vehicles Based on a Two-Stage Optical Flow Clustering

Monocular Vision Based Obstacle Detection for Robot Navigation in Unstructured Environment

Dynamic Illumination Optical Flow Computing for Sensing Multiple Mobile Robots from a Drone.

Fusing Stereopsis & Corner Sparse Optical Flow for Real-time Obstacle Avoidance of Unmanned Aerial Vehicle

Seeing Through Pixel Motion: Learning Obstacle Avoidance from Optical Flow with One Camera

Optical Flow-Based Obstacle Detection for Mid-Air Collision Avoidance

Monocular Event-Based Vision for Obstacle Avoidance with a Quadrotor

Dynamic obstacle detection method based on U–V disparity and residual optical flow for autonomous driving

A Theoretical Analysis of the Velocity Obstacle Method for Nonholonomic Vehicles and Underactuated Surface Vessels

Probabilistic Higher-Order Velocity Obstacle for Dynamic Collision Avoidance in Uncertain Environments

Biologically Inspired Collision Avoidance Without Distance Information

Reactive Collision Avoidance for Safe Agile Navigation

End to end collision avoidance based on optical flow and neural networks

Moving Obstacle Avoidance: a Data-Driven Risk-Aware Approach

Overtaking Vehicle Detection Using Dynamic and Quasi-Static Background Modeling

Optical Flow Matters: an Empirical Comparative Study on Fusing Monocular Extracted Modalities for Better Steering

Fast Obstacle Avoidance Based on Real-Time Sensing

Where Should I Look? Optimised Gaze Control for Whole-Body Collision Avoidance in Dynamic Environments

Vision-Based In-Flight Collision Avoidance Control Based on Background Subtraction Using Embedded System

A real-time obstacle avoidance and path tracking strategy for a mobile robot using machine-learning and vision-based approach

Optical Flow Based Detection and Tracking of Moving Objects for Autonomous Vehicles