Abstract:The development of high-performance, low-cost unmanned aerial vehicles paired with rapid progress in vision-based perception systems herald a new era of autonomous flight systems with mission-ready capabilities. One of the key features of an autonomous UAV is a robust mid-air collision avoidance strategy. This paper proposes a vision-based in-flight collision avoidance system based on background subtraction using an embedded computing system for unmanned aerial vehicles (UAVs). The pipeline of proposed in-flight collision avoidance system is as follows: (i) subtract dynamic background subtraction to remove it and to detect moving objects, (ii) denoise using morphology and binarization methods, (iii) cluster the moving objects and remove noise blobs, using Euclidean clustering, (iv) distinguish independent objects and track the movement using the Kalman filter, and (v) avoid collision, using the proposed decision-making techniques. This work focuses on the design and the demonstration of a vision-based fast-moving object detection and tracking system with decision-making capabilities to perform evasive maneuvers to replace a high-vision system such as event camera. The novelty of our method lies in the motion-compensating moving object detection framework, which accomplishes the task with background subtraction via a two-dimensional transformation approximation. Clustering and tracking algorithms process detection data to track independent objects, and stereo-camera-based distance estimation is conducted to estimate the three-dimensional trajectory, which is then used during decision-making procedures. The examination of the system is conducted with a test quadrotor UAV, and appropriate algorithm parameters for various requirements are deduced.

Fusing Stereopsis & Corner Sparse Optical Flow for Real-time Obstacle Avoidance of Unmanned Aerial Vehicle

Autonomous Flights in Dynamic Environments with Onboard Vision

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

Adaptive Switching Spatial-Temporal Fusion Detection for Remote Flying Drones

Seeing Through Pixel Motion: Learning Obstacle Avoidance from Optical Flow with One Camera

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

Efficient Optical flow and Stereo Vision for Velocity Estimation and Obstacle Avoidance on an Autonomous Pocket Drone

REAL-TIME ON-BOARD OBSTACLE AVOIDANCE FOR UAVS BASED ON EMBEDDED STEREO VISION

Autonomous Obstacle Avoidance for UAV based on Point Cloud

Stereo vision based obstacle avoidance strategy for quadcopter UAV

Research on Obstacle Avoidance Technology for Unmanned Aerial Vehicles Based on Panoramic Visual Perception

Monocular Vision-Based Obstacle Detection/Avoidance For Unmanned Aerial Vehicles

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

Vision-Based In-Flight Collision Avoidance Control Based on Background Subtraction Using Embedded System

Detecting and avoiding frontal obstacles from monocular camera for micro unmanned aerial vehicles

Multi-UAV Cooperative Obstacle Avoidance of 3D Vector Field Histogram Plus and Dynamic Window Approach

Optical Flow-Based Obstacle Detection for Mid-Air Collision Avoidance

Adaptive Visual Servoing for Obstacle Avoidance of Micro Unmanned Aerial Vehicle with Optical Flow and Switched System Model

Aerial Target Detection and Avoidance for UAV Based on Stereo Vision

Monocular Event-Based Vision for Obstacle Avoidance with a Quadrotor

Autonomous aerial obstacle avoidance using LiDAR sensor fusion