Abstract:The development of high-performance, low-cost unmanned aerial vehicles paired with rapid progress in vision-based perception systems herald a new era of autonomous flight systems with mission-ready capabilities. One of the key features of an autonomous UAV is a robust mid-air collision avoidance strategy. This paper proposes a vision-based in-flight collision avoidance system based on background subtraction using an embedded computing system for unmanned aerial vehicles (UAVs). The pipeline of proposed in-flight collision avoidance system is as follows: (i) subtract dynamic background subtraction to remove it and to detect moving objects, (ii) denoise using morphology and binarization methods, (iii) cluster the moving objects and remove noise blobs, using Euclidean clustering, (iv) distinguish independent objects and track the movement using the Kalman filter, and (v) avoid collision, using the proposed decision-making techniques. This work focuses on the design and the demonstration of a vision-based fast-moving object detection and tracking system with decision-making capabilities to perform evasive maneuvers to replace a high-vision system such as event camera. The novelty of our method lies in the motion-compensating moving object detection framework, which accomplishes the task with background subtraction via a two-dimensional transformation approximation. Clustering and tracking algorithms process detection data to track independent objects, and stereo-camera-based distance estimation is conducted to estimate the three-dimensional trajectory, which is then used during decision-making procedures. The examination of the system is conducted with a test quadrotor UAV, and appropriate algorithm parameters for various requirements are deduced.

A robust vision system on an unmanned helicopter for ground target seeking and following

A Vision System for Autonomous Flight of Micro Helicopter

A Vision-based UAV Tracker Aiming at Aerial Targets

A vision system for landing an unmanned helicopter in a complex environment

Small Unmanned Aerial Vehicle Visual System for Ground Moving Target Positioning

Vision-Based Target Detection and Tracking System for a Quadcopter

Vision navigation for unmanned helicopter autonomous landing

Vision System for an Unmanned Helicopter Landing in Complex Environment

A Vision-Based Ground Moving Target Tracking System for Quadrotor UAVs

Quadcopter Drone for Vision-Based Autonomous Target Following

Vision System for Mini Unmanned Aerial Vehicles Based on DSP

Design and implementation of a visual tracking system for small-scale unmanned helicopters

Vision System for Aerial Robot

An Integrated Visual System for Unmanned Aerial Vehicles Tracking and Landing on the Ground Vehicles

Visual Servo Control Of Unmanned Aerial Vehicles: An Object Tracking-Based Approach

Vision-based system for a real-time detection and following of UAV

On-board Monocular Vision-based Ground Target Recognition and Localization System for a Flapping-wing Aerial Vehicle.

Robust Vision-Based Control of a Rotorcraft UAV for Uncooperative Target Tracking

Autonomous Landing of a Helicopter UAV with a Ground-Based Multisensory Fusion System

The Object Recognition and Adaptive Threshold Selection in the Vision System for Landing an Unmanned Aerial Vehicle

Vision-Based In-Flight Collision Avoidance Control Based on Background Subtraction Using Embedded System