Abstract:Tracking a maneuvering target with a quadcopter is a challenging problem, that involves a variety of fields such as visual tracking, state estimation, and control algorithms. Most existing unmanned aerial vehicle (UAV) systems fail to track targets accurately in the long term and cannot relocate targets after target loss. This paper aims to design and implement a vision-based target tracking system for quadcopters that can steadily and accurately track the ground target as well as the air target without any prior information. We employ a vision detection algorithm to select the target quickly and precisely. To fit complex practical conditions, a target tracking algorithm is developed based on correlation filters, which is capable of tracking targets with large-scale variation and fast motion. In addition, an efficient redetection algorithm based on the support vector machine (SVM) is designed to handle target occlusions and loss. The target states are estimated from the visual information by an improved Lucas-Kanade (LK) optical flow method and an extended Kalman filter (EKF). Moreover, a double closed-loop Proportion Integral Differential (PID) controller using the estimated states is designed to follow the target. By implementing the main algorithms on an onboard NUC computer, an extensive outdoor flight is evaluated for a quadcopter platform equipped with a stereo camera. The experimental results validate the feasibility and practicability of the developed system.

On-board Monocular Vision-based Ground Target Recognition and Localization System for a Flapping-wing Aerial Vehicle.

Target Detection and Localization for Flapping-Wing Robots Based on Biological Eagle-Eye Vision

Autonomous Flights in Dynamic Environments with Onboard Vision

Small Unmanned Aerial Vehicle Visual System for Ground Moving Target Positioning

TJ-FlyingFish: an Unmanned Morphable Aerial-Aquatic Vehicle System

Vision-Based Target Localization for a Flapping-Wing Aerial Vehicle

Fast-Tracker 2.0: Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression.

Collision-Aware Navigation for Flapping-Wing Aerial Robots in Dense Environments

The Object Recognition and Adaptive Threshold Selection in the Vision System for Landing an Unmanned Aerial Vehicle

A Vision-based UAV Tracker Aiming at Aerial Targets

A Vision System for Autonomous Flight of Micro Helicopter

Real-Time Visual Tracking of Moving Targets Using a Low-Cost Unmanned Aerial Vehicle with a 3-Axis Stabilized Gimbal System

Development of UAV-Based Target Tracking and Recognition Systems

Monocular vision-based real-time target recognition and tracking for autonomously landing an UAV in a cluttered shipboard environment

An Integrated Visual System for Unmanned Aerial Vehicles Tracking and Landing on the Ground Vehicles

AERIAL VEHICLES DETECTION AND RECOGNITION FOR UAV VISION SYSTEM

Remote Sensing on a Bird-inspired Flapping Wings Robot Combined with LiDAR

Monocular Long-Term Target Following on UAVs

Multi-resolution Visual Fiducial and Assistant Navigation System for Unmanned Aerial Vehicle Landing

Vision-Based Target Detection and Tracking System for a Quadcopter

Infrared and Visible Image Fusion with Deep Neural Network in Enhanced Flight Vision System