Abstract:Deploying autonomous robots in crowded indoor environments usually requires them to have accurate dynamic obstacle perception. Although plenty of previous works in the autonomous driving field have investigated the 3D object detection problem, the usage of dense point clouds from a heavy Light Detection and Ranging (LiDAR) sensor and their high computation cost for learning-based data processing make those methods not applicable to small robots, such as vision-based UAVs with small onboard computers. To address this issue, we propose a lightweight 3D dynamic obstacle detection and tracking (DODT) method based on an RGB-D camera, which is designed for low-power robots with limited computing power. Our method adopts a novel ensemble detection strategy, combining multiple computationally efficient but low-accuracy detectors to achieve real-time high-accuracy obstacle detection. Besides, we introduce a new feature-based data association and tracking method to prevent mismatches utilizing point clouds' statistical features. In addition, our system includes an optional and auxiliary learning-based module to enhance the obstacle detection range and dynamic obstacle identification. The proposed method is implemented in a small quadcopter, and the results show that our method can achieve the lowest position error (0.11m) and a comparable velocity error (0.23m/s) across the benchmarking algorithms running on the robot's onboard computer. The flight experiments prove that the tracking results from the proposed method can make the robot efficiently alter its trajectory for navigating dynamic environments. Our software is available on GitHub as an open-source ROS package.

Dynamic Target Tracking and Localization for Small UAV in Unstructured Outdoor Environment

Dynamic Target Tracking of Small UAVs in Unstructured Environment

A Vision-based UAV Tracker Aiming at Aerial Targets

Dynamic Target Tracking and Ingressing of a Small UAV Using Monocular Sensor Based on the Geometric Constraints

Similar Targets Detection and Location Indoors by UAV

A Novel Real-Time Moving Target Tracking and Path Planning System for a Quadrotor UAV in Unknown Unstructured Outdoor Scenes

Real-time tracking a ground moving target in complex indoor and outdoor environments with UAV

Fast-Tracker: A Robust Aerial System for Tracking Agile Target in Cluttered Environments

Development of UAV-Based Target Tracking and Recognition Systems

Moving Target Tracking for Single UAV In Open Outdoor Environment

A Vision-Based Ground Moving Target Tracking System for Quadrotor UAVs

Real-Time Visual Tracking of Moving Targets Using a Low-Cost Unmanned Aerial Vehicle with a 3-Axis Stabilized Gimbal System

Dynamic Object Tracking on Autonomous UAV System for Surveillance Applications

Small Target Recognition and Tracking Based on UAV Platform

Vision-Based Target Detection and Tracking System for a Quadcopter

Onboard dynamic-object detection and tracking for autonomous robot navigation with RGB-D camera

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

ECO-HC Based Tracking for Ground Moving Target Using Single UAV

Camera-Based Local and Global Target Detection, Tracking, and Localization Techniques for UAVs

Research on Target Tracking System of Quadrotor UAV Based on Monocular Vision

Long-term Reliable Visual Tracking with UAVs.