Abstract:Deploying autonomous robots in crowded indoor environments usually requires them to have accurate dynamic obstacle perception. Although plenty of previous works in the autonomous driving field have investigated the 3D object detection problem, the usage of dense point clouds from a heavy Light Detection and Ranging (LiDAR) sensor and their high computation cost for learning-based data processing make those methods not applicable to small robots, such as vision-based UAVs with small onboard computers. To address this issue, we propose a lightweight 3D dynamic obstacle detection and tracking (DODT) method based on an RGB-D camera, which is designed for low-power robots with limited computing power. Our method adopts a novel ensemble detection strategy, combining multiple computationally efficient but low-accuracy detectors to achieve real-time high-accuracy obstacle detection. Besides, we introduce a new feature-based data association and tracking method to prevent mismatches utilizing point clouds' statistical features. In addition, our system includes an optional and auxiliary learning-based module to enhance the obstacle detection range and dynamic obstacle identification. The proposed method is implemented in a small quadcopter, and the results show that our method can achieve the lowest position error (0.11m) and a comparable velocity error (0.23m/s) across the benchmarking algorithms running on the robot's onboard computer. The flight experiments prove that the tracking results from the proposed method can make the robot efficiently alter its trajectory for navigating dynamic environments. Our software is available on GitHub as an open-source ROS package.

Detection-Aware Trajectory Generation for a Drone Cinematographer

A Simultaneous Trajectory Generation Method for Quadcopter Intercepting Ground Mobile Vehicle

Aerial Chasing of a Dynamic Target in Complex Environments

Visibility-aware Trajectory Optimization with Application to Aerial Tracking

Elastic Tracker: A Spatio-temporal Trajectory Planner for Flexible Aerial Tracking

On trackability of a moving target by fixed-wing UAV using geometric approach

QP Chaser: Polynomial Trajectory Generation for Autonomous Aerial Tracking

Alternating Minimization Based Trajectory Generation for Quadrotor Aggressive Flight

A Vision-based UAV Tracker Aiming at Aerial Targets

Tiny Drone Tracking Framework Using Multiple Trackers and Kalman-based Predictor

3D Trajectory Reconstruction of Drones using a Single Camera

Risk-aware Trajectory Sampling for Quadrotor Obstacle Avoidance in Dynamic Environments

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

Trajectory Approximation of Video Based on Phase Correlation for Forward Facing Camera

Optimal Trajectory Planning for Autonomous Drone Cinematography

Onboard dynamic-object detection and tracking for autonomous robot navigation with RGB-D camera

Real-Time Drone (UAV) Trajectory Generation and Tracking by Optical Flow

BPMP-Tracker: A Versatile Aerial Target Tracker Using Bernstein Polynomial Motion Primitives

Optimization-based Trajectory Tracking Approach for Multi-rotor Aerial Vehicles in Unknown Environments

Moving Vehicle Tracking with a Moving Drone Based on Track Association

Artificial Potential Field Based Trajectory Tracking for Quadcopter UAV Moving Targets