Abstract:Visual inertial odometry (VIO) is widely used for the state estimation of multicopters, but it may function poorly in environments with few visual features or in overly aggressive flights. In this work, we propose a perception-aware collision avoidance trajectory planner for multicopters, that may be used with any feature-based VIO algorithm. Our approach can fly the vehicle to a goal position at high speed, avoiding obstacles in an unknown stationary environment while achieving good VIO state estimation accuracy. The proposed planner samples a group of minimum jerk trajectories and finds collision-free trajectories among them, which are then evaluated based on their speed to the goal and perception quality. Both the motion blur of features and their locations are considered for the perception quality. Our novel consideration of the motion blur of features enables automatic adaptation of the trajectory's aggressiveness under environments with different light levels. The best trajectory from the evaluation is tracked by the vehicle and is updated in a receding horizon manner when new images are received from the camera. Only generic assumptions about the VIO are made, so that the planner may be used with various existing systems. The proposed method can run in real-time on a small embedded computer on board. We validated the effectiveness of our proposed approach through experiments in both indoor and outdoor environments. Compared to a perception-agnostic planner, the proposed planner kept more features in the camera's view and made the flight less aggressive, making the VIO more accurate. It also reduced VIO failures, which occurred for the perception-agnostic planner but not for the proposed planner. The ability of the proposed planner to fly through dense obstacles was also validated. The experiment video can be found at https://youtu.be/qO3LZIrpwtQ.

Perception-Aware Baesd Quadrotor Translation and Yaw Angle Planner in Unpredictable Dynamic Situations

Autonomous Flights in Dynamic Environments with Onboard Vision

Alternating Minimization Based Trajectory Generation for Quadrotor Aggressive Flight

Automatic Parameter Adaptation for Quadrotor Trajectory Planning

3D Path Planning of Quadrotor Aerial Robots Using Numerical Optimization

Whole-Body Real-Time Motion Planning for Multicopters

Polynomial-based Online Planning for Autonomous Drone Racing in Dynamic Environments

Safety-Driven and Localization Uncertainty-Driven Perception-Aware Trajectory Planning for Quadrotor Unmanned Aerial Vehicles

CPA-Planner: Motion Planner with Complete Perception Awareness for Sensing- Limited Quadrotors

A Safer Vision-based Autonomous Planning System for Quadrotor UAVs with Dynamic Obstacle Trajectory Prediction and Its Application with LLMs

Integrated Path Planning and Trajectory Tracking Control for Quadrotor UAVs with Obstacle Avoidance in the Presence of Environmental and Systematic Uncertainties: Theory and Experiment

EVA-Planner: Environmental Adaptive Quadrotor Planning

Real-time Quadrotor Navigation Through Planning in Depth Space in Unstructured Environments

PE-Planner: A Performance-Enhanced Quadrotor Motion Planner for Autonomous Flight in Complex and Dynamic Environments

Obstacle-Aware Topological Planning over Polyhedral Representation for Quadrotors.

Perception-Aware Receding Horizon Trajectory Planning for Multicopters With Visual-Inertial Odometry

Computationally Efficient Trajectory Planning for High Speed Obstacle Avoidance of a Quadrotor with Active Sensing.

Search-based Path Planning and Receding Horizon Based Trajectory Generation for Quadrotor Motion Planning

Human-guided motion planner with perception awareness for assistive aerial teleoperation

Risk-aware Trajectory Sampling for Quadrotor Obstacle Avoidance in Dynamic Environments

Safe Interval Motion Planning for Quadrotors in Dynamic Environments