Abstract:The combination of visual and inertial sensors for state estimation has recently found wide echo in the robotics community, especially in the aerial robotics field, due to the lightweight and complementary characteristics of the sensors data. However, most state estimation systems based on visual-inertial sensing suffer from severe processor requirements, which in many cases make them impractical. In this paper, we propose a simple, low-cost and high rate method for state estimation enabling autonomous flight of micro aerial vehicles, which presents a low computational burden. The proposed state estimator fuses observations from an inertial measurement unit, an optical flow smart camera and a time-of-flight range sensor. The smart camera provides optical flow measurements up to a rate of 200 Hz, avoiding the computational bottleneck to the main processor produced by all image processing requirements. To the best of our knowledge, this is the first example of extending the use of these smart cameras from hovering-like motions to odometry estimation, producing estimates that are usable during flight times of several minutes. In order to validate and defend the simplest algorithmic solution, we investigate the performances of two Kalman filters, in the extended and error-state flavors, alongside with a large number of algorithm modifications defended in earlier literature on visual-inertial odometry, showing that their impact on filter performance is minimal. To close the control loop, a non-linear controller operating in the special Euclidean group SE(3) is able to drive, based on the estimated vehicle’s state, a quadrotor platform in 3D space guaranteeing the asymptotic stability of 3D position and heading. All the estimation and control tasks are solved on board and in real time on a limited computational unit. The proposed approach is validated through simulations and experimental results, which include comparisons with ground-truth data provided by a motion capture system. For the benefit of the community, we make the source code public.

Real-time and 3D vision for autonomous small and micro air vehicles

Autonomous Flights in Dynamic Environments with Onboard Vision

3D Vehicle Detection Using Cheap LiDAR and Camera Sensors.

Binocular Stereo Vision Based 3D Mapping for Micro Aerial Vehicles in an Indoor Environment

Autonomous navigation of micro aerial vehicles using high-rate and low-cost sensors

Small Unmanned Aerial Vehicle Visual System for Ground Moving Target Positioning

Monocular Snapshot-based Sensing and Control of Hover, Takeoff, and Landing for a Low-cost Quadrotor

Toward Autonomy of Micro Aerial Vehicles in Unknown and Global Positioning System Denied Environments

OwlFusion: Depth-Only Onboard Real-Time 3D Reconstruction of Scalable Scenes for Fast-Moving MAV

Real-Time Optimal States Estimation with Inertial and Delayed Visual Measurements for Unmanned Aerial Vehicles

Search-based 3D Planning and Trajectory Optimization for Safe Micro Aerial Vehicle Flight Under Sensor Visibility Constraints

Monocular Vision based Collaborative Localization for Micro Aerial Vehicle Swarms

Monocular Vision-Based Obstacle Detection/Avoidance For Unmanned Aerial Vehicles

Autonomous navigation and environment modeling for MAVs in 3-D enclosed industrial environments

Autonomous 3D Reconstruction Using a MAV

Visual Localization and Environment Mapping for Micro Aerial Vehicles

Multi-camera visual SLAM for autonomous navigation of micro aerial vehicles

Vision-based Relative Detection and Tracking for Teams of Micro Aerial Vehicles

Efficient Submap-based Autonomous MAV Exploration using Visual-Inertial SLAM Configurable for LiDARs or Depth Cameras

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

Visual Odometry and 3D Mapping in Indoor Environments