Abstract:The combination of visual and inertial sensors for state estimation has recently found wide echo in the robotics community, especially in the aerial robotics field, due to the lightweight and complementary characteristics of the sensors data. However, most state estimation systems based on visual-inertial sensing suffer from severe processor requirements, which in many cases make them impractical. In this paper, we propose a simple, low-cost and high rate method for state estimation enabling autonomous flight of micro aerial vehicles, which presents a low computational burden. The proposed state estimator fuses observations from an inertial measurement unit, an optical flow smart camera and a time-of-flight range sensor. The smart camera provides optical flow measurements up to a rate of 200 Hz, avoiding the computational bottleneck to the main processor produced by all image processing requirements. To the best of our knowledge, this is the first example of extending the use of these smart cameras from hovering-like motions to odometry estimation, producing estimates that are usable during flight times of several minutes. In order to validate and defend the simplest algorithmic solution, we investigate the performances of two Kalman filters, in the extended and error-state flavors, alongside with a large number of algorithm modifications defended in earlier literature on visual-inertial odometry, showing that their impact on filter performance is minimal. To close the control loop, a non-linear controller operating in the special Euclidean group SE(3) is able to drive, based on the estimated vehicle’s state, a quadrotor platform in 3D space guaranteeing the asymptotic stability of 3D position and heading. All the estimation and control tasks are solved on board and in real time on a limited computational unit. The proposed approach is validated through simulations and experimental results, which include comparisons with ground-truth data provided by a motion capture system. For the benefit of the community, we make the source code public.

Improvement in the UAV position estimation with low-cost GPS, INS and vision-based system: Application to a quadrotor UAV

Sensing and Control of a Quadrotor Using a Visual Inertial Fusion Method

A Miniature Integrated Navigation System for Rotary-Wing Unmanned Aerial Vehicles

A Position Estimation and Control System for the Quadrotor in GPS-Deny Situation Based on FAST Detection and Optical Flow

Monocular Snapshot-based Sensing and Control of Hover, Takeoff, and Landing for a Low-cost Quadrotor

A Vision-based UAV Tracker Aiming at Aerial Targets

Metric Sensing and Control of a Quadrotor Using a Homography-Based Visual Inertial Fusion Method.

A Sensor Fusion Approach to Observe Quadrotor Velocity

Design and Implementation of Low Cost Integrated Navigation System for Mini Autonomous Helicopter

Delayed Monocular SLAM Approach Applied to Unmanned Aerial Vehicles

Autonomous Flight Using UWB-Based Positioning System with Optical Flow Sensors in a GPS-Denied Environment

A Homography-Based Visual Inertial Fusion Method for Robust Sensing of a Micro Aerial Vehicle

Autonomous navigation of micro aerial vehicles using high-rate and low-cost sensors

Differential GNSS and Vision-Based Tracking to Improve Navigation Performance in Cooperative Multi-UAV Systems

Position estimation and control for quadrotor using optical flow and GPS sensors

Onboard Hover Control of a Quadrotor using Template Matching and Optic Flow

Position Estimation Method for Small Drones Based on the Fusion of Multisource, Multimodal Data and Digital Twins

Improving Optical Flow Sensor Using a Gimbal for Quadrotor Navigation in GPS-Denied Environment

Dynamic Attitude Estimation Improvement for Low-cost MEMS IMU by Integrating Low-cost GPS

Monocular Visual SLAM Based on a Cooperative UAV-Target System

Onboard Real-Time Multi-Sensor Pose Estimation for Indoor Quadrotor Navigation with Intermittent Communication