Abstract:The combination of visual and inertial sensors for state estimation has recently found wide echo in the robotics community, especially in the aerial robotics field, due to the lightweight and complementary characteristics of the sensors data. However, most state estimation systems based on visual-inertial sensing suffer from severe processor requirements, which in many cases make them impractical. In this paper, we propose a simple, low-cost and high rate method for state estimation enabling autonomous flight of micro aerial vehicles, which presents a low computational burden. The proposed state estimator fuses observations from an inertial measurement unit, an optical flow smart camera and a time-of-flight range sensor. The smart camera provides optical flow measurements up to a rate of 200 Hz, avoiding the computational bottleneck to the main processor produced by all image processing requirements. To the best of our knowledge, this is the first example of extending the use of these smart cameras from hovering-like motions to odometry estimation, producing estimates that are usable during flight times of several minutes. In order to validate and defend the simplest algorithmic solution, we investigate the performances of two Kalman filters, in the extended and error-state flavors, alongside with a large number of algorithm modifications defended in earlier literature on visual-inertial odometry, showing that their impact on filter performance is minimal. To close the control loop, a non-linear controller operating in the special Euclidean group SE(3) is able to drive, based on the estimated vehicle’s state, a quadrotor platform in 3D space guaranteeing the asymptotic stability of 3D position and heading. All the estimation and control tasks are solved on board and in real time on a limited computational unit. The proposed approach is validated through simulations and experimental results, which include comparisons with ground-truth data provided by a motion capture system. For the benefit of the community, we make the source code public.

Surgical glove perforation in dermatologic surgery.

A Homography-Based Visual Inertial Fusion Method for Robust Sensing of a Micro Aerial Vehicle

Real-Time Onboard 3D State Estimation of an Unmanned Aerial Vehicle in Multi-Environments Using Multi-Sensor Data Fusion

Sensing and Control of a Quadrotor Using a Visual Inertial Fusion Method

State Estimation of QAUV Based on Dynamic Model

Metric Sensing and Control of a Quadrotor Using a Homography-Based Visual Inertial Fusion Method.

Inertial-aided State and Slope Estimation Using a Monocular Camera

Inertial-Aided Metric States and Surface Normal Estimation Using a Monocular Camera.

Autonomous navigation of micro aerial vehicles using high-rate and low-cost sensors

Accurate and Robust State Estimation via Fusion of Visual-Inertial-UWB with Time Synchronization

Delayed Monocular SLAM Approach Applied to Unmanned Aerial Vehicles

Direct Visual-Inertial Ego-Motion Estimation via Iterated Extended Kalman Filter

A Monocular Odometer for a Quadrotor Using a Homography Model and Inertial Cues

A Spatial Localization and Attitude Estimation System for Unmanned Aerial Vehicles Using a Single Dynamic Vision Sensor

Cascaded Motion Estimation for Intelligent Vehicles in GNSS-Denied Scenes

Position Estimation Method for Small Drones Based on the Fusion of Multisource, Multimodal Data and Digital Twins

Multi-Radar Inertial Odometry for 3D State Estimation using mmWave Imaging Radar

Real-Time Cross-View Image Matching and Camera Pose Determination for Unmanned Aerial Vehicles

Real-Time Visual Tracking of Moving Targets Using a Low-Cost Unmanned Aerial Vehicle with a 3-Axis Stabilized Gimbal System

Fusing Stereopsis & Corner Sparse Optical Flow for Real-time Obstacle Avoidance of Unmanned Aerial Vehicle

Onboard Real-Time Multi-Sensor Pose Estimation for Indoor Quadrotor Navigation with Intermittent Communication