Abstract:In this paper, we focus on the problem of motion tracking in unknown environments using visual and inertial sensors. We term this estimation task visual–inertial odometry (VIO), in analogy to the well-known visual-odometry problem. We present a detailed study of extended Kalman filter (EKF)-based VIO algorithms, by comparing both their theoretical properties and empirical performance. We show that an EKF formulation where the state vector comprises a sliding window of poses (the multi-state-constraint Kalman filter (MSCKF)) attains better accuracy, consistency, and computational efficiency than the simultaneous localization and mapping (SLAM) formulation of the EKF, in which the state vector contains the current pose and the features seen by the camera. Moreover, we prove that both types of EKF approaches are inconsistent, due to the way in which Jacobians are computed. Specifically, we show that the observability properties of the EKF’s linearized system models do not match those of the underlying system, which causes the filters to underestimate the uncertainty in the state estimates. Based on our analysis, we propose a novel, real-time EKF-based VIO algorithm, which achieves consistent estimation by (i) ensuring the correct observability properties of its linearized system model, and (ii) performing online estimation of the camera-to-inertial measurement unit (IMU) calibration parameters. This algorithm, which we term MSCKF 2.0, is shown to achieve accuracy and consistency higher than even an iterative, sliding-window fixed-lag smoother, in both Monte Carlo simulations and real-world testing.

A Linear-Complexity EKF for Visual-Inertial Navigation with Loop Closures

Toward Consistent Drift-free Visual Inertial Localization on Keyframe Based Map

Visual-Inertial Localization for Skid-Steering Robots with Kinematic Constraints

Map-Based Visual-Inertial Localization: Consistency and Complexity

Simultaneous localization and map building with linear system model.

Consistent EKF-Based Visual-Inertial Odometry on Matrix Lie Group

EKF-Based Visual Inertial Navigation Using Sliding Window Nonlinear Optimization

MOBILE ROBOT LOCALIZATION USING LINEAR SYSTEM MODEL

Variable Observability Constrained Visual-Inertial-GNSS EKF-Based Navigation.

A Combined Visual-Inertial Navigation System of MSCKF and EKF-SLAM

High-precision, consistent EKF-based visual-inertial odometry

Toward Consistent and Efficient Map-Based Visual-Inertial Localization: Theory Framework and Filter Design

A Visual-Inertial Navigation System Based on Multi-State Constraint Kalman Filter

Variational Bayesian-Based Adaptive Error-State Kalman Filter With Application on LiDAR-Inertial Integrated Navigation System

Accurate Monocular Visual-inertial SLAM using a Map-assisted EKF Approach

Exploiting Symmetries to Design EKFs with Consistency Properties for Navigation and SLAM

Body-Centered Dynamically-Tuned Error-State Extended Kalman Filter for Visual Inertial Odometry in GNSS-Denied Environments

Rapid and robust initialization for monocular visual inertial navigation within multi-state Kalman filter

LiDAR-Inertial Odometry Based on Extended Kalman Filter

Clifford Algebra-Based Iterated Extended Kalman Filter with Application to Low-Cost INS/GNSS Navigation

LIO-EKF: High Frequency LiDAR-Inertial Odometry using Extended Kalman Filters