Abstract:In this paper, we focus on the problem of motion tracking in unknown environments using visual and inertial sensors. We term this estimation task visual–inertial odometry (VIO), in analogy to the well-known visual-odometry problem. We present a detailed study of extended Kalman filter (EKF)-based VIO algorithms, by comparing both their theoretical properties and empirical performance. We show that an EKF formulation where the state vector comprises a sliding window of poses (the multi-state-constraint Kalman filter (MSCKF)) attains better accuracy, consistency, and computational efficiency than the simultaneous localization and mapping (SLAM) formulation of the EKF, in which the state vector contains the current pose and the features seen by the camera. Moreover, we prove that both types of EKF approaches are inconsistent, due to the way in which Jacobians are computed. Specifically, we show that the observability properties of the EKF’s linearized system models do not match those of the underlying system, which causes the filters to underestimate the uncertainty in the state estimates. Based on our analysis, we propose a novel, real-time EKF-based VIO algorithm, which achieves consistent estimation by (i) ensuring the correct observability properties of its linearized system model, and (ii) performing online estimation of the camera-to-inertial measurement unit (IMU) calibration parameters. This algorithm, which we term MSCKF 2.0, is shown to achieve accuracy and consistency higher than even an iterative, sliding-window fixed-lag smoother, in both Monte Carlo simulations and real-world testing.

Pose and motion estimation from monocular vision based on IEKF, DD1 and DD2 filters

Stereo Camera Motion Estimation Based on Euclidean Reconstruction

An Application Of Unscented Kalman Filter For Pose And Motion Estimation Based On Monocular Vision

Gaussian Particle Filter Based Pose and Motion Estimation

Stereo Visual-Inertial Odometry with Multiple Kalman Filters Ensemble

3D motion estimation from a stereo image sequence using dual-sequential-Kalman-filter

DS-VIO: Robust and Efficient Stereo Visual Inertial Odometry based on Dual Stage EKF

Monocular Vision-Based Iterative Pose Estimation Algorithm from Corresponding Feature Points

Stirling's Interpolation Filtering and Extended Kalman Filtering for Orientation Estimation

Pose Estimation for Unknown Motion Target Based on Improved ICP Algorithm and Adaptive EKF

SP-VIO: Robust and Efficient Filter-Based Visual Inertial Odometry with State Transformation Model and Pose-Only Visual Description

Real time pose estimation based on extended Kalman filter for binocular camera

PO-MSCKF: An Efficient Visual-Inertial Odometry by Reconstructing the Multi-State Constrained Kalman Filter with the Pose-only Theory

High-precision, consistent EKF-based visual-inertial odometry

Invariant Cubature Kalman Filter for Monocular Visual Inertial Odometry with Line Features

Iterated extended Kalman filter based visual-inertial odometry using direct photometric feedback

A 2-Point Pose Estimation Algorithm For Monocular Visual Odometry Of Ground Vehicles

Nonlinear Stochastic Estimators on the Special Euclidean Group SE(3) using Uncertain IMU and Vision Measurements

Equivariant Filter for Tightly Coupled LiDAR-Inertial Odometry

Tightly coupled Visual Inertial Odometry based on Artificial Landmarks

Motion Estimation Using Region-Level Segmentation and Extended Kalman Filter for Autonomous Driving