Abstract:Currently, simultaneous localization and mapping (SLAM) is one of the main research topics in the robotics field. Visual-inertia SLAM, which consists of a camera and an inertial measurement unit (IMU), can significantly improve robustness and enable scale weak-visibility, whereas monocular visual SLAM is scale-invisible. For ground mobile robots, the introduction of a wheel speed sensor can solve the scale weak-visibility problem and improve robustness under abnormal conditions. In this paper, a multi-sensor fusion SLAM algorithm using monocular vision, inertia, and wheel speed measurements is proposed. The sensor measurements are combined in a tightly coupled manner, and a nonlinear optimization method is used to maximize the posterior probability to solve the optimal state estimation. Loop detection and back-end optimization are added to help reduce or even eliminate the cumulative error of the estimated poses, thus ensuring global consistency of the trajectory and map. The outstanding contribution of this paper is that the wheel odometer pre-integration algorithm, which combines the chassis speed and IMU angular speed, can avoid the repeated integration caused by linearization point changes during iterative optimization; state initialization based on the wheel odometer and IMU enables a quick and reliable calculation of the initial state values required by the state estimator in both stationary and moving states. Comparative experiments were conducted in room-scale scenes, building scale scenes, and visual loss scenarios. The results showed that the proposed algorithm is highly accurate—2.2 m of cumulative error after moving 812 m (0.28%, loopback optimization disabled)—robust, and has an effective localization capability even in the event of sensor loss, including visual loss. The accuracy and robustness of the proposed method are superior to those of monocular visual inertia SLAM and traditional wheel odometers.

Visual/inertial odometry with tight coupling of multi-bit pose information

Robust Tightly-Coupled Visual-Inertial Odometry with Pre-built Maps in High Latency Situations

A Binocular Vision/IMU MSCKF Localization Method Considering Dynamic Initialization and Loopback Detection

Invariant Cubature Kalman Filtering-Based Visual-Inertial Odometry for Robot Pose Estimation

Robust and Efficient Visual-Inertial Odometry with Multi-plane Priors.

A Monocular Visual-Inertial Odometry Based on Hybrid Residuals.

Tightly Coupled Optimization-based GPS-Visual-Inertial Odometry with Online Calibration and Initialization

Robust Visual-Inertial Odometry Based on a Kalman Filter and Factor Graph

A New Tightly-Coupled Dual-VIO for a Mobile Manipulator With Dynamic Locomotion

Direct Visual-Inertial Odometry with Semi-Dense Mapping

Vins-Mkf: A Tightly-Coupled Multi-Keyframe Visual-Inertial Odometry For Accurate And Robust State Estimation

Tightly-coupled Fusion of Global Positional Measurements in Optimization-based Visual-Inertial Odometry

DVIO: an Optimization-Based Tightly Coupled Direct Visual-Inertial Odometry

Robust Tightly Coupled Pose Measurement Based on Multi-Sensor Fusion in Mobile Robot System

Loosely Coupled Stereo VINS Based on Point-Line Features Tracking with Feedback Loops

An improved visual odometry optimization algorithm based on Kinect camera

A Robust and Integrated Visual Odometry Framework Exploiting the Optical Flow and Feature Point Method

RGB-D Inertial Odometry for Indoor Robot via Keyframe-based Nonlinear Optimization

Time-Differenced Carrier Phase Assisted Visual-Inertial Odometry with Global Pose Graph Optimization

Tightly-coupled Vision-Gyro- Wheel Odometry for Ground Vehicle with Online Extrinsic Calibration

Adaptive Stereo Direct Visual Odometry with Real-Time Loop Closure Detection and Relocalization