Abstract:Currently, simultaneous localization and mapping (SLAM) is one of the main research topics in the robotics field. Visual-inertia SLAM, which consists of a camera and an inertial measurement unit (IMU), can significantly improve robustness and enable scale weak-visibility, whereas monocular visual SLAM is scale-invisible. For ground mobile robots, the introduction of a wheel speed sensor can solve the scale weak-visibility problem and improve robustness under abnormal conditions. In this paper, a multi-sensor fusion SLAM algorithm using monocular vision, inertia, and wheel speed measurements is proposed. The sensor measurements are combined in a tightly coupled manner, and a nonlinear optimization method is used to maximize the posterior probability to solve the optimal state estimation. Loop detection and back-end optimization are added to help reduce or even eliminate the cumulative error of the estimated poses, thus ensuring global consistency of the trajectory and map. The outstanding contribution of this paper is that the wheel odometer pre-integration algorithm, which combines the chassis speed and IMU angular speed, can avoid the repeated integration caused by linearization point changes during iterative optimization; state initialization based on the wheel odometer and IMU enables a quick and reliable calculation of the initial state values required by the state estimator in both stationary and moving states. Comparative experiments were conducted in room-scale scenes, building scale scenes, and visual loss scenarios. The results showed that the proposed algorithm is highly accurate—2.2 m of cumulative error after moving 812 m (0.28%, loopback optimization disabled)—robust, and has an effective localization capability even in the event of sensor loss, including visual loss. The accuracy and robustness of the proposed method are superior to those of monocular visual inertia SLAM and traditional wheel odometers.

Optimization-based legged odometry and sensor fusion for legged robot continuous localization

A Bio-inspired SLAM System for a Legged Robot

Simultaneous localization and map building with linear system model.

Degeneration-Aware Localization with Arbitrary Global-Local Sensor Fusion.

Evaluating Map-Based RGB-D SLAM on an Autonomous Walking Robot

Robust Tightly Coupled Pose Measurement Based on Multi-Sensor Fusion in Mobile Robot System

Local Optimized and Scalable Frame-to-model SLAM

LVIO-SAM: A Multi-sensor Fusion Odometry via Smoothing and Mapping

State Estimation for Legged Robots Using Contact-Centric Leg Odometry

Robust Optimization-Based Fusion of GNSS and Visual-Inertial-Wheel Odometry.

Odometry Estimation Utilizing 6-DOF Force Sensors and IMU for Legged Robot

OptiState: State Estimation of Legged Robots using Gated Networks with Transformer-based Vision and Kalman Filtering

Learning Inertial Odometry for Dynamic Legged Robot State Estimation

Continuous-Time Fixed-Lag Smoothing for LiDAR-Inertial-Camera SLAM

A Sensor Fusion Method for Pose Estimation of C-Legged Robots

Mobile Robot Localization: a Modular, Odometry-Improving Approach

A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensors

Navigating by Touch: Haptic Monte Carlo Localization via Geometric Sensing and Terrain Classification

Robot Localization Method Based on Multi-Sensor Fusion in Low-Light Environment

Robot Localization and Navigation Using Visible Light Positioning and SLAM Fusion

A Robust and Fast GNSS-Inertial-LiDAR Odometry With INS-Centric Multiple Modalities by IESKF