Abstract:Currently, simultaneous localization and mapping (SLAM) is one of the main research topics in the robotics field. Visual-inertia SLAM, which consists of a camera and an inertial measurement unit (IMU), can significantly improve robustness and enable scale weak-visibility, whereas monocular visual SLAM is scale-invisible. For ground mobile robots, the introduction of a wheel speed sensor can solve the scale weak-visibility problem and improve robustness under abnormal conditions. In this paper, a multi-sensor fusion SLAM algorithm using monocular vision, inertia, and wheel speed measurements is proposed. The sensor measurements are combined in a tightly coupled manner, and a nonlinear optimization method is used to maximize the posterior probability to solve the optimal state estimation. Loop detection and back-end optimization are added to help reduce or even eliminate the cumulative error of the estimated poses, thus ensuring global consistency of the trajectory and map. The outstanding contribution of this paper is that the wheel odometer pre-integration algorithm, which combines the chassis speed and IMU angular speed, can avoid the repeated integration caused by linearization point changes during iterative optimization; state initialization based on the wheel odometer and IMU enables a quick and reliable calculation of the initial state values required by the state estimator in both stationary and moving states. Comparative experiments were conducted in room-scale scenes, building scale scenes, and visual loss scenarios. The results showed that the proposed algorithm is highly accurate—2.2 m of cumulative error after moving 812 m (0.28%, loopback optimization disabled)—robust, and has an effective localization capability even in the event of sensor loss, including visual loss. The accuracy and robustness of the proposed method are superior to those of monocular visual inertia SLAM and traditional wheel odometers.

Visual Inertial Wheel Odometry on SE(3) for Mobile Robots with Extrinsic Calibration

Simultaneous Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Uncalibrated Extrinsic Parameters

Simultaneous Intrinsic And Extrinsic Calibration Of A Visual-Odometric Sensor System

Kinematics Based Visual Localization for Skid-Steering Robots: Algorithm and Theory.

Visual-Inertial Localization for Skid-Steering Robots with Kinematic Constraints

Accurate and Robust Odometry by Fusing Monocular Visual, Inertial, and Wheel Encoder.

Stereo Visual-Inertial Odometry with Multiple Kalman Filters Ensemble

Implementation and observability analysis of visual-inertial-wheel odometry with robust initialization and online extrinsic calibration

Robust Tightly Coupled Pose Measurement Based on Multi-Sensor Fusion in Mobile Robot System

GPS-aided Visual Wheel Odometry

Tightly coupled robust positioning of visual-inertial-wheel encoders in visually challenging environments

Pose Estimation Based on Bidirectional Visual–Inertial Odometry with 3D LiDAR (BV-LIO)

Visual Slam Incorporating Wheel Odometer For Indoor Robots

Robust Visual Odometry on $\text{se}(3)$: Design and Verification

Visual-Inertial-Wheel Odometry with Wheel-Aided Maximum-a-Posteriori Initialization for Ground Robots

RGB-D Inertial Odometry for Indoor Robot via Keyframe-based Nonlinear Optimization

Monocular visual-inertial SLAM algorithm combined with wheel speed anomaly detection

Insufficient environmental information indoor localization of mecanum mobile platform using wheel-visual-inertial odometry

Wheel-SLAM: Simultaneous Localization and Terrain Mapping Using One Wheel-Mounted IMU

RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environments

Active Extrinsic Calibration of Encoder and LIDAR for Robot