Abstract:Currently, simultaneous localization and mapping (SLAM) is one of the main research topics in the robotics field. Visual-inertia SLAM, which consists of a camera and an inertial measurement unit (IMU), can significantly improve robustness and enable scale weak-visibility, whereas monocular visual SLAM is scale-invisible. For ground mobile robots, the introduction of a wheel speed sensor can solve the scale weak-visibility problem and improve robustness under abnormal conditions. In this paper, a multi-sensor fusion SLAM algorithm using monocular vision, inertia, and wheel speed measurements is proposed. The sensor measurements are combined in a tightly coupled manner, and a nonlinear optimization method is used to maximize the posterior probability to solve the optimal state estimation. Loop detection and back-end optimization are added to help reduce or even eliminate the cumulative error of the estimated poses, thus ensuring global consistency of the trajectory and map. The outstanding contribution of this paper is that the wheel odometer pre-integration algorithm, which combines the chassis speed and IMU angular speed, can avoid the repeated integration caused by linearization point changes during iterative optimization; state initialization based on the wheel odometer and IMU enables a quick and reliable calculation of the initial state values required by the state estimator in both stationary and moving states. Comparative experiments were conducted in room-scale scenes, building scale scenes, and visual loss scenarios. The results showed that the proposed algorithm is highly accurate—2.2 m of cumulative error after moving 812 m (0.28%, loopback optimization disabled)—robust, and has an effective localization capability even in the event of sensor loss, including visual loss. The accuracy and robustness of the proposed method are superior to those of monocular visual inertia SLAM and traditional wheel odometers.

A Multisensory Data Fusion Method of the Two-Wheeled Self-Balanced Robot

Multisensor Data Fusion for Robot Parts Recognition

Online Multi-Object Tracking from A Bird's-Eye View by Fusion of Millimeter-Wave Radar and Vision

An Auditory and Olfactory Data Fusion Algorithm Based on Spiking Neural Network for Mobile Robot

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

SVM-based Extended Kalman Filter State Estimation of Biped Robot.

Multi-Sensor Fusion Based Robot Self-Activity Recognition

Multimodal fusion and human-robot interaction control of an intelligent robot

Robust Tightly Coupled Pose Measurement Based on Multi-Sensor Fusion in Mobile Robot System

Gait Recognition Using Optical Motion Capture: A Decision Fusion Based Method

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Vision SLAM algorithm for wheeled robots integrating multiple sensors

Multi-Sensor Fusion for Wheel-Inertial-Visual Systems Using a Fuzzification-Assisted Iterated Error State Kalman Filter

Multi-Sensor Fusion Tomato Picking Robot Localization and Mapping Research

Multimodal sensory fusion for soccer robot self-localization based on long short-term memory recurrent neural network

A Multimodal Information Fusion Model for Robot Action Recognition with Time Series

A Sensor Fusion Algorithm: Improving State Estimation Accuracy for a Quadruped Robot Dog

Robust Data Fusion of Multimodal Sensory Information for Mobile Robots

A Novel Multi-Sensor Hybrid Fusion Framework

Physical Extraction and Feature Fusion for Multi-Mode Signals in a Measurement System for Patients in Rehabilitation Exoskeleton

Multi-heterogeneous sensor data fusion method via convolutional neural network for fault diagnosis of wheeled mobile robot