Abstract:In recent years, the accuracy of visual SLAM (Simultaneous Localization and Mapping) technology has seen significant improvements, making it a prominent area of research. However, within the current RGB-D SLAM systems, the estimation of 3D positions of feature points primarily relies on direct measurements from RGB-D depth cameras, which inherently contain measurement errors. Moreover, the potential of triangulation-based estimation for ORB (Oriented FAST and Rotated BRIEF) feature points remains underutilized. To address the singularity of measurement data, this paper proposes the integration of the ORB features, triangulation uncertainty estimation and depth measurements uncertainty estimation, for 3D positions of feature points. This integration is achieved using a CI (Covariance Intersection) filter, referred to as the CI-TEDM (Triangulation Estimates and Depth Measurements) method. Vision-based SLAM systems face significant challenges, particularly in environments, such as long straight corridors, weakly textured scenes, or during rapid motion, where tracking failures are common. To enhance the stability of visual SLAM, this paper introduces an improved CI-TEDM method by incorporating wheel encoder data. The mathematical model of the encoder is proposed, and detailed derivations of the encoder pre-integration model and error model are provided. Building on these improvements, we propose a novel tightly coupled visual-inertial RGB-D SLAM with encoder integration of ORB triangulation and depth measurement uncertainties. Validation on open-source datasets and real-world environments demonstrates that the proposed improvements significantly enhance the robustness of real-time state estimation and localization accuracy for intelligent vehicles in challenging environments.

Spatial Uncertainty Model of a Three-View RGB-D Camera System

Multi-view 3D Reconstruction from Uncalibrated Radially-Symmetric Cameras

Recurrent Volume-based 3D Feature Fusion for Real-time Multi-view Object Pose Estimation

Robust 3D Reconstruction with an RGB-D Camera

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

High-Quality Depth Recovery Via Interactive Multi-view Stereo

Real-time High-accuracy Three-Dimensional Reconstruction with Consumer RGB-D Cameras

Probabilistic RGB-D odometry based on points, lines and planes under depth uncertainty

Noise-Resilient Reconstruction of Panoramas and 3D Scenes Using Robot-Mounted Unsynchronized Commodity RGB-D Cameras

Visual Odometry Based 3D-Reconstruction

Probabilistic Multi-View Fusion of Active Stereo Depth Maps for Robotic Bin-Picking

RGB-Fusion: Monocular 3D reconstruction with learned depth prediction

Improving RealSense by Fusing Color Stereo Vision and Infrared Stereo Vision for the Visually Impaired

Multi-view Monocular Depth and Uncertainty Prediction with Deep SfM in Dynamic Environments

Multi-view 3D Object Reconstruction and Uncertainty Modelling with Neural Shape Prior

Geometric Integration of Hybrid Correspondences for RGB-D Unidirectional Tracking

Visual-Inertial RGB-D SLAM with Encoder Integration of ORB Triangulation and Depth Measurement Uncertainties

Active Perception with A Monocular Camera for Multiscopic Vision

Uncertainty-Aware Visual-Inertial SLAM with Volumetric Occupancy Mapping

Success Probability in Multi-View Imaging

Robust Depth-Aided RGBD-Inertial Odometry for Indoor Localization