Abstract:Most of the existing RGB-D simultaneous localization and mapping (SLAM) systems are based on point features or point-line features or point-plane features. However, the existing multi-feature fusion SLAM methods based on the filter framework are not accurate and robust. And the fusion methods based on the optimization framework process different kinds of features separately and integrate them loosely. In the optimization-based framework, how to tightly fuse various kinds of features for achieving more accurate and robust pose estima-tion has been rarely considered. In this paper, we propose a unified point-line-plane fusion RGB-D visual SLAM method for navigation of mobile robots in structured environments, making full use of the information of three kinds of geometric features. Specifically, it extracts point, line, and plane features using images captured by the RGB-D camera and expresses them in a uniform way. Then, a mutual association scheme is designed for data association of point, line and plane features, which not only considers the correspondence of homogeneous features, i.e., point-point, line-line and plane-plane pairs, but also includes the association of heterogeneous features, i.e., point-line, point-plane and line-plane pairs. Afterwards, the matching errors between homoge-neous features and the association errors between heterogeneous features are uniformly represented and jointly optimized to estimate the camera pose and feature parameters for accurate and consistent localization and map building. It is worth pointing out that the proposed unified framework contains two levels. From the system framework perspective, all the main components of the SLAM system, i.e., feature representation, feature as-sociation and error function are handled in a unified manner, which increases the accuracy and compactness of the multi-feature SLAM system. From the feature processing perspective, both homogeneous features and het-erogeneous features are uniformly used, which provides more spatial constraints on pose estimation. Finally, the accuracy and robustness of the proposed method are verified by experiment comparisons with state-of-the-art visual SLAM systems on public datasets and in real-world environments

Multi-Sensor Fusion SLAM Based on Fast Euclidean Clustering to Filter Dynamic Targets

Research on Multi-Sensor Fusion SLAM Algorithm Based on Outlier Rejection and Boundary Rendering

Fast Simultaneous Locating and Mapping Approach Based on Information Fusion from Multiple Sensor

Local Optimized and Scalable Frame-to-model SLAM

A Multi-Sensor Deep Fusion SLAM Algorithm Based on TSDF Map

Sensor Fusion SLAM: An Efficient and Robust SLAM system for Dynamic Environments

Detection-first Tightly-Coupled LiDAR-Visual-Inertial SLAM in Dynamic Environments

A Dynamic Object Removing 3D Reconstruction System Based on Multi-Sensor Fusion

LVI-Fusion: A Robust Lidar-Visual-Inertial SLAM Scheme

A Multi-Sensor Fusion Framework for Localization Using LiDAR, IMU and RGB-DCamera

An Enhanced Multi-Sensor Simultaneous Localization and Mapping (SLAM) Framework with Coarse-to-Fine Loop Closure Detection Based on a Tightly Coupled Error State Iterative Kalman Filter

MSF-SLAM: Multi-Sensor-Fusion-Based Simultaneous Localization and Mapping for Complex Dynamic Environments

Lvio-Fusion: A Self-adaptive Multi-sensor Fusion SLAM Framework Using Actor-critic Method

Fast, Robust, Accurate, Multi-Body Motion Aware SLAM

Simultaneous localization and mapping of mobile robots with multi-sensor fusion

A Multisensor Fusion With Automatic Vision–LiDAR Calibration Based on Factor Graph Joint Optimization for SLAM

Robust Multi-Sensor Fusion SLAM Based on Road Network and Reflectivity Enhancement

FAST-LIVO: Fast and Tightly-coupled Sparse-Direct LiDAR-Inertial-Visual Odometry

SLAM Algorithm Based on Heterogeneous Sensor Data Fusion

UPLP-SLAM: Unified point-line-plane feature fusion for RGB-D visual SLAM

Localization and Mapping Method Based on Multimodal Information Fusion and Deep Learning for Dynamic Object Removal