Abstract:In visual simultaneous localization and mapping (vSLAM) systems, the rigid assumption of the environment is usually overcome by introducing geometry-based or learning-based methods. However, these methods either rely heavily on depth information or tend to suffer from poor real-time performance. In this article, we present real-time vSLAM (RVD-SLAM), a real-time simultaneous localization and mapping (SLAM) in dynamic environments for red green blue-depth (RGB-D)/stereo/monocular sensors based on sparsely semantic segmentation and outlier prior. RVD-SLAM utilizes feature matching information, which does not rely on depth, to detect outliers and dynamic features. First, an affine consistency constraint is proposed and seamlessly integrated into the matching optimization of the system to efficiently detect outliers. Second, we skillfully combine affine information with the efficiently semantic model, which enables the reuse of previously obtained information, to detect dynamic objects. Finally, to adapt to slightly dynamic environments and reduce the computational cost, the ratio of outliers in the matching set is employed as prior information for sparsely using the semantic method. Moreover, an improved map update method considering dynamic features is designed to ensure the effectiveness of the map used for long-term tracking. The wide experiments on the public TUM and KITTI datasets demonstrate quantitatively that our method improves camera tracking compared to state-of-the-art (SOTA) methods and runs in real-time. To further evaluate RVD-SLAM's generalization capabilities and performance of dynamic object detection, we also test it in real dynamic scenarios by using handheld RGB-D and stereo cameras.

DIR-SLAM: Dynamic Interference Removal for Real-Time VSLAM in Dynamic Environments

Visual SLAM in dynamic environments based on object detection

Real-time motion removal based on point correlations for RGB-D SLAM in indoor dynamic environments

Accurate RGB-D SLAM in Dynamic Environments Based on Dynamic Visual Feature Removal

COEB-SLAM: A Robust VSLAM in Dynamic Environments Combined Object Detection, Epipolar Geometry Constraint, and Blur Filtering

DMOT-SLAM: Visual SLAM in Dynamic Environments with Moving Object Tracking

Visual SLAM for Dynamic Environments Based on Object Detection and Optical Flow for Dynamic Object Removal

Dynamic SLAM: A Visual SLAM in Outdoor Dynamic Scenes

SGC-VSLAM: A Semantic and Geometric Constraints VSLAM for Dynamic Indoor Environments

MISD-SLAM: Multimodal Semantic SLAM for Dynamic Environments

DGS-SLAM: A Fast and Robust RGBD SLAM in Dynamic Environments Combined by Geometric and Semantic Information

OVD-SLAM: An Online Visual SLAM for Dynamic Environments

A visual SLAM method assisted by IMU and deep learning in indoor dynamic blurred scenes

ESD-SLAM: An efficient semantic visual SLAM towards dynamic environments

Real-Time Visual-Inertial Localization Using Semantic Segmentation Towards Dynamic Environments

RVD-SLAM: A Real-Time Visual SLAM Toward Dynamic Environments Based on Sparsely Semantic Segmentation and Outlier Prior

Robust Stereo Visual SLAM for Dynamic Environments With Moving Object

DRV-SLAM: An Adaptive Real-Time Semantic Visual SLAM Based on Instance Segmentation Toward Dynamic Environments

Det-SLAM: A semantic visual SLAM for highly dynamic scenes using Detectron2

VSLAM method based on object detection in dynamic environments