Abstract:When the existing visual SLAM (simultaneous localization and mapping) algorithms are applied to dynamic environments, the pose error estimated by the system often increases sharply, or even the algorithm fails due to the interference of dynamic objects. To adapt to dynamic scenes, a dynamic object processing part needs to be added to the system. However, some existing processing methods lead to reduced real-time performance, which is not conducive to the real-time localization and navigation of mobile robots. To solve the above problems, an RGB-D SLAM system is proposed in this paper for indoor dynamic environments. The system designs an adaptive semantic segmentation tracking algorithm to meet the requirements of localization accuracy and real-time performance in dynamic scenes. First, a lightweight semantic segmentation network is used to provide a priori information about the object. According to this prior information and the motion state of the object in the previous scene, each feature point is assigned a motion level and is classified as a static point, movable static point, or dynamic point. Then, whether the current frame needs semantic segmentation is adaptively determined according to the motion level information of the feature points. Some appropriate feature points (static points) are selected for initial pose estimation, and then, secondary optimization of the pose is performed according to the results of weighted static constraints. In order to verify the effectiveness of the proposed algorithm, experiments are carried out on the TUM RGB-D dynamic scene dataset and compared with ORB-SLAM2 and other SLAM algorithms for dynamic environments. The results show that the proposed algorithm performs well on most datasets, and the positioning accuracy in indoor dynamic environments can be improved by 90.57% compared with the ORB-SLAM2 algorithm. In addition, a 3D semantic map of static backgrounds in dynamic scenes has been established, using dense point cloud maps to visualize 3D scene information, and incorporating semantic information to label objects in the scene, to guide advanced tasks such as robot navigation and enhance the usability of the system.

Rgb-D Slam Based On Extended Bundle Adjustment With 2d And 3d Information

Robust Keyframe-based Dense SLAM with an RGB-D Camera.

A Submap Joining Algorithm for 3D Reconstruction Using an RGB-D Camera Based on Point and Plane Features

RGB‐D SLAM with Moving Object Tracking in Dynamic Environments

A Robust RGB-D SLAM System With Points and Lines for Low Texture Indoor Environments

Local Optimized and Scalable Frame-to-model SLAM

RGB-D SLAM in Dynamic Environments Using Point Correlations

Robust 3D Reconstruction with an RGB-D Camera

RGBDS-SLAM: A RGB-D Semantic Dense SLAM Based on 3D Multi Level Pyramid Gaussian Splatting

VIP-SLAM: An Efficient Tightly-Coupled RGB-D Visual Inertial Planar SLAM

EC-SLAM: Real-time Dense Neural RGB-D SLAM System with Effectively Constrained Global Bundle Adjustment.

Dynamic RGB-D SLAM Based on Static Probability and Observation Number

PL-GM:RGB-D SLAM With a Novel 2D and 3D Geometric Constraint Model of Point and Line Features

A SLAM System Based on RGBD Image and Point-Line Feature

Spatial structure comparison based RGB-D SLAM in dynamic environments

PG-SLAM: Photo-realistic and Geometry-aware RGB-D SLAM in Dynamic Environments

RGBiD-SLAM for Accurate Real-time Localisation and 3D Mapping

A dense RGB-D SLAM algorithm based on convolutional neural network of multi-layer image invariant feature

GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAM

An RGB-D SLAM algorithm based on adaptive semantic segmentation in dynamic environment

EC-SLAM: Effectively Constrained Neural RGB-D SLAM with Sparse TSDF Encoding and Global Bundle Adjustment