Abstract:In response to the challenge that traditional visual simultaneous localization and mapping (SLAM) systems, based on the assumption of a static environment, struggle to achieve real-time indoor 3D reconstruction in complex dynamic scenes, this paper proposes a real-time indoor 3D reconstruction algorithm based on semantic visual SLAM. By leveraging object detection to obtain 2D semantic information and providing prior information for geometric methods, the fusion of the two effectively suppresses dynamic features, reduces reliance on deep learning methods, and ensures the algorithm's real-time performance. Experimental results on dynamic scenes in the TUM RGB-D dataset show that our algorithm maintains nearly unchanged real-time performance while achieving an average performance improvement of approximately 97.56% and 97.31% on the TUM dataset and Bonn dataset, respectively, compared to the ORB-SLAM2 system. Moreover, our algorithm can reconstruct more intuitive indoor global Octo-map and semantic metric maps compared to sparse point cloud maps, effectively enhancing the scene perception capability of mobile robots and laying the foundation for performing advanced tasks. Furthermore, our algorithm demonstrates a 3.5-10.5 times improvement in real-time performance compared to other mainstream semantic SLAM systems. Experimental results on the NVIDIA Jetson AGX Xavier confirm that our algorithm can run in real time on low-power platforms such as mobile robots or drones. However, the drawbacks of our algorithm include lower reconstruction accuracy in low-texture and large-scale scenes and ineffective suppression of dynamic features in low-dynamic scenes. Future work will consider replacing and improving deep learning methods and integrating IMU and other sensors to enhance system usability.

Realtime 3D reconstruction algorithm based on improved AKAZE and multi-layer feature detection network

Two-Stage Multi-Camera Constrain Mapping Pipeline for Large-Scale 3D Reconstruction

Local Optimized and Scalable Frame-to-model SLAM

Optimization RGB-D 3-D Reconstruction Algorithm Based on Dynamic SLAM

Research on Indoor 3D Reconstruction Technology Based on Semantic Visual Simultaneous Localization and Mapping

Visual Odometry Based 3D-Reconstruction

Real-Time LiDAR–Inertial Simultaneous Localization and Mesh Reconstruction

A Dynamic Object Removing 3D Reconstruction System Based on Multi-Sensor Fusion

Probabilistic Projective Association and Semantic Guided Relocalization for Dense Reconstruction

A dense RGB-D SLAM algorithm based on convolutional neural network of multi-layer image invariant feature

Dynamic SLAM: A Visual SLAM in Outdoor Dynamic Scenes

A 3D LiDAR-Inertial Tightly-Coupled SLAM for Mobile Robots on Indoor Environment

Improving SLAM Techniques with Integrated Multi-Sensor Fusion for 3D Reconstruction

3D Reconstruction of Indoor Scenes Based on Feature and Graph Optimization

An Efficient Dense Reconstruction Algorithm from LiDAR and Monocular Camera

FD-SLAM: 3-D Reconstruction Using Features and Dense Matching

3D Reconstruction of Indoor Scenes Via Image Registration

Real-Time SLAM Based on Dynamic Feature Point Elimination in Dynamic Environment

An improved multi-object classification algorithm for visual SLAM under dynamic environment

Real-time 3D mapping using a 2D laser scanner and IMU-aided visual SLAM