Abstract:In response to the challenge that traditional visual simultaneous localization and mapping (SLAM) systems, based on the assumption of a static environment, struggle to achieve real-time indoor 3D reconstruction in complex dynamic scenes, this paper proposes a real-time indoor 3D reconstruction algorithm based on semantic visual SLAM. By leveraging object detection to obtain 2D semantic information and providing prior information for geometric methods, the fusion of the two effectively suppresses dynamic features, reduces reliance on deep learning methods, and ensures the algorithm's real-time performance. Experimental results on dynamic scenes in the TUM RGB-D dataset show that our algorithm maintains nearly unchanged real-time performance while achieving an average performance improvement of approximately 97.56% and 97.31% on the TUM dataset and Bonn dataset, respectively, compared to the ORB-SLAM2 system. Moreover, our algorithm can reconstruct more intuitive indoor global Octo-map and semantic metric maps compared to sparse point cloud maps, effectively enhancing the scene perception capability of mobile robots and laying the foundation for performing advanced tasks. Furthermore, our algorithm demonstrates a 3.5-10.5 times improvement in real-time performance compared to other mainstream semantic SLAM systems. Experimental results on the NVIDIA Jetson AGX Xavier confirm that our algorithm can run in real time on low-power platforms such as mobile robots or drones. However, the drawbacks of our algorithm include lower reconstruction accuracy in low-texture and large-scale scenes and ineffective suppression of dynamic features in low-dynamic scenes. Future work will consider replacing and improving deep learning methods and integrating IMU and other sensors to enhance system usability.

Automatic Structural Mapping And Semantic Optimization From Indoor Point Clouds

Object-aware Semantic Mapping of Indoor Scenes Using Octomap

Robust Indoor Localization and Map Matching Algorithm with Visual SLAM

Cooperative indoor 3D mapping and modeling using LiDAR data

Map building for indoor environment with laser range scanner

Semantic-aware Room-Level Indoor Modeling from Point Clouds

A New Framework for Generating Indoor 3D Digital Models from Point Clouds

3D Reconstruction Approach for Outdoor Scene Based on Multiple Point Cloud Fusion

A point-line-plane primitives fused localization and object-oriented semantic mapping in structural indoor scenes

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

Automatic Reconstruction of Multi-Level Indoor Spaces from Point Cloud and Trajectory

A Simple and Efficient Registration of 3D Point Cloud and Image Data for Indoor Mobile Mapping System

Semantic decomposition and reconstruction of residential scenes from LiDAR data

A LASER-SLAM ALGORITHM FOR INDOOR MOBILE MAPPING

A 3D LiDAR-Inertial Tightly-Coupled SLAM for Mobile Robots on Indoor Environment

SEMANTIC SEGMENTATION OF INDOOR 3D POINT CLOUDS BY JOINT OPTIMIZATION OF GEOMETRIC FEATURES AND NEURAL NETWORKS

A Specialized Pipeline for Efficient and Reliable 3D Semantic Model Reconstruction of Buildings from Indoor Point Clouds

Research on Indoor 3D Reconstruction Technology Based on Semantic Visual Simultaneous Localization and Mapping

Three-Dimensional Structure Measurement And Optimization Method Of Indoor Scene Based On Single Image

Semantic line framework-based indoor building modeling using backpacked laser scanning point cloud