Abstract:Large volumes of 3D parametric datasets, such as building information modeling (BIM), are the foundation for developing and applying smart city and digital twin technologies. Those datasets are also considered valuable tools for efficiently managing rebuilt structures during the operation and maintenance stages. Nevertheless, current approaches developed for the scan-to-BIM process rely on manual or semi-automatic procedures and insufficiently leverage semantic data in point clouds. These methods struggle to accurately represent large-scale indoor complex layouts and extract details from irregular-shaped unstructured elements, causing inefficiencies in BIM model generation. To address these issues, we propose an innovative scan-to-BIM framework based on deep learning algorithms and raw point cloud data, enabling the automatic generation of 3D models for both structured and unstructured indoor elements. Initially, we propose an enhanced deep learning neural network to improve the point clouds' semantic segmentation accuracy. Subsequently, an efficient workflow is developed to reconstruct 3D building models of structured indoor scenes. The proposed workflow can reconstruct large-scale data with multiple room layouts of Manhattan or non-Manhattan structures and reconstruct 3D models automatically by using a BIM parametric algorithm implemented in Revit software. Moreover, we introduce a robust method for unstructured elements to automatically generate corresponding 3D BIM models, even when the incorporating semantic information is incomplete. The proposed approach was evaluated on synthetic and real data for different scales and complexities of indoor scenes. The results of the experiments demonstrate that the improved model significantly enhances the overall semantic segmentation accuracy compared to the baseline models. The proposed scan-to-BIM framework is efficient for indoor element 3D reconstruction, achieving precision, recall, and F-score values ranging from 96% to 99%. The generated BIM models are competitive with traditional methods regarding model completeness and geometric accuracy.

ArrangementNet: Learning Scene Arrangements for Vectorized Indoor Scene Modeling

Semantic-aware Room-Level Indoor Modeling from Point Clouds

Neural Rendering in a Room: Amodal 3D Understanding and Free-Viewpoint Rendering for the Closed Scene Composed of Pre-Captured Objects

Automated BIM generation for large-scale indoor complex environments based on deep learning

Neural 3D Scene Reconstruction with Indoor Planar Priors

Object-aware Semantic Mapping of Indoor Scenes Using Octomap

DSGI‐Net: Density‐based Selective Grouping Point Cloud Learning Network for Indoor Scene

Non-autoregressive transformer with fine-grained optimization for user-specified indoor layout

A New Framework for Generating Indoor 3D Digital Models from Point Clouds

Neural 3D Scene Reconstruction with the Manhattan-world Assumption

LiDAR-Net: A Real-scanned 3D Point Cloud Dataset for Indoor Scenes

Leveraging Deep Learning for Automated Reconstruction of Indoor Unstructured Elements in Scan-to-BIM

Urban Scene LOD Vectorized Modeling From Photogrammetry Meshes

The Polygonal 3D Layout Reconstruction of an Indoor Environment via Voxel-Based Room Segmentation and Space Partition

Recognition of Indoor Scenes Using 3-D Scene Graphs

A Hybrid Semantic-Geometric Approach for Clutter-Resistant Floorplan Generation from Building Point Clouds

FloorNet: A Unified Framework for Floorplan Reconstruction from 3D Scans

A Single-Stream Adaptive Scene Layout Modeling Method for Scene Recognition

360 Layout Estimation via Orthogonal Planes Disentanglement and Multi-view Geometric Consistency Perception

Graph Neural Network for Generative Furniture Arrangement

Automatic Reconstruction of Multi-Level Indoor Spaces from Point Cloud and Trajectory