Abstract:Large volumes of 3D parametric datasets, such as building information modeling (BIM), are the foundation for developing and applying smart city and digital twin technologies. Those datasets are also considered valuable tools for efficiently managing rebuilt structures during the operation and maintenance stages. Nevertheless, current approaches developed for the scan-to-BIM process rely on manual or semi-automatic procedures and insufficiently leverage semantic data in point clouds. These methods struggle to accurately represent large-scale indoor complex layouts and extract details from irregular-shaped unstructured elements, causing inefficiencies in BIM model generation. To address these issues, we propose an innovative scan-to-BIM framework based on deep learning algorithms and raw point cloud data, enabling the automatic generation of 3D models for both structured and unstructured indoor elements. Initially, we propose an enhanced deep learning neural network to improve the point clouds' semantic segmentation accuracy. Subsequently, an efficient workflow is developed to reconstruct 3D building models of structured indoor scenes. The proposed workflow can reconstruct large-scale data with multiple room layouts of Manhattan or non-Manhattan structures and reconstruct 3D models automatically by using a BIM parametric algorithm implemented in Revit software. Moreover, we introduce a robust method for unstructured elements to automatically generate corresponding 3D BIM models, even when the incorporating semantic information is incomplete. The proposed approach was evaluated on synthetic and real data for different scales and complexities of indoor scenes. The results of the experiments demonstrate that the improved model significantly enhances the overall semantic segmentation accuracy compared to the baseline models. The proposed scan-to-BIM framework is efficient for indoor element 3D reconstruction, achieving precision, recall, and F-score values ranging from 96% to 99%. The generated BIM models are competitive with traditional methods regarding model completeness and geometric accuracy.

Automatic Fine-Grained BIM element classification using Multi-Modal deep learning (MMDL)

Classification of Building Information Model (BIM) Structures with Deep Learning

A geometric deep learning approach for checking element-to-entity mappings in infrastructure building information models

A Geometric-Relational Deep Learning Framework for BIM Object Classification

Automated Building Information Modeling Compliance Check Through a Large Language Model Combined with Deep Learning and Ontology

Automated BIM generation for large-scale indoor complex environments based on deep learning

Building Information Modeling-Based Integration of MEP Layout Designs and Constructability

Building Information Modeling and Classification by Visual Learning At A City Scale

Research on Full-Element and Multi-Time-Scale Modeling Method of BIM for Lean Construction

Matching Real-World Facilities to Building Information Modeling Data Using Natural Language Processing

A Generalized LLM-Augmented BIM Framework: Application to a Speech-to-BIM system

Vision-assisted BIM reconstruction from 3D LiDAR point clouds for MEP scenes

A Hybrid Approach to Semi-Automatic Conversion of 3D Point Cloud Data to Building Information Model

More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification

Single-Stage Broad Multi-Instance Multi-Label Learning (BMIML) with Diverse Inter-Correlations and its application to medical image classification

Leveraging Deep Learning for Automated Reconstruction of Indoor Unstructured Elements in Scan-to-BIM

Deep-Learning-Based Automated Building Information Modeling Reconstruction Using Orthophotos with Digital Surface Models

Deep Learning Approach to Point Cloud Scene Understanding for Automated Scan to 3D Reconstruction

Reconstructing BIM from 2D Structural Drawings for Existing Buildings

BIM-based 3D Multimodal Reconstruction for Substation Equipment Inspection Images

AutoM3L: An Automated Multimodal Machine Learning Framework with Large Language Models