Abstract:Large volumes of 3D parametric datasets, such as building information modeling (BIM), are the foundation for developing and applying smart city and digital twin technologies. Those datasets are also considered valuable tools for efficiently managing rebuilt structures during the operation and maintenance stages. Nevertheless, current approaches developed for the scan-to-BIM process rely on manual or semi-automatic procedures and insufficiently leverage semantic data in point clouds. These methods struggle to accurately represent large-scale indoor complex layouts and extract details from irregular-shaped unstructured elements, causing inefficiencies in BIM model generation. To address these issues, we propose an innovative scan-to-BIM framework based on deep learning algorithms and raw point cloud data, enabling the automatic generation of 3D models for both structured and unstructured indoor elements. Initially, we propose an enhanced deep learning neural network to improve the point clouds' semantic segmentation accuracy. Subsequently, an efficient workflow is developed to reconstruct 3D building models of structured indoor scenes. The proposed workflow can reconstruct large-scale data with multiple room layouts of Manhattan or non-Manhattan structures and reconstruct 3D models automatically by using a BIM parametric algorithm implemented in Revit software. Moreover, we introduce a robust method for unstructured elements to automatically generate corresponding 3D BIM models, even when the incorporating semantic information is incomplete. The proposed approach was evaluated on synthetic and real data for different scales and complexities of indoor scenes. The results of the experiments demonstrate that the improved model significantly enhances the overall semantic segmentation accuracy compared to the baseline models. The proposed scan-to-BIM framework is efficient for indoor element 3D reconstruction, achieving precision, recall, and F-score values ranging from 96% to 99%. The generated BIM models are competitive with traditional methods regarding model completeness and geometric accuracy.

Synthetic data generation using building information models

Synthetic Datasets for Rebar Instance Segmentation Using Mask R-CNN

A Multi-Scenario Crowd Data Synthesis Based on Building Information Modeling

BIM Hyperreality: Data Synthesis Using BIM and Hyperrealistic Rendering for Deep Learning

Synthetic Image Data for Deep Learning

Towards Automatic Generation of As-Built BIM: 3D Building Facade Modeling and Material Recognition from Images

Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networks

Synthetic 3D Data Generation Pipeline for Geometric Deep Learning in Architecture

Automated BIM generation for large-scale indoor complex environments based on deep learning

Training a convolutional neural network for transportation sign detection using synthetic dataset

Indoor synthetic data generation: A systematic review

Synthetic Data Generation for Bridging Sim2Real Gap in a Production Environment

Generating synthetic photogrammetric data for training deep learning based 3D point cloud segmentation models

Enhancing point cloud semantic segmentation in the data‐scarce domain of industrial plants through synthetic data

Image Translation Based Synthetic Data Generation for Industrial Object Detection and Pose Estimation.

Development of large-scale synthetic 3D point cloud datasets for vision-based bridge structural condition assessment

FreeMask: Synthetic Images with Dense Annotations Make Stronger Segmentation Models

Efficient Realistic Data Generation Framework leveraging Deep Learning-based Human Digitization

Hybrid Data Augmentation for Enhanced Crack Detection in Building Construction

Improving synthetic 3D model-aided indoor image localization via domain adaptation

Robust Disaster Assessment from Aerial Imagery Using Text-to-Image Synthetic Data