Abstract:Large volumes of 3D parametric datasets, such as building information modeling (BIM), are the foundation for developing and applying smart city and digital twin technologies. Those datasets are also considered valuable tools for efficiently managing rebuilt structures during the operation and maintenance stages. Nevertheless, current approaches developed for the scan-to-BIM process rely on manual or semi-automatic procedures and insufficiently leverage semantic data in point clouds. These methods struggle to accurately represent large-scale indoor complex layouts and extract details from irregular-shaped unstructured elements, causing inefficiencies in BIM model generation. To address these issues, we propose an innovative scan-to-BIM framework based on deep learning algorithms and raw point cloud data, enabling the automatic generation of 3D models for both structured and unstructured indoor elements. Initially, we propose an enhanced deep learning neural network to improve the point clouds' semantic segmentation accuracy. Subsequently, an efficient workflow is developed to reconstruct 3D building models of structured indoor scenes. The proposed workflow can reconstruct large-scale data with multiple room layouts of Manhattan or non-Manhattan structures and reconstruct 3D models automatically by using a BIM parametric algorithm implemented in Revit software. Moreover, we introduce a robust method for unstructured elements to automatically generate corresponding 3D BIM models, even when the incorporating semantic information is incomplete. The proposed approach was evaluated on synthetic and real data for different scales and complexities of indoor scenes. The results of the experiments demonstrate that the improved model significantly enhances the overall semantic segmentation accuracy compared to the baseline models. The proposed scan-to-BIM framework is efficient for indoor element 3D reconstruction, achieving precision, recall, and F-score values ranging from 96% to 99%. The generated BIM models are competitive with traditional methods regarding model completeness and geometric accuracy.

Layout modelling of the built environment for autonomous mobile robots using Building Information Modelling (BIM) and simulation

Semantic Navigation Using Building Information on Construction Sites

BIM-Integrated Collaborative Robotics for Application in Building Construction and Maintenance

BIM-based simulation of construction robotics in the assembly process of wood frames

Building Construction Operation Simulation Based on BIM Technology and Intelligent Robots

BIM-assisted object recognition for the on-site autonomous robotic assembly of discrete structures

A Bim-Based Approach for Automated Tower Crane Layout Planning

Integration of 4D BIM and Robot Task Planning: Creation and Flow of Construction-Related Information for Action-Level Simulation of Indoor Wall Frame Installation

Semantic enrichment of BIM with IndoorGML for quadruped robot navigation and automated 3D scanning

Game Simulation to Support Construction Automation in Modular Construction Using BIM and Robotics Technology—Stage I

An ontology-based approach to data exchanges for robot navigation on construction sites

Automated BIM generation for large-scale indoor complex environments based on deep learning

BIM-based Safe and Trustworthy Robot Pathfinding using Scalable MHA* Algorithms and Natural Language Processing

Robot-Assisted Object Detection for Construction Automation: Data and Information-Driven Approach

Enabling Building Information Model-Driven Human-Robot Collaborative Construction Workflows with Closed-Loop Digital Twins

Exploration of Indoor Barrier-Free Plane Intelligent Lofting System Combining BIM and Multi-Sensors

Object-Aware View Planning for Autonomous 3-D Model Reconstruction of Buildings Using a Mobile Robot

Compact rover surveying and laser scanning for BIM development

On-demand monitoring of construction projects through a game-like hybrid application of BIM and machine learning

Towards fully BIM-enabled building automation and robotics: A perspective of lifecycle information flow

Toward Automated Virtual Assembly for Prefabricated Construction: Construction Sequencing through Simulated BIM