Abstract:Abstract. Achieving automatic 3D reconstruction for indoor scenes is extremely useful in the field of scene understanding. Building information modeling (BIM) models are essential for lowering project costs, assisting in building planning and renovations, as well as improving building management efficiency. However, nearly all current available scan-to-BIM approaches employ manual or semi-automatic methods. These approaches concentrate solely on significant structured objects, neglecting other unstructured elements such as furniture. The limitation arises from challenges in modeling incomplete point clouds of obstructed objects and capturing indoor scene details. Therefore, this research introduces an innovative and effective reconstruction framework based on deep learning semantic segmentation and model-driven techniques to address these limitations. The proposed framework utilizes wall segment recognition, feature extraction, opening detection, and automatic modeling to reconstruct 3D structured models of point clouds with different room layouts in both Manhattan and non-Manhattan architectures. Moreover, it provides 3D BIM models of actual unstructured elements by detecting objects, completing point clouds, establishing bounding boxes, determining type and orientation, and automatically generating 3D BIM models with a parametric algorithm implemented into the Revit software. We evaluated this framework using publicly available and locally generated point cloud datasets with varying furniture combinations and layout complexity. The results demonstrate the proposed framework's efficiency in reconstructing structured indoor elements, exhibiting completeness and geometric accuracy, and achieving precision and recall values greater than 98%. Furthermore, the generated unstructured 3D BIM models keep essential real-scene characteristics such as geometry, spatial locations, numerical aspects, various shapes, and orientations compared to literature methods.

Deep Learning-Based Classification and Reconstruction of Residential Scenes From Large-Scale Point Clouds.

Large-scale urban point cloud labeling and reconstruction

Deep Learning Guided Building Reconstruction from Satellite Imagery-derived Point Clouds

Deep Learning Approach to Point Cloud Scene Understanding for Automated Scan to 3D Reconstruction

Semantic decomposition and reconstruction of residential scenes from LiDAR data

City3D: Large-Scale Building Reconstruction from Airborne LiDAR Point Clouds

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Automatic 3D Building Reconstruction from Multi-View Aerial Images with Deep Learning

A Three-Step Approach for TLS Point Cloud Classification.

Efficient 3D reconstruction for urban scenes

3D Virtual Urban Scene Reconstruction from a Single Optical Remote Sensing Image.

Urban Building Reconstruction from Raw LiDAR Point Data

DEEP LEARNING FOR 3D BUILDING RECONSTRUCTION: A REVIEW

Scene Understanding in a Large Dynamic Environment Through a Laser-Based Sensing.

A Graph-Based Approach for 3D Building Model Reconstruction from Airborne LiDAR Point Clouds.

An Automated 3D Approach for Buildings Reconstruction from Airborne Laser Scanning Data

Automatic 3-D Reconstruction of Indoor Environment with Mobile Laser Scanning Point Clouds

3D Residential Reconstruction from a Single Indoor Floor Plan.

3D Building Roof Reconstruction from Airborne LiDAR Point Clouds: a Framework Based on a Spatial Database

Leveraging Deep Learning for Automated Reconstruction of Indoor Unstructured Elements in Scan-to-BIM

Deep-Learning-Based Classification for DTM Extraction from ALS Point Cloud