Abstract:The creation of building information models requires acquiring real building conditions. The generation of a three-dimensional (3D) model from 3D point clouds involves classification, outline extraction, and boundary regularization for semantic segmentation. The number of 3D point clouds generated using close-range images is smaller and tends to be unevenly distributed, which is not conducive to automated modeling processing. In this paper, we propose an efficient solution for the semantic segmentation of indoor point clouds from close-range images. A 3D deep learning framework that achieves better results is further proposed. A dynamic graph convolutional neural network (DGCNN) 3D deep learning method is used in this study. This method was selected to learn point cloud semantic features. Moreover, more efficient operations can be designed to build a module for extracting point cloud features such that the problem of inadequate beam and column classification can be resolved. First, DGCNN is applied to learn and classify the indoor point cloud into five categories: columns, beams, walls, floors, and ceilings. Then, the proposed semantic segmentation and modeling method is utilized to obtain the geometric parameters of each object to be integrated into building information modeling software. The experimental results show that the overall accuracy rates of the three experimental sections of Area_1 in the Stanford 3D semantic dataset test results are 86.9%, 97.4%, and 92.5%. The segmentation accuracy of corridor 2F in a civil engineering building is 94.2%. In comparing the length with the actual on-site measurement, the root mean square error is found to be ±0.03 m. The proposed method is demonstrated to be capable of automatic semantic segmentation from 3D point clouds with indoor close-range images.

Learning Semantic Segmentation on Unlabeled Real-World Indoor Point Clouds via Synthetic Data

Learning Indoor Point Cloud Semantic Segmentation from Image-Level Labels

A Semantic Labeling Strategy to Reject Unknown Objects in Large Scale 3d Point Clouds

Data-efficient 3D instance segmentation by transferring knowledge from synthetic scans

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

A Deep Learning Network for Semantic Labeling of Large-Scale Urban Point Clouds

A Point-Based Deep Learning Network for Semantic Segmentation of MLS Point Clouds

Learning Semantic Segmentation from Synthetic Data: A Geometrically Guided Input-Output Adaptation Approach

Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning

Unsupervised Urban Scene Segmentation Via Domain Adaptation

SEMANTIC SEGMENTATION OF INDOOR 3D POINT CLOUDS BY JOINT OPTIMIZATION OF GEOMETRIC FEATURES AND NEURAL NETWORKS

Unsupervised Domain Adaptive Point Cloud Semantic Segmentation.

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

Not All Areas Are Equal: Transfer Learning for Semantic Segmentation via Hierarchical Region Selection

Semantic Segmentation of Airborne LiDAR Point Clouds With Noisy Labels

Urban scene semantic segmentation with insufficient labeled data

Adaptive Semantic Segmentation with a Strategic Curriculum of Proxy Labels

Cross-modal and Cross-domain Knowledge Transfer for Label-free 3D Segmentation

Weakly Supervised Point Cloud Segmentation Via Deep Morphological Semantic Information Embedding

Box2Seg: Learning Semantics of 3D Point Clouds with Box-Level Supervision