Abstract:The creation of building information models requires acquiring real building conditions. The generation of a three-dimensional (3D) model from 3D point clouds involves classification, outline extraction, and boundary regularization for semantic segmentation. The number of 3D point clouds generated using close-range images is smaller and tends to be unevenly distributed, which is not conducive to automated modeling processing. In this paper, we propose an efficient solution for the semantic segmentation of indoor point clouds from close-range images. A 3D deep learning framework that achieves better results is further proposed. A dynamic graph convolutional neural network (DGCNN) 3D deep learning method is used in this study. This method was selected to learn point cloud semantic features. Moreover, more efficient operations can be designed to build a module for extracting point cloud features such that the problem of inadequate beam and column classification can be resolved. First, DGCNN is applied to learn and classify the indoor point cloud into five categories: columns, beams, walls, floors, and ceilings. Then, the proposed semantic segmentation and modeling method is utilized to obtain the geometric parameters of each object to be integrated into building information modeling software. The experimental results show that the overall accuracy rates of the three experimental sections of Area_1 in the Stanford 3D semantic dataset test results are 86.9%, 97.4%, and 92.5%. The segmentation accuracy of corridor 2F in a civil engineering building is 94.2%. In comparing the length with the actual on-site measurement, the root mean square error is found to be ±0.03 m. The proposed method is demonstrated to be capable of automatic semantic segmentation from 3D point clouds with indoor close-range images.

Semantic surrounding projection for object height estimation using single-line lidar and image

Semantic Reconstruction based on RGB Image and Sparse Depth

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

Object-aware Semantic Mapping of Indoor Scenes Using Octomap

Semantic Mapping and Localization for Autonomous Indoor Parking Based on Human-readable Visual Landmark

Boosting Lidar 3D Object Detection with Point Cloud Semantic Segmentation

HeightFormer: A Semantic Alignment Monocular 3D Object Detection Method from Roadside Perspective

Approaching Outside: Scaling Unsupervised 3D Object Detection from 2D Scene

Cooperative indoor 3D mapping and modeling using LiDAR data

LISNeRF Mapping: LiDAR-based Implicit Mapping via Semantic Neural Fields for Large-Scale 3D Scenes

3D Scene Reconstruction with Sparse LiDAR Data and Monocular Image in Single Frame

Indoor Instance-Aware Semantic Mapping Using Instance Segmentation

Multi-Task Learning of Relative Height Estimation and Semantic Segmentation from Single Airborne RGB Images

Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning

Scene Understanding in a Large Dynamic Environment Through a Laser-Based Sensing.

Scan-based Semantic Segmentation of LiDAR Point Clouds: An Experimental Study

An Approach for Construct Semantic Map with Scene Classification and Object Semantic Segmentation

MS23D: A 3D object detection method using multi-scale semantic feature points to construct 3D feature layer

Monocular Indoor Depth Estimation Method Based on Neural Networks with Constraints on Two-Dimensional Images and Three-Dimensional Geometry

PanoNet3D: Combining Semantic and Geometric Understanding for LiDARPoint Cloud Detection

HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor