Abstract:Urban scene-level 3D point cloud labeling is a very laborious and expensive task compared to images. Conversely however, image processing techniques, deep learning or otherwise are more established and mature. Thus, in a multi-source data environment, the labeling of a point cloud scene via an automated image process as an initial step, followed by a manual human verification process is an effective way to save man hours and cost. With the above as the goal, this study presents a simple but robust spatio-spectral feature representation approach. In this approach, a class-aware band selection and reduction (CBSR) technique is developed for optimal hyperspectral feature representation. A double-branched convolutional Gaussian Bernoulli deep belief network (CGBDBN) is then used for hierarchical spatial feature extraction from LiDAR-derived data and the CBSR data. Using stacked ensemble learning, spatio-spectral features are generated from the two feature streams via a fusion rule and then classified — the results of which are used in labeling a raw 3D LiDAR point cloud through projection. To evaluate this study, extensive experiments were conducted on the IEEE 2018 Houston dataset — the only publicly available dataset with both hyperspectral image (HSI) and 3D point cloud covering the same area — for urban scene classification. The results indicate that the developed CBSR attained comparatively competitive results with state-of-the-art approaches, thus making it a robust spectral feature representation technique. Also, the weight-sharing property, probabilistic modeling, and hierarchical nature of CGBDBN gives our approach the ability to capture high-level contextual features. Furthermore, compared to the spatial- or spectral-only features, the generated spatio-spectral features are more discriminative and significantly aided in improving the proposed model's efficacy. Overall, the proposed approach, based on the evaluation metrics, is a robust and effective approach for both coarse- and fine-grained raw LiDAR point cloud labeling tasks.

From Virtuality To Reality: A Learning-based Point Cloud Labeling Method With Synthesis Scene

Towards Open-Set Semantic Labeling in 3D Point Clouds : Analysis on the Unknown Class.

Classification of LiDAR Point Clouds Using Supervoxel-Based Detrended Feature and Perception-Weighted Graphical Model.

A Semantic Labeling Strategy to Reject Unknown Objects in Large Scale 3d Point Clouds

A Survey of Label-Efficient Deep Learning for 3D Point Clouds

A LiDAR Point Cloud Generator: from a Virtual World to Autonomous Driving

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

A Three-Step Approach for TLS Point Cloud Classification.

Parallel Point Clouds: Hybrid Point Cloud Generation and 3D Model Enhancement via Virtual–Real Integration

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

Hyperspectral image-aided LiDAR point cloud labeling via spatio-spectral feature representation learning

Label Propagation from ImageNet to 3D Point Clouds

Multi-View Features Joint Learning with Label and Local Distribution Consistency for Point Cloud Classification

A supervoxel-based spectro-spatial approach for 3D urban point cloud labelling

Quasi-Balanced Self-Training on Noise-Aware Synthesis of Object Point Clouds for Closing Domain Gap

Point-Syn2Real: Semi-Supervised Synthetic-to-Real Cross-Domain Learning for Object Classification in 3D Point Clouds

High-fidelity LiDAR Simulation System Based on Real Pointcloud Features

Visual Boundary-Guided Pseudo-Labeling for Weakly Supervised 3D Point Cloud Segmentation in Indoor Environments

Label Name is Mantra: Unifying Point Cloud Segmentation across Heterogeneous Datasets

3D Point Cloud Labeling Tool for Driving Automatically

PCGen: Point Cloud Generator for LiDAR Simulation