Abstract:There has been a growing interest in the research of semantic labeling on scenes represented by 3D point clouds. A fundamental issue that has been largely ignored is the unavoidable presence of unknown objects and the lack of effective ways of dealing with them. Traditional methods usually label unknown objects as one of the pre-trained classes which is either a meaningful target class or a defined unknown class that collectively refers to all uninterested objects. Due to the fact that the class of unknown in essence is a collection of many unseen or uninterested classes, in which the in-class variation is significant and less manageable. It is challenging to solve the unknown problem in a pre-trained manner. In order to advance the research on semantic labeling with the presence of unknown objects, this study investigates the feasibility of adopting an open-set approach, i.e. train a model without unknown objects and reject them accurately in the test. In this paper, we propose a method that exploits the conflict of different labeling results in order to withstand the negative effect of unknown objects. The proposed framework relies on a Conditional Random Field (CRF) to capture inherent spatial relationships and appearance similarities between objects, and employs a Probability of Inclusion Support Vector Machine (PISVM) to estimate an unknown likelihood for each training class. The probabilistic outputs from both CRF and PISVM are then proposed to be combined under the Dempster Shafer theory for conflict measurement and unknown rejection. The novelty lies in that the method encodes both contextual constrains and unknown likelihood for performance enhancement. Comprehensive experimental results on publicly available data sets are presented to show the negative effects of unknown objects and the improvements on labeling accuracy achieved by the proposed method.

A Deep Active Learning Framework for Semantic Labeling of Point Clouds

A Semantic Labeling Strategy to Reject Unknown Objects in Large Scale 3d Point Clouds

Towards Open-Set Semantic Labeling in 3D Point Clouds : Analysis on the Unknown Class.

PCL: Point Contrast and Labeling for Weakly Supervised Point Cloud Semantic Segmentation

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

A Survey of Label-Efficient Deep Learning for 3D Point Clouds

A Deep Learning Network for Semantic Labeling of Large-Scale Urban Point Clouds

Weakly Supervised Semantic Segmentation for Point Clouds with Self-Purification on Pseudo Labels

Active Learning for Point Cloud Semantic Segmentation Via Spatial-Structural Diversity Reasoning

A Multi-Granularity Semisupervised Active Learning for Point Cloud Semantic Segmentation

BSTS: A Weakly-Supervised Method for Semantic Learning of 3D Point Clouds

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

A Simple Framework of Few-Shot Learning Using Sparse Annotations for Semantic Segmentation of 3-D Point Clouds

Box2Seg: Learning Semantics of 3D Point Clouds with Box-Level Supervision

PointCluster: Deep Clustering of 3D Point Clouds with Semantic Pseudo-Labeling

PointCluster: Deep Clustering of 3-D Point Clouds With Semantic Pseudo-Labeling

WEAKLY SUPERVISED PSEUDO-LABEL ASSISTED LEARNING FOR ALS POINT CLOUD SEMANTIC SEGMENTATION

Weakly Supervised Point Cloud Segmentation Via Deep Morphological Semantic Information Embedding

HybridCR: Weakly-Supervised 3D Point Cloud Semantic Segmentation Via Hybrid Contrastive Regularization

Encoding Discriminative Representation for Point Cloud Semantic Segmentation

Higher-Order Conditional Random Fields-Based 3d Semantic Labeling Of Airborne Laser-Scanning Point Clouds