Abstract:There has been a growing interest in the research of semantic labeling on scenes represented by 3D point clouds. A fundamental issue that has been largely ignored is the unavoidable presence of unknown objects and the lack of effective ways of dealing with them. Traditional methods usually label unknown objects as one of the pre-trained classes which is either a meaningful target class or a defined unknown class that collectively refers to all uninterested objects. Due to the fact that the class of unknown in essence is a collection of many unseen or uninterested classes, in which the in-class variation is significant and less manageable. It is challenging to solve the unknown problem in a pre-trained manner. In order to advance the research on semantic labeling with the presence of unknown objects, this study investigates the feasibility of adopting an open-set approach, i.e. train a model without unknown objects and reject them accurately in the test. In this paper, we propose a method that exploits the conflict of different labeling results in order to withstand the negative effect of unknown objects. The proposed framework relies on a Conditional Random Field (CRF) to capture inherent spatial relationships and appearance similarities between objects, and employs a Probability of Inclusion Support Vector Machine (PISVM) to estimate an unknown likelihood for each training class. The probabilistic outputs from both CRF and PISVM are then proposed to be combined under the Dempster Shafer theory for conflict measurement and unknown rejection. The novelty lies in that the method encodes both contextual constrains and unknown likelihood for performance enhancement. Comprehensive experimental results on publicly available data sets are presented to show the negative effects of unknown objects and the improvements on labeling accuracy achieved by the proposed method.

A Semantic Labeling Strategy to Reject Unknown Objects in Large Scale 3d Point Clouds

Towards Open-Set Semantic Labeling in 3D Point Clouds : Analysis on the Unknown Class.

From Virtuality To Reality: A Learning-based Point Cloud Labeling Method With Synthesis Scene

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

Exploiting Label Uncertainty for Enhanced 3D Object Detection From Point Clouds

Geometry and Uncertainty-Aware 3D Point Cloud Class-Incremental Semantic Segmentation

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

Semi-Supervised Mesh Segmentation and Labeling

Dual-level Adaptive Self-Labeling for Novel Class Discovery in Point Cloud Segmentation

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Investigate Indistinguishable Points in Semantic Segmentation of 3D Point Cloud

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

A Semantic-Based Loop Closure Detection of 3D Point Cloud

Improving Deep Learning based Point Cloud Classification using Markov Random Fields with Quadratic Pseudo-Boolean Optimization

Detection and Segmentation of Unlearned Objects in Unknown Environment

PDF: A Probability-Driven Framework for Open World 3D Point Cloud Semantic Segmentation

Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning

Understanding the Imperfection of 3D point Cloud and Semantic Segmentation algorithms for 3D Models of Indoor Environment

Visual Boundary-Guided Pseudo-Labeling for Weakly Supervised 3D Point Cloud Segmentation in Indoor Environments

Contextually Guided Semantic Labeling and Search for 3D Point Clouds

Learning Semantic Segmentation on Unlabeled Real-World Indoor Point Clouds via Synthetic Data