Abstract:There has been a growing interest in the research of semantic labeling on scenes represented by 3D point clouds. A fundamental issue that has been largely ignored is the unavoidable presence of unknown objects and the lack of effective ways of dealing with them. Traditional methods usually label unknown objects as one of the pre-trained classes which is either a meaningful target class or a defined unknown class that collectively refers to all uninterested objects. Due to the fact that the class of unknown in essence is a collection of many unseen or uninterested classes, in which the in-class variation is significant and less manageable. It is challenging to solve the unknown problem in a pre-trained manner. In order to advance the research on semantic labeling with the presence of unknown objects, this study investigates the feasibility of adopting an open-set approach, i.e. train a model without unknown objects and reject them accurately in the test. In this paper, we propose a method that exploits the conflict of different labeling results in order to withstand the negative effect of unknown objects. The proposed framework relies on a Conditional Random Field (CRF) to capture inherent spatial relationships and appearance similarities between objects, and employs a Probability of Inclusion Support Vector Machine (PISVM) to estimate an unknown likelihood for each training class. The probabilistic outputs from both CRF and PISVM are then proposed to be combined under the Dempster Shafer theory for conflict measurement and unknown rejection. The novelty lies in that the method encodes both contextual constrains and unknown likelihood for performance enhancement. Comprehensive experimental results on publicly available data sets are presented to show the negative effects of unknown objects and the improvements on labeling accuracy achieved by the proposed method.

Start from minimum labeling: Learning of 3D object models and point labeling from a large and complex environment

From RGB-D Images to RGB Images

From RGB-D Images to RGB Images: Single Labeling for Mining Visual Models

Category Modeling from Just a Single Labeling: Use Depth Information to Guide the Learning of 2D Models

Unsupervised 3D category discovery and point labeling from a large urban environment

Towards Open-Set Semantic Labeling in 3D Point Clouds : Analysis on the Unknown Class.

Self-Supervised Global-Local Structure Modeling for Point Cloud Domain Adaptation with Reliable Voted Pseudo Labels

A Semantic Labeling Strategy to Reject Unknown Objects in Large Scale 3d Point Clouds

From Virtuality To Reality: A Learning-based Point Cloud Labeling Method With Synthesis Scene

Semi-Supervised Mesh Segmentation and Labeling

Learning Category-Specific 3d Shape Models From Weakly Labeled 2d Images

Leveraging Large-Scale Pretrained Vision Foundation Models for Label-Efficient 3D Point Cloud Segmentation

Active Exploration of Large 3D Model Repositories

Image Understands Point Cloud: Weakly Supervised 3D Semantic Segmentation via Association Learning

Towards A Weakly Supervised Framework for 3D Point Cloud Object Detection and Annotation

Weakly-Supervised Learning of Category-Specific 3D Object Shapes.

Few-Shot Meta-Learning on Point Cloud for Semantic Segmentation

Detection and Segmentation of Unlearned Objects in Unknown Environment

Unsupervised Joint 3D Object Model Learning and 6D Pose Estimation for Depth-Based Instance Segmentation.

Exploiting Label Uncertainty for Enhanced 3D Object Detection From Point Clouds

Learning to group and label fine-grained shape components