Abstract:There has been a growing interest in the research of semantic labeling on scenes represented by 3D point clouds. A fundamental issue that has been largely ignored is the unavoidable presence of unknown objects and the lack of effective ways of dealing with them. Traditional methods usually label unknown objects as one of the pre-trained classes which is either a meaningful target class or a defined unknown class that collectively refers to all uninterested objects. Due to the fact that the class of unknown in essence is a collection of many unseen or uninterested classes, in which the in-class variation is significant and less manageable. It is challenging to solve the unknown problem in a pre-trained manner. In order to advance the research on semantic labeling with the presence of unknown objects, this study investigates the feasibility of adopting an open-set approach, i.e. train a model without unknown objects and reject them accurately in the test. In this paper, we propose a method that exploits the conflict of different labeling results in order to withstand the negative effect of unknown objects. The proposed framework relies on a Conditional Random Field (CRF) to capture inherent spatial relationships and appearance similarities between objects, and employs a Probability of Inclusion Support Vector Machine (PISVM) to estimate an unknown likelihood for each training class. The probabilistic outputs from both CRF and PISVM are then proposed to be combined under the Dempster Shafer theory for conflict measurement and unknown rejection. The novelty lies in that the method encodes both contextual constrains and unknown likelihood for performance enhancement. Comprehensive experimental results on publicly available data sets are presented to show the negative effects of unknown objects and the improvements on labeling accuracy achieved by the proposed method.

Label Transfer Between Images And 3d Shapes Via Local Correspondence Encoding

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

A Cross-Dimension Annotations Method for 3D Structural Facial Landmark Extraction

Point Cloud Domain Adaptation Via Masked Local 3D Structure Prediction

Towards Open-Set Semantic Labeling in 3D Point Clouds : Analysis on the Unknown Class.

Semi-Supervised Mesh Segmentation and Labeling

Conditional Random Fields for Image Labeling

Learning to group and label fine-grained shape components

A New Image Labeling Method Based on Content-Based Image Retrieval and Conditional Random Field

Image labeling based on fully-connected conditional random field

Equivariant Local Reference Frames for Unsupervised Non-rigid Point Cloud Shape Correspondence

Conditional Random Fields for Image Region Labeling with Global Observation.

A new Laplacian mixture conditional random field model for image labeling

Cross-modal and Cross-domain Knowledge Transfer for Label-free 3D Segmentation

Learning Implicit Functions for Dense 3D Shape Correspondence of Generic Objects

Context-based conditional random fields as recurrent neural networks for image labeling

Transferring facade labels between point clouds with semantic octrees while considering change detection

Sparse Higher Order Conditional Random Fields for Improved Sequence Labeling.

Semi-supervised learning for image annotation based on conditional random fields

Panoptic NeRF: 3D-to-2d Label Transfer for Panoptic Urban Scene Segmentation