Abstract:There has been a growing interest in the research of semantic labeling on scenes represented by 3D point clouds. A fundamental issue that has been largely ignored is the unavoidable presence of unknown objects and the lack of effective ways of dealing with them. Traditional methods usually label unknown objects as one of the pre-trained classes which is either a meaningful target class or a defined unknown class that collectively refers to all uninterested objects. Due to the fact that the class of unknown in essence is a collection of many unseen or uninterested classes, in which the in-class variation is significant and less manageable. It is challenging to solve the unknown problem in a pre-trained manner. In order to advance the research on semantic labeling with the presence of unknown objects, this study investigates the feasibility of adopting an open-set approach, i.e. train a model without unknown objects and reject them accurately in the test. In this paper, we propose a method that exploits the conflict of different labeling results in order to withstand the negative effect of unknown objects. The proposed framework relies on a Conditional Random Field (CRF) to capture inherent spatial relationships and appearance similarities between objects, and employs a Probability of Inclusion Support Vector Machine (PISVM) to estimate an unknown likelihood for each training class. The probabilistic outputs from both CRF and PISVM are then proposed to be combined under the Dempster Shafer theory for conflict measurement and unknown rejection. The novelty lies in that the method encodes both contextual constrains and unknown likelihood for performance enhancement. Comprehensive experimental results on publicly available data sets are presented to show the negative effects of unknown objects and the improvements on labeling accuracy achieved by the proposed method.

Projective Analysis for 3D Shape Segmentation

Towards Open-Set Semantic Labeling in 3D Point Clouds : Analysis on the Unknown Class.

3x2: 3D Object Part Segmentation by 2D Semantic Correspondences

SEG-MAT: 3D Shape Segmentation Using Medial Axis Transform

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

Deep Projective 3D Semantic Segmentation

3D Shape Segmentation Based on Viewpoint Entropy and Projective Fully Convolutional Networks Fusing Multi-view Features

A Geometric Approach to Joint 2D Region-Based Segmentation and 3D Pose Estimation Using a 3D Shape Prior

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learning

iSeg3D: An Interactive 3D Shape Segmentation Tool

Semi-Supervised Co-Analysis of 3D Shape Styles from Projected Lines

Rethinking 3D LiDAR Point Cloud Segmentation

Segment3D: Learning Fine-Grained Class-Agnostic 3D Segmentation without Manual Labels

Weakly Supervised 3D Instance Segmentation without Instance-level Annotations

Leveraging Large-Scale Pretrained Vision Foundation Models for Label-Efficient 3D Point Cloud Segmentation

Unsupervised Co-Segmentation of 3D Shapes Via Affinity Aggregation Spectral Clustering.

Affinity3D: Propagating Instance-Level Semantic Affinity for Zero-Shot Point Cloud Semantic Segmentation

OccuSeg: Occupancy-Aware 3D Instance Segmentation

Detecting 3D Points of Interest Using Projective Neural Networks

3D shape representation, matching and recognition