Abstract:There has been a growing interest in the research of semantic labeling on scenes represented by 3D point clouds. A fundamental issue that has been largely ignored is the unavoidable presence of unknown objects and the lack of effective ways of dealing with them. Traditional methods usually label unknown objects as one of the pre-trained classes which is either a meaningful target class or a defined unknown class that collectively refers to all uninterested objects. Due to the fact that the class of unknown in essence is a collection of many unseen or uninterested classes, in which the in-class variation is significant and less manageable. It is challenging to solve the unknown problem in a pre-trained manner. In order to advance the research on semantic labeling with the presence of unknown objects, this study investigates the feasibility of adopting an open-set approach, i.e. train a model without unknown objects and reject them accurately in the test. In this paper, we propose a method that exploits the conflict of different labeling results in order to withstand the negative effect of unknown objects. The proposed framework relies on a Conditional Random Field (CRF) to capture inherent spatial relationships and appearance similarities between objects, and employs a Probability of Inclusion Support Vector Machine (PISVM) to estimate an unknown likelihood for each training class. The probabilistic outputs from both CRF and PISVM are then proposed to be combined under the Dempster Shafer theory for conflict measurement and unknown rejection. The novelty lies in that the method encodes both contextual constrains and unknown likelihood for performance enhancement. Comprehensive experimental results on publicly available data sets are presented to show the negative effects of unknown objects and the improvements on labeling accuracy achieved by the proposed method.

Detection of Shapes in 2D Point Clouds Generated from Images

Detecting Shapes in 2 D Point Clouds Generated from Images

Detection, Classification and Estimation of Individual Shapes in 2d and 3d Point Clouds

A Fully Statistical Framework for Shape Detection in Image Primitives

Shape estimation from 3D point clouds

Towards Open-Set Semantic Labeling in 3D Point Clouds : Analysis on the Unknown Class.

Facial feature points detecting based on Gaussian Mixture Models

A Multilevel Point-Cluster-Based Discriminative Feature for Als Point Cloud Classification

SSN: Shape Signature Networks for Multi-class Object Detection from Point Clouds

3D Object Detection from Point Cloud via Voting Step Diffusion

Shape Prior Based Moving Object Detection

Information Geometric Framework For Point Cloud Data

An Integrated Framework for 3-D Modeling, Object Detection, and Pose Estimation from Point-Clouds

Unsupervised Detection of Distinctive Regions on 3D Shapes

A Shape Detection Framework for Deformation Objects Using Clustering Algorithms

Generic Primitive Detection in Point Clouds Using Novel Minimal Quadric Fits

Point Cloud Novelty Detection Based on Latent Representations of a General Feature Extractor

Zero-shot Point Cloud Completion Via 2D Priors

Object detection via structural feature selection and shape model

A Novel Feature Point Detection Algorithm of Unstructured 3D Point Cloud

Robust And Accurate Feature Detection on Point Clouds