Abstract:There has been a growing interest in the research of semantic labeling on scenes represented by 3D point clouds. A fundamental issue that has been largely ignored is the unavoidable presence of unknown objects and the lack of effective ways of dealing with them. Traditional methods usually label unknown objects as one of the pre-trained classes which is either a meaningful target class or a defined unknown class that collectively refers to all uninterested objects. Due to the fact that the class of unknown in essence is a collection of many unseen or uninterested classes, in which the in-class variation is significant and less manageable. It is challenging to solve the unknown problem in a pre-trained manner. In order to advance the research on semantic labeling with the presence of unknown objects, this study investigates the feasibility of adopting an open-set approach, i.e. train a model without unknown objects and reject them accurately in the test. In this paper, we propose a method that exploits the conflict of different labeling results in order to withstand the negative effect of unknown objects. The proposed framework relies on a Conditional Random Field (CRF) to capture inherent spatial relationships and appearance similarities between objects, and employs a Probability of Inclusion Support Vector Machine (PISVM) to estimate an unknown likelihood for each training class. The probabilistic outputs from both CRF and PISVM are then proposed to be combined under the Dempster Shafer theory for conflict measurement and unknown rejection. The novelty lies in that the method encodes both contextual constrains and unknown likelihood for performance enhancement. Comprehensive experimental results on publicly available data sets are presented to show the negative effects of unknown objects and the improvements on labeling accuracy achieved by the proposed method.

Detection Based Object Labeling of 3D Point Cloud for Indoor Scenes.

A Semantic Labeling Strategy to Reject Unknown Objects in Large Scale 3d Point Clouds

Towards Open-Set Semantic Labeling in 3D Point Clouds : Analysis on the Unknown Class.

Hybrid 3D Reconstruction of Indoor Scenes Integrating Object Recognition

Deep learning based 3D target detection for indoor scenes

Indoor Scene Recognition in 3D

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

Contextually Guided Semantic Labeling and Search for 3D Point Clouds

Efficient Indoor 3D Object Detection in Point Clouds Using the Kinect Sensor

Labeling 3D scenes for Personal Assistant Robots

Visual Boundary-Guided Pseudo-Labeling for Weakly Supervised 3D Point Cloud Segmentation in Indoor Environments

Indoor 3D Point Cloud Segmentation Based on Multi-Constraint Graph Clustering

Reinforcing Lidar-Based 3d Object Detection With Rgb And 3d Information

Frustum PointNets for 3D Object Detection from RGB-D Data

Indoor Scene Recognition from RGB-D Images by Learning Scene Bases

Automated Semantic Segmentation of Indoor Point Clouds from Close-Range Images with Three-Dimensional Deep Learning

Data-Driven Indoor Scene Modeling from a Single Color Image with Iterative Object Segmentation and Model Retrieval

3D Semantic Segmentation Algorithm for Indoor Scenes based on Long-term Memory

Refined Voting and Scene Feature Fusion for 3D Object Detection in Point Clouds

CONSTRUCTION OF A DUAL-TASK MODEL FOR INDOOR SCENE RECOGNITION AND SEMANTIC SEGMENTATION BASED ON POINT CLOUDS

Training an Open-Vocabulary Monocular 3D Object Detection Model without 3D Data