Abstract:In recent years, there has been a growing interest in the research of semantic labeling of indoor scenes represented by 3D point clouds. A fundamental problem that has largely been oversighted in the current research is the way of dealing with the unknown class which collectively includes all the objects that are of no interest to the application developer. In the training stage, these objects are either completely removed or labeled as unknown, resulting in a trained model which is not fully and fairly exposed to the actual sample space. In the test stage, the unknown objects are naturally present and provided to the classifier, causing a significant drop of the classification accuracy-usually 20%~30%. Simply improving the features or the classifier will not address the root cause problem. In this paper, we propose a labeling framework combining both Conditional Random Field (CRF) and P I -SVM to specifically solve the problem caused by the unknown class. First, we use a CRF to model the contextual relations in the 3D space, for which the parameters for both node potential and edge potential are learned from training data. Then, we make use of the rejection strategy of the P I -SVM, which estimates an unnormalized probability for each class. Finally, we reinforce the result of CRF with the belief provided by the P I -SVM, and the labeling result is based on the agreement of the two classifiers. The proposed method takes advantage of the global optimization of CRF and the advantage of unknown rejection of P I -SVM. Experimental results on publicly available data set show that this method has improved the classification accuracy by 10.7% given the accuracy drop of 19.23% caused by the unknown.

Contextual Modeling for Logical Labeling of PDF Documents

Logical Labeling of Fixed Layout PDF Documents Using Multiple Contexts

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Document Page Structure Learning For Fixed-Layout E-Books Using Conditional Random Fields

A Deep Learning-Based Formula Detection Method for Pdf Documents

A Semantic Labeling Strategy to Reject Unknown Objects in Large Scale 3d Point Clouds

A Multi-Modal Context Reasoning Approach for Conditional Inference on Joint Textual and Visual Clues

Semantic Context Modeling with Maximal Margin Conditional Random Fields for Automatic Image Annotation

Image Region Labeling by Exploring Contextual Information of Visual Spatial and Semantic Concepts

Context-Aware Classification of Legal Document Pages

Image Layer Modeling for Complex Document Layout Generation.

Conditional Random Fields for Image Region Labeling with Global Observation.

Conditional Random Fields for Image Labeling

Labeling images by integrating sparse multiple distance learning and semantic context modeling

Tree-structured conditional random fields for semantic annotation

DOCMASTER: A Unified Platform for Annotation, Training, & Inference in Document Question-Answering

Contextual Recognition of Hand-Drawn Diagrams with Conditional Random Fields

PDF: A Probability-Driven Framework for Open World 3D Point Cloud Semantic Segmentation

PDFChatAnnotator: A Human-LLM Collaborative Multi-Modal Data Annotation Tool for PDF-Format Catalogs

Conditional Random Fields Based Label Sequence and Information Feedback