Abstract:Point-based indoor 3D object detection has received increasing attention with the large demand for augmented reality, autonomous driving, and robot technology in the industry. However, the detection precision suffers from inputs with semantic ambiguity, i.e., shape symmetries, occlusion, and texture missing, which would lead that different objects appearing similar from different viewpoints and then confusing the detection model. Typical point-based detectors relieve this problem via learning proposal representations with both geometric and semantic information, while the entangled representation may cause a reduction in both semantic and spatial discrimination. In this paper, we focus on alleviating the confusion from entanglement and then enhancing the proposal representation by considering the proposal’s semantics and the context in one scene. A semantic-context graph network (SCGNet) is proposed, which mainly includes two modules: a category-aware proposal recoding module (CAPR) and a proposal context aggregation module (PCAg). To produce semantically clear features from entanglement representation, the CAPR module learns a high-level semantic embedding for each category to extract discriminative semantic clues. In view of further enhancing the proposal representation and leveraging the semantic clues, the PCAg module builds a graph to mine the most relevant context in the scene. With few bells and whistles, the SCGNet achieves SOTA performance and obtains consistent gains when applying to different backbones (0.9% ~ 2.4% on ScanNet V2 and 1.6% ~ 2.2% on SUN RGB-D for mAP@0.25). Code is available at https://github.com/dsw-jlu-rgzn/SCGNet.

Discovering spatial context prototypes for object detection

Contextual Object Detection with Spatial Context Prototypes

Context-Guided Super-Class Inference for Zero-Shot Detection

Learning Object Spatial Relationship from Demonstration

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

An Efficient Isolation Method for Contextual Object Detection

Context-aware and Semantic-consistent Spatial Interactions for One-shot Object Detection without Fine-tuning

Object2Scene: Putting Objects in Context for Open-Vocabulary 3D Detection

Object-Based Image Retrieval Using Spatial Context

Spatial Context-Aware Object-Attentional Network for Multi-Label Image Classification

ContextHOI: Spatial Context Learning for Human-Object Interaction Detection

Deep feature based contextual model for object detection

Hunting Attributes: Context Prototype-Aware Learning for Weakly Supervised Semantic Segmentation

Visual Vocabulary Optimization with Spatial Context for Image Annotation and Classification

Semantic-Context Graph Network for Point-based 3D Object Detection

Context Refinement for Object Detection

Exploring Person Context and Local Scene Context for Object Detection

Task-Specific Context Decoupling for Object Detection

Context Matters: Distilling Knowledge Graph for Enhanced Object Detection

Context-Aware Aerial Object Detection: Leveraging Inter-Object and Background Relationships

Spatial Self-Distillation for Object Detection with Inaccurate Bounding Boxes