Abstract:Scene Graph Generation (SGG) aims to detect all objects and identify their pairwise relationships in the scene. Recently, tremendous progress has been made in exploring better context relationship representations. Previous work mainly focuses on contextual information aggregation and uses de-biasing strategies on samples to eliminate the preference for head predicates. However, there remain challenges caused by indeterminate feature training. Overlooking the label confusion problem in feature training easily results in a messy feature distribution among the confused categories, thereby affecting the prediction of predicates. To alleviate the aforementioned problem, in this paper, we focus on enhancing predicate representation learning. Firstly, we propose a novel Adaptive Message Passing (AMP) network to dynamically conduct information propagation among neighbors. AMP provides discriminating representations for neighbor nodes under the view of de-noising and adaptive aggregation. Furthermore, we construct a feature-assisted training paradigm alongside the predicate classification branch, guiding predicate feature learning to the corresponding feature space. Moreover, to alleviate biased prediction caused by the long-tailed class distribution and the interference of confused labels, we design a Bi-level Curriculum learning scheme (BiC). The BiC separately considers the training from the feature learning and de-biasing levels, preserving discriminating representations of different predicates while resisting biased predictions. Results on multiple SGG datasets show that our proposed method AMP-BiC has superior comprehensive performance, demonstrating its effectiveness.

PPDL: Predicate Probability Distribution Based Loss for Unbiased Scene Graph Generation

PCPL: Predicate-Correlation Perception Learning for Unbiased Scene Graph Generation

DBiased-P: Dual-Biased Predicate Predictor for Unbiased Scene Graph Generation

Learning to Generate an Unbiased Scene Graph by Using Attribute-Guided Predicate Features.

Ensemble Predicate Decoding for Unbiased Scene Graph Generation

Informative Scene Graph Generation via Debiasing

Dark Knowledge Balance Learning for Unbiased Scene Graph Generation

Fast Contextual Scene Graph Generation with Unbiased Context Augmentation.

Semantic Diversity-aware Prototype-based Learning for Unbiased Scene Graph Generation

Skew Class-balanced Re-weighting for Unbiased Scene Graph Generation

A Causality Guided Loss for Imbalanced Learning in Scene Graph Generation

From General to Specific: Informative Scene Graph Generation Via Balance Adjustment

Fine-Grained Scene Graph Generation via Sample-Level Bias Prediction

Dual-branch Hybrid Learning Network for Unbiased Scene Graph Generation

Adaptive Feature Learning for Unbiased Scene Graph Generation

Debiased Scene Graph Generation for Dual Imbalance Learning

Label Semantic Knowledge Distillation for Unbiased Scene Graph Generation

Unbiased Scene Graph Generation Via Head-Tail Cooperative Network with Self-Supervised Learning

Learning to Generate Scene Graph from Head to Tail

Addressing Predicate Overlap in Scene Graph Generation with Semantic Granularity Controller

Taking A Closer Look at Visual Relation: Unbiased Video Scene Graph Generation with Decoupled Label Learning