Abstract:Scene Graph Generation (SGG) aims to detect all objects and identify their pairwise relationships in the scene. Recently, tremendous progress has been made in exploring better context relationship representations. Previous work mainly focuses on contextual information aggregation and uses de-biasing strategies on samples to eliminate the preference for head predicates. However, there remain challenges caused by indeterminate feature training. Overlooking the label confusion problem in feature training easily results in a messy feature distribution among the confused categories, thereby affecting the prediction of predicates. To alleviate the aforementioned problem, in this paper, we focus on enhancing predicate representation learning. Firstly, we propose a novel Adaptive Message Passing (AMP) network to dynamically conduct information propagation among neighbors. AMP provides discriminating representations for neighbor nodes under the view of de-noising and adaptive aggregation. Furthermore, we construct a feature-assisted training paradigm alongside the predicate classification branch, guiding predicate feature learning to the corresponding feature space. Moreover, to alleviate biased prediction caused by the long-tailed class distribution and the interference of confused labels, we design a Bi-level Curriculum learning scheme (BiC). The BiC separately considers the training from the feature learning and de-biasing levels, preserving discriminating representations of different predicates while resisting biased predictions. Results on multiple SGG datasets show that our proposed method AMP-BiC has superior comprehensive performance, demonstrating its effectiveness.

DBiased-P: Dual-Biased Predicate Predictor for Unbiased Scene Graph Generation

PCPL: Predicate-Correlation Perception Learning for Unbiased Scene Graph Generation

PPDL: Predicate Probability Distribution Based Loss for Unbiased Scene Graph Generation

Divide-and-Conquer Predictor for Unbiased Scene Graph Generation

Ensemble Predicate Decoding for Unbiased Scene Graph Generation

Learning to Generate an Unbiased Scene Graph by Using Attribute-Guided Predicate Features.

Informative Scene Graph Generation via Debiasing

Unbiased Scene Graph Generation Via Head-Tail Cooperative Network with Self-Supervised Learning

Dual-branch Hybrid Learning Network for Unbiased Scene Graph Generation

A Balanced Relation Prediction Framework for Scene Graph Generation

Rethinking the Evaluation of Unbiased Scene Graph Generation

Fine-Grained Scene Graph Generation via Sample-Level Bias Prediction

Skew Class-balanced Re-weighting for Unbiased Scene Graph Generation

Debiased Scene Graph Generation for Dual Imbalance Learning

Fast Contextual Scene Graph Generation with Unbiased Context Augmentation.

Dark Knowledge Balance Learning for Unbiased Scene Graph Generation

Adaptive Feature Learning for Unbiased Scene Graph Generation

Unbiased Scene Graph Generation from Biased Training

A New Training Data Organization Form and Training Mode for Unbiased Scene Graph Generation

Head-Tail Cooperative Learning Network for Unbiased Scene Graph Generation

From General to Specific: Informative Scene Graph Generation Via Balance Adjustment