Abstract:Scene Graph Generation (SGG) aims to detect all objects and identify their pairwise relationships in the scene. Recently, tremendous progress has been made in exploring better context relationship representations. Previous work mainly focuses on contextual information aggregation and uses de-biasing strategies on samples to eliminate the preference for head predicates. However, there remain challenges caused by indeterminate feature training. Overlooking the label confusion problem in feature training easily results in a messy feature distribution among the confused categories, thereby affecting the prediction of predicates. To alleviate the aforementioned problem, in this paper, we focus on enhancing predicate representation learning. Firstly, we propose a novel Adaptive Message Passing (AMP) network to dynamically conduct information propagation among neighbors. AMP provides discriminating representations for neighbor nodes under the view of de-noising and adaptive aggregation. Furthermore, we construct a feature-assisted training paradigm alongside the predicate classification branch, guiding predicate feature learning to the corresponding feature space. Moreover, to alleviate biased prediction caused by the long-tailed class distribution and the interference of confused labels, we design a Bi-level Curriculum learning scheme (BiC). The BiC separately considers the training from the feature learning and de-biasing levels, preserving discriminating representations of different predicates while resisting biased predictions. Results on multiple SGG datasets show that our proposed method AMP-BiC has superior comprehensive performance, demonstrating its effectiveness.

Heterogeneous Learning for Scene Graph Generation

HL-Net: Heterophily Learning Network for Scene Graph Generation

Heterogeneous Graph Learning for Scene Graph Prediction in 3D Point Clouds

Dual-branch Hybrid Learning Network for Unbiased Scene Graph Generation

Bridging Visual and Textual Semantics: Towards Consistency for Unbiased Scene Graph Generation

Hyper-relationship Learning Network for Scene Graph Generation

Fast Contextual Scene Graph Generation with Unbiased Context Augmentation.

Synergetic Prototype Learning Network for Unbiased Scene Graph Generation

Unbiased Heterogeneous Scene Graph Generation with Relation-aware Message Passing Neural Network

Self-Supervised Heterogeneous Graph Learning: a Homophily and Heterogeneity View

Attention Redirection Transformer with Semantic Oriented Learning for Unbiased Scene Graph Generation

Learning to Generate Scene Graph from Head to Tail

Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph Generation

HGBER: Heterogeneous Graph Neural Network With Bidirectional Encoding Representation

Head-Tail Cooperative Learning Network for Unbiased Scene Graph Generation

Geometric Contrastive Learning for Heterogeneous Graphs Encoding

Heterogeneous Graph Contrastive Learning With Augmentation Graph

Adaptive Feature Learning for Unbiased Scene Graph Generation

Peer Learning for Unbiased Scene Graph Generation

Hierarchical Memory Learning for Fine-Grained Scene Graph Generation.

Heterogeneous Graph Contrastive Learning with Dual Aggregation Scheme and Adaptive Augmentation