Abstract:Scene graph generation (SGG) aims to understand the visual objects and their semantic relationships from one given image. Until now, lots of SGG datasets with the eyelevel view are released but the SGG dataset with the overhead view is scarcely studied. By contrast to the object occlusion problem in the eyelevel view, which impedes the SGG, the overhead view provides a new perspective that helps to promote the SGG by providing a clear perception of the spatial relationships of objects in the ground scene. To fill in the gap of the overhead view dataset, this paper constructs and releases an aerial image urban scene graph generation (AUG) dataset. Images from the AUG dataset are captured with the low-attitude overhead view. In the AUG dataset, 25,594 objects, 16,970 relationships, and 27,175 attributes are manually annotated. To avoid the local context being overwhelmed in the complex aerial urban scene, this paper proposes one new locality-preserving graph convolutional network (LPG). Different from the traditional graph convolutional network, which has the natural advantage of capturing the global context for SGG, the convolutional layer in the LPG integrates the non-destructive initial features of the objects with dynamically updated neighborhood information to preserve the local context under the premise of mining the global context. To address the problem that there exists an extra-large number of potential object relationship pairs but only a small part of them is meaningful in AUG, we propose the adaptive bounding box scaling factor for potential relationship detection (ABS-PRD) to intelligently prune the meaningless relationship pairs. Extensive experiments on the AUG dataset show that our LPG can significantly outperform the state-of-the-art methods and the effectiveness of the proposed locality-preserving strategy.

Template-Guided Data Augmentation for Unbiased Scene Graph Generation

Fast Contextual Scene Graph Generation with Unbiased Context Augmentation.

Fine-Grained Scene Graph Generation with Data Transfer

PCPL: Predicate-Correlation Perception Learning for Unbiased Scene Graph Generation

Informative Scene Graph Generation via Debiasing

Towards Unseen Triples: Effective Text-Image-joint Learning for Scene Graph Generation

From General to Specific: Informative Scene Graph Generation Via Balance Adjustment

Learning to Generate Scene Graph from Head to Tail

Learning to Generate an Unbiased Scene Graph by Using Attribute-Guided Predicate Features.

Refine and Redistribute: Multi-Domain Fusion and Dynamic Label Assignment for Unbiased Scene Graph Generation.

Enhanced Data Transfer Cooperating with Artificial Triplets for Scene Graph Generation

Adaptive Self-training Framework for Fine-grained Scene Graph Generation

Adaptive Feature Learning for Unbiased Scene Graph Generation

Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph Generation

Label Semantic Knowledge Distillation for Unbiased Scene Graph Generation

Relation-Specific Feature Augmentation for unbiased scene graph generation

Learning to Generate Language-Supervised and Open-Vocabulary Scene Graph Using Pre-Trained Visual-Semantic Space

Fine-Grained Scene Graph Generation via Sample-Level Bias Prediction

SG-Adapter: Enhancing Text-to-Image Generation with Scene Graph Guidance

Fine-Grained is Too Coarse: A Novel Data-Centric Approach for Efficient Scene Graph Generation

AUG: A New Dataset and An Efficient Model for Aerial Image Urban Scene Graph Generation