Abstract:The purpose of multi-label image classification is to assign multiple labels for multiple objects presented in one image. Recent research efforts exploit graph convolution network (GCN) to learn the label co-occurrence dependencies for enhancing the semantic representation. Although these methods have achieved promising results, they can not capture the intrinsic correlation between objects in images and do not consider the inter-channel relationship. In addition, the previous methods treat each single image independently and fail to explore the relationship between different images. To address the above challenges, we propose a novel D ual R elation G raph N etwork (DRGN) model, which adopts a double branch structure to excavate rich semantic information from intra-image and cross-image simultaneously. Specifically, we first develop an intra-image channel-relation mining (ICM) module to mine the inter-channel relationship in features while learning the importance of different channels. Secondly, we design a new GCN-based intra-image spatial-relation exploring (ISE) module to capture the correlation between objects in individual image. Notably, ISE module and ICM module can complement and promote each other from the spatial and channel dimensions of images to improve the correlation between objects in individual image. Thirdly, we propose a novel GCN-based cross-image semantic learning (CSL) module to learn the semantic relationship between different images in the mini-batch. Through graph reasoning, our CSL module can iteratively refine input image features by acquiring common semantic information from other images in the mini-batch. Extensive experiments on the MS-COCO 2014, PASCAL VOC 2007, and VG-500 datasets demonstrate that the proposed DRGN model outperforms current state-of-the-art methods.

Dual-channel graph contrastive learning for multi-label classification with label-specific features and label correlations

Dual-Channel Graph Contrastive Learning for Self-Supervised Graph-Level Representation Learning

Dual Contrastive Learning Network for Graph Clustering

Multi-Label Classification with Label Graph Superimposing

Correlation-Aware Graph Convolutional Networks for Multi-Label Node Classification

DualGraph: Improving Semi-supervised Graph Classification Via Dual Contrastive Learning

Learning common and label-specific features for multi-Label classification with correlation information

Mining Semantic Information with Dual Relation Graph Network for Multi-Label Image Classification

A Graph-based Semi-supervised Multi-label Learning Method Based on Label Correlation Consistency

Granular Correlation-based Label-specific Feature Augmentation for Multi-label Classification

DGCL: dual-graph neural networks contrastive learning for molecular property prediction

Generative Multi-Label Correlation Learning

Enhancing Label Correlation Feedback in Multi-Label Text Classification via Multi-Task Learning

Joint Label-Specific Features and Correlation Information for Multi-Label Learning.

Instance-Aware Deep Graph Learning for Multi-Label Classification

Graph-Propagation Based Correlation Learning for Weakly Supervised Fine-Grained Image Classification.

Multi-Label Learning by Exploiting Label Correlations with LDA

Correlation-Guided Representation for Multi-Label Text Classification

Multi-label classification by exploiting local positive and negative pairwise label correlation

Group sensitive Classifier Chains for multi-label classification

SMGCL: Semi-supervised Multi-view Graph Contrastive Learning