Abstract:In this article, we focus on the task of zero-shot image classification (ZSIC) that equips a learning system with the ability to recognize visual images from unseen classes. In contrast to the traditional image classification, ZSIC more easily suffers from the class-imbalance issue since it is more concerned with the class-level knowledge transferring capability. In the real world, the sample numbers of different categories generally follow a long-tailed distribution, and the discriminative information in the sample-scarce seen classes is hard to transfer to the related unseen classes in the traditional batch-based training manner, which degrades the overall generalization ability a lot. To alleviate the class-imbalance issue in ZSIC, we propose a sample-balanced training process to encourage all training classes to contribute equally to the learned model. Specifically, we randomly select the same number of images from each class across all training classes to form a training batch to ensure that the sample-scarce classes contribute equally as those classes with sufficient samples during each iteration. Considering that the instances from the same class differ in class representativeness, we further develop an efficient semantic-guided feature fusion model to obtain the discriminative class visual prototype for the following visual-semantic interaction process via distributing different weights to the selected samples based on their class representativeness. Extensive experiments on three imbalanced ZSIC benchmark datasets for both traditional ZSIC and generalized ZSIC tasks demonstrate that our approach achieves promising results, especially for the unseen categories that are closely related to the sample-scarce seen categories. Besides, the experimental results on two class-balanced datasets show that the proposed approach also improves the classification performance against the baseline model.

Boosting Zero-Shot Image Classification via Pairwise Relationship Learning

Zero-Shot Detection with Transferable Object Proposal Mechanism.

Zero-Shot Image Classification Method Based on Attention Mechanism and Semantic Information Fusion

Zero-shot Image Categorization by Image Correlation Exploration

VS-Boost: Boosting Visual-Semantic Association for Generalized Zero-Shot Learning

Selective Zero-Shot Classification with Augmented Attributes.

Multi-method Integration with Confidence-based Weighting for Zero-shot Image Classification

Generalized Zero-Shot Text Classification Via Inter-Class Relationship

Boosting Zero-Shot Node Classification Via Dependency Capture and Discriminative Feature Learning

Description Boosting for Zero-Shot Entity and Relation Classification

Semantic-Guided Class-Imbalance Learning Model for Zero-Shot Image Classification

Zero-shot sketch-based image retrieval via adaptive relation-aware metric learning

Boosting Zero-shot Learning via Contrastive Optimization of Attribute Representations

Scalable Zero-Shot Learning Via Binary Visual-Semantic Embeddings

Dual Feature Augmentation Network for Generalized Zero-shot Learning

Learning to Model Relationships for Zero-Shot Video Classification

Zero-shot Metric Learning.

Learning Discriminative Latent Attributes for Zero-Shot Classification.

Zero-shot Object Detection with Contrastive Semantic Association Network

Adaptive Relation-Aware Network for zero-shot classification

Discriminative and Robust Attribute Alignment for Zero-Shot Learning