Abstract:Zero-shot image recognition attempts to simulate the zero-shot learning mechanism of humans and recognizes the images of novel classes. It is crucial to learn transferable knowledge from seen classes and generalize it to unseen classes for image recognition in zero-shot learning (ZSL). Most existing ZSL methods extract visual features with pretrained backbone networks and learn transferable knowledge with the extracted visual features. However, the backbone networks are not pretrained for a special task, and the extracted visual features usually contain some distractive information for the ZSL task, which causes some discriminative information to be ignored or weakened and degrades the quality of knowledge learned from seen classes. Moreover, since visual samples of unseen classes are not obtainable, domain shift is another challenging problem. In this paper, we propose visual feature enhancement to learn more discriminative visual features via a graph convolutional network (GCN) and an attention mechanism for improving the quality of the learned transferable knowledge. Different from previous works, we explore the correlations between different latent visual patterns of an image and introduce GCN to enhance visual features. On the other hand, we take advantage of different learning mechanisms of GCN and MLP and propose dual classifier learning for improving the generalization and inference capabilities of our model. In end-to-end model training, the module of visual feature enhancement and the module of dual classifier learning are beneficial to each other via joint optimization. Finally, we perform extensive experiments in the ZSL setting and GZSL setting. The extensive experimental results verify the effectiveness and superiority of our method.

Simple Is Better: A Global Semantic Consistency Based End-To-End Framework For Effective Zero-Shot Learning

Global Semantic Consistency for Zero-Shot Learning.

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Cluster-based Contrastive Disentangling for Generalized Zero-Shot Learning

Learn More from Less: Generalized Zero-Shot Learning with Severely Limited Labeled Data

OntoZSL: Ontology-enhanced Zero-shot Learning

Visual and Semantic Prototypes-Jointly Guided CNN for Generalized Zero-shot Learning

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Improving Generalized Zero-Shot Learning by Exploring the Diverse Semantics from External Class Names

Leveraging Self-Distillation and Disentanglement Network to Enhance Visual–Semantic Feature Consistency in Generalized Zero-Shot Learning

Improving generalized zero-shot learning via cluster-based semantic disentangling representation

SEER-ZSL: Semantic Encoder-Enhanced Representations for Generalized Zero-Shot Learning

Unbiased Hybrid Generation Network for Zero-Shot Learning

Semantics Disentangling for Generalized Zero-Shot Learning

Modality independent adversarial network for generalized zero shot image classification

Visual feature synthesis with semantic reconstructor for traditional and generalized zero‐shot object classification

Semantic-diversity transfer network for generalized zero-shot learning via inner disagreement based OOD detector

Zero-shot learning via visual feature enhancement and dual classifier learning for image recognition

Better Transferability with Attribute Attention for Generalized Zero-Shot Learning

SR-GAN: Semantic Rectifying Generative Adversarial Network for Zero-shot Learning

Zero-Shot Learning with Joint Generative Adversarial Networks