Abstract:Zero-shot image recognition attempts to simulate the zero-shot learning mechanism of humans and recognizes the images of novel classes. It is crucial to learn transferable knowledge from seen classes and generalize it to unseen classes for image recognition in zero-shot learning (ZSL). Most existing ZSL methods extract visual features with pretrained backbone networks and learn transferable knowledge with the extracted visual features. However, the backbone networks are not pretrained for a special task, and the extracted visual features usually contain some distractive information for the ZSL task, which causes some discriminative information to be ignored or weakened and degrades the quality of knowledge learned from seen classes. Moreover, since visual samples of unseen classes are not obtainable, domain shift is another challenging problem. In this paper, we propose visual feature enhancement to learn more discriminative visual features via a graph convolutional network (GCN) and an attention mechanism for improving the quality of the learned transferable knowledge. Different from previous works, we explore the correlations between different latent visual patterns of an image and introduce GCN to enhance visual features. On the other hand, we take advantage of different learning mechanisms of GCN and MLP and propose dual classifier learning for improving the generalization and inference capabilities of our model. In end-to-end model training, the module of visual feature enhancement and the module of dual classifier learning are beneficial to each other via joint optimization. Finally, we perform extensive experiments in the ZSL setting and GZSL setting. The extensive experimental results verify the effectiveness and superiority of our method.

Dual Part Discovery Network for Zero-Shot Learning

Zero-Shot Detection with Transferable Object Proposal Mechanism.

Zero-Shot Learning with Generative Latent Prototype Model.

Dual Relation Mining Network for Zero-Shot Learning

Dual Collaborative Visual-Semantic Mapping for Multi-Label Zero-Shot Image Recognition

Dual Progressive Prototype Network for Generalized Zero-Shot Learning

Dual Feature Augmentation Network for Generalized Zero-shot Learning

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Dual Expert Distillation Network for Generalized Zero-Shot Learning

Zero-Shot Learning via Discriminative Dual Semantic Auto-Encoder

Learning Discriminative Latent Attributes for Zero-Shot Classification.

Meta-Transfer Networks for Zero-Shot Learning

Zero-shot learning via visual feature enhancement and dual classifier learning for image recognition

Learning Latent Semantic Attributes for Zero-Shot Object Detection.

Learning discriminative visual semantic embedding for zero-shot recognition

`Eyes of a Hawk and Ears of a Fox': Part Prototype Network for Generalized Zero-Shot Learning

Unbiased Hybrid Generation Network for Zero-Shot Learning

High-Discriminative Attribute Feature Learning for Generalized Zero-Shot Learning

Part-Object Progressive Refinement Network for Zero-Shot Learning

Hybrid Discriminative Attribute-Object Embedding Network for Compositional Zero-Shot Learning

Deep transductive network for generalized zero shot learning