Abstract:Zero-Shot Learning (ZSL) aims to recognize unseen classes by generalizing the knowledge, i.e., visual and semantic relationships, obtained from seen classes, where image augmentation techniques are commonly applied to improve the generalization ability of a model. However, this approach can also cause adverse effects on ZSL since the conventional augmentation techniques that solely depend on single-label supervision is not able to maintain semantic information and result in the semantic distortion issue consequently. In other words, image argumentation may falsify the semantic (e.g., attribute) information of an image. To take the advantage of image augmentations while mitigating the semantic distortion issue, we propose a novel ZSL approach by Harnessing Adversarial Samples (HAS). HAS advances ZSL through adversarial training which takes into account three crucial aspects: (1) robust generation by enforcing augmentations to be similar to negative classes, while maintaining correct labels, (2) reliable generation by introducing a latent space constraint to avert significant deviations from the original data manifold, and (3) diverse generation by incorporating attribute-based perturbation by adjusting images according to each semantic attribute's localization. Through comprehensive experiments on three prominent zero-shot benchmark datasets, we demonstrate the effectiveness of our adversarial samples approach in both ZSL and Generalized Zero-Shot Learning (GZSL) scenarios. Our source code is available at <a class="link-external link-https" href="https://github.com/uqzhichen/HASZSL" rel="external noopener nofollow">this https URL</a>.

Zero-Shot Learning by Generating Pseudo Feature Representations.

Attribute-Based Synthetic Network (ABS-Net): Learning more from pseudo feature representations.

Zero-Shot Learning with Generative Latent Prototype Model.

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Attentive Semantic Preservation Network for Zero-Shot Learning.

Unbiased Hybrid Generation Network for Zero-Shot Learning

Weakly Supervised Classification Model for Zero‐shot Semantic Segmentation

A Semantic Similarity Supervised Autoencoder for Zero-Shot Learning.

Explainable Zero-Shot Learning Via Attentive Graph Convolutional Network And Knowledge Graphs

Zero-Shot Learning with Joint Generative Adversarial Networks

Zero-Shot Learning via Structure-Aligned Generative Adversarial Network

Zero-Shot Learning via Attribute Regression and Class Prototype Rectification

SR-GAN: Semantic Rectifying Generative Adversarial Network for Zero-shot Learning

Zero-Shot Learning by Harnessing Adversarial Samples

Zero-Shot Aspect-Based Sentiment Analysis

Zero-Shot Learning With Attentive Region Embedding and Enhanced Semantics

Zero-shot action recognition by clustered representation with redundancy-free features

Dual Feature Augmentation Network for Generalized Zero-shot Learning

Zero-Shot Learning via Discriminative Dual Semantic Auto-Encoder

Zero-VAE-GAN: Generating Unseen Features for Generalized and Transductive Zero-Shot Learning