Abstract:Zero-shot learning (ZSL) aims to recognize the novel classes which cannot be collected for training a prediction model. Accordingly, generative models (e.g., generative adversarial network (GAN)) are typically used to synthesize the visual samples conditioned by the class semantic vectors and achieve remarkable progress for ZSL. However, existing GAN-based generative ZSL methods are based on hand-crafted models, which cannot adapt to various datasets/scenarios and fails to model instability. To alleviate these challenges, we propose evolutionary generative adversarial network search (termed EGANS) to automatically design the generative network with good adaptation and stability, enabling reliable visual feature sample synthesis for advancing ZSL. Specifically, we adopt cooperative dual evolution to conduct a neural architecture search for both generator and discriminator under a unified evolutionary adversarial framework. EGANS is learned by two stages: evolution generator architecture search and evolution discriminator architecture search. During the evolution generator architecture search, we adopt a many-to-one adversarial training strategy to evolutionarily search for the optimal generator. Then the optimal generator is further applied to search for the optimal discriminator in the evolution discriminator architecture search with a similar evolution search algorithm. Once the optimal generator and discriminator are searched, we entail them into various generative ZSL baselines for ZSL classification. Extensive experiments show that EGANS consistently improve existing generative ZSL methods on the standard CUB, SUN, AWA2 and FLO datasets. The significant performance gains indicate that the evolutionary neural architecture search explores a virgin field in ZSL.

Dual VAEGAN: A generative model for generalized zero-shot learning

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Joint Learning of Attended Zero-Shot Features and Visual-Semantic Mapping.

Contrastive Visual Feature Filtering for Generalized Zero-Shot Learning

Zero-VAE-GAN: Generating Unseen Features for Generalized and Transductive Zero-Shot Learning

Cluster-based Contrastive Disentangling for Generalized Zero-Shot Learning

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Generative-based hybrid model with semantic representations for generalized zero-shot learning

Leveraging Dual Variational Autoencoders and Generative Adversarial Networks for Enhanced Multimodal Interaction in Zero-Shot Learning

Visual-Augmented Dynamic Semantic Prototype for Generative Zero-Shot Learning

Dual Adversarial Semantics-Consistent Network for Generalized Zero-Shot Learning

EGANS: Evolutionary Generative Adversarial Network Search for Zero-Shot Learning

Learning discriminative and representative feature with cascade GAN for generalized zero-shot learning

Visual-Semantic Aligned Bidirectional Network for Zero-Shot Learning

Investigating the Bilateral Connections in Generative Zero-Shot Learning

Residual-Prototype Generating Network for Generalized Zero-Shot Learning

A Discriminative Cross-Aligned Variational Autoencoder for Zero-Shot Learning

Zero-Shot Learning With Attentive Region Embedding and Enhanced Semantics

GAN-MVAE: A discriminative latent feature generation framework for generalized zero-shot learning

Zero-Shot Learning with Joint Generative Adversarial Networks

Disentangling Semantic-to-visual Confusion for Zero-shot Learning