Abstract:Deep learning models have the ability to extract rich knowledge from large-scale datasets. However, the sharing of data has become increasingly challenging due to concerns regarding data copyright and privacy. Consequently, this hampers the effective transfer of knowledge from existing data to novel downstream tasks and concepts. Zero-shot learning (ZSL) approaches aim to recognize new classes by transferring semantic knowledge learned from base classes. However, traditional generative ZSL methods often require access to real images from base classes and rely on manually annotated attributes, which presents challenges in terms of data restrictions and model scalability. To this end, this paper tackles a challenging and practical problem dubbed as data-free zero-shot learning (DFZSL), where only the CLIP-based base classes data pre-trained classifier is available for zero-shot classification. Specifically, we propose a generic framework for DFZSL, which consists of three main components. Firstly, to recover the virtual features of the base data, we model the CLIP features of base class images as samples from a von Mises-Fisher (vMF) distribution based on the pre-trained classifier. Secondly, we leverage the text features of CLIP as low-cost semantic information and propose a feature-language prompt tuning (FLPT) method to further align the virtual image features and textual features. Thirdly, we train a conditional generative model using the well-aligned virtual image features and corresponding semantic text features, enabling the generation of new classes features and achieve better zero-shot generalization. Our framework has been evaluated on five commonly used benchmarks for generalized ZSL, as well as 11 benchmarks for the base-to-new ZSL. The results demonstrate the superiority and effectiveness of our approach. Our code is available in

Learn More from Less: Generalized Zero-Shot Learning with Severely Limited Labeled Data

Cluster-based Contrastive Disentangling for Generalized Zero-Shot Learning

Learning Discriminative Latent Features for Generalized Zero-and Few-Shot Learning.

Data-Free Generalized Zero-Shot Learning

A Review of Generalized Zero-Shot Learning Methods

Zero-Shot Learning with Few Seen Class Samples.

OntoZSL: Ontology-enhanced Zero-shot Learning

Transductive Unbiased Embedding for Zero-Shot Learning

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Meta-Transfer Networks for Zero-Shot Learning

Distribution and Gradient Constrained Embedding Model for Zero-Shot Learning with Fewer Seen Samples

Learning Multiple Criteria Calibration for Generalized Zero-shot Learning

Transfer Increment for Generalized Zero-Shot Learning

Improving Generalized Zero-Shot Learning by Semantic Discriminator

Less but Better: Enabling Generalized Zero-shot Learning Towards Unseen Domains by Intrinsic Learning from Redundant LLM Semantics

SEER-ZSL: Semantic Encoder-Enhanced Representations for Generalized Zero-Shot Learning

Simple Is Better: A Global Semantic Consistency Based End-To-End Framework For Effective Zero-Shot Learning

Generalized Zero-Shot Recognition based on Visually Semantic Embedding

Asymmetric Graph Based Zero Shot Learning

Improving Generalized Zero-Shot Learning by Exploring the Diverse Semantics from External Class Names

A Boundary Based Out-of-Distribution Classifier for Generalized Zero-Shot Learning