Abstract:Zero-shot text learning enables text classifiers to handle unseen classes efficiently, alleviating the need for task-specific training data. A simple approach often relies on comparing embeddings of query (text) to those of potential classes. However, the embeddings of a simple query sometimes lack rich contextual information, which hinders the classification performance. Traditionally, this has been addressed by improving the embedding model with expensive training. We introduce QZero, a novel training-free knowledge augmentation approach that reformulates queries by retrieving supporting categories from Wikipedia to improve zero-shot text classification performance. Our experiments across six diverse datasets demonstrate that QZero enhances performance for state-of-the-art static and contextual embedding models without the need for retraining. Notably, in News and medical topic classification tasks, QZero improves the performance of even the largest OpenAI embedding model by at least 5% and 3%, respectively. Acting as a knowledge amplifier, QZero enables small word embedding models to achieve performance levels comparable to those of larger contextual models, offering the potential for significant computational savings. Additionally, QZero offers meaningful insights that illuminate query context and verify topic relevance, aiding in understanding model predictions. Overall, QZero improves embedding-based zero-shot classifiers while maintaining their simplicity. This makes it particularly valuable for resource-constrained environments and domains with constantly evolving information.

Zero-Shot Learning for Semantic Utterance Classification

A Semantic Similarity Supervised Autoencoder for Zero-Shot Learning.

Weakly Supervised Classification Model for Zero‐shot Semantic Segmentation

OntoZSL: Ontology-enhanced Zero-shot Learning

Transductive Unbiased Embedding for Zero-Shot Learning

Transductive discriminative dictionary learning approach for zero-shot classification

Learning Latent Semantic Attributes for Zero-Shot Object Detection.

Zero-Shot End-to-End Spoken Language Understanding via Cross-Modal Selective Self-Training

Zero-Shot Recognition Based on Semantic Embeddings and Deep Clustering

A Meaningful Learning Method for Zero-Shot Semantic Segmentation

Semantic Autoencoder for Zero-Shot Learning

Ontology-guided Semantic Composition for Zero-Shot Learning

Retrieval Augmented Zero-Shot Text Classification

Zero-Shot Learning via Discriminative Dual Semantic Auto-Encoder

Zero-Shot Learning on Semantic Class Prototype Graph

Zero-Shot Scene Classification for High Spatial Resolution Remote Sensing Images

Zero-shot Feature Selection via Exploiting Semantic Knowledge.

Zero-Shot Text Classification with Semantically Extended Graph Convolutional Network

Semantic-aware Visual Attributes Learning for Zero-Shot Recognition

Vocabulary-Informed Zero-Shot and Open-Set Learning

Semantic Embedding Space for Zero-Shot Action Recognition