Abstract:Zero-shot text classification (0Shot-TC) is a challenging NLU problem to which little attention has been paid by the research community. 0Shot-TC aims to associate an appropriate label with a piece of text, irrespective of the text domain and the aspect (e.g., topic, emotion, event, etc.) described by the label. And there are only a few articles studying 0Shot-TC, all focusing only on topical categorization which, we argue, is just the tip of the iceberg in 0Shot-TC. In addition, the chaotic experiments in literature make no uniform comparison, which blurs the progress. This work benchmarks the 0Shot-TC problem by providing unified datasets, standardized evaluations, and state-of-the-art baselines. Our contributions include: i) The datasets we provide facilitate studying 0Shot-TC relative to conceptually different and diverse aspects: the ``topic'' aspect includes ``sports'' and ``politics'' as labels; the ``emotion'' aspect includes ``joy'' and ``anger''; the ``situation'' aspect includes ``medical assistance'' and ``water shortage''. ii) We extend the existing evaluation setup (label-partially-unseen) -- given a dataset, train on some labels, test on all labels -- to include a more challenging yet realistic evaluation label-fully-unseen 0Shot-TC (Chang et al., 2008), aiming at classifying text snippets without seeing task specific training data at all. iii) We unify the 0Shot-TC of diverse aspects within a textual entailment formulation and study it this way. Code & Data: <a class="link-external link-https" href="https://github.com/yinwenpeng/BenchmarkingZeroShot" rel="external noopener nofollow">this https URL</a>

Zero-Shot Text Classification with Semantically Extended Textual Entailment.

Zero-Shot Detection with Transferable Object Proposal Mechanism.

Context-Guided Super-Class Inference for Zero-Shot Detection

Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approach

Zero-Shot Text Classification with Semantically Extended Graph Convolutional Network

Zero-shot Text Classification via Reinforced Self-training

Weakly Supervised Classification Model for Zero‐shot Semantic Segmentation

Issues with Entailment-based Zero-shot Text Classification.

Transductive discriminative dictionary learning approach for zero-shot classification

Text2Model: Text-based Model Induction for Zero-shot Image Classification

OntoZSL: Ontology-enhanced Zero-shot Learning

Integrating Semantic Knowledge to Tackle Zero-shot Text Classification

Selective Zero-Shot Classification with Augmented Attributes.

Logic-guided Semantic Representation Learning for Zero-Shot Relation Classification.

Cap2Seg: Inferring Semantic and Spatial Context from Captions for Zero-Shot Image Segmentation

Zero-Shot Object Detection by Semantics-Aware DETR with Adaptive Contrastive Loss.

Liberating Seen Classes: Boosting Few-Shot and Zero-Shot Text Classification via Anchor Generation and Classification Reframing

Zero-Shot Text Classification via Self-Supervised Tuning

Zero-Shot Learning for Semantic Utterance Classification

ZeroAE: Pre-trained Language Model Based Autoencoder for Transductive Zero-shot Text Classification

Retrieval Augmented Zero-Shot Text Classification