Abstract:Extreme Multi-label Text Classification (XMC) involves learning a classifier that can assign an input with a subset of most relevant labels from millions of label choices. Recent works in this domain have increasingly focused on a symmetric problem setting where both input instances and label features are short-text in nature. Short-text XMC with label features has found numerous applications in areas such as query-to-ad-phrase matching in search ads, title-based product recommendation, prediction of related searches. In this paper, we propose Gandalf, a novel approach which makes use of a label co-occurrence graph to leverage label features as additional data points to supplement the training distribution. By exploiting the characteristics of the short-text XMC problem, it leverages the label features to construct valid training instances, and uses the label graph for generating the corresponding soft-label targets, hence effectively capturing the label-label correlations. Surprisingly, models trained on these new training instances, although being less than half of the original dataset, can outperform models trained on the original dataset, particularly on the PSP@k metric for tail labels. With this insight, we aim to train existing XMC algorithms on both, the original and new training instances, leading to an average 5% relative improvements for 6 state-of-the-art algorithms across 4 benchmark datasets consisting of up to 1.3M labels. Gandalf can be applied in a plug-and-play manner to various methods and thus forwards the state-of-the-art in the domain, without incurring any additional computational overheads.

ADAM: An Attentional Data Augmentation Method for Extreme Multi-label Text Classification

On Data Augmentation for Extreme Multi-label Classification

AttentionXML: Label Tree-based Attention-Aware Deep Model for High-Performance Extreme Multi-Label Text Classification

Taming Prompt-Based Data Augmentation for Long-Tailed Extreme Multi-Label Text Classification.

HAXMLNet: Hierarchical Attention Network for Extreme Multi-Label Text Classification

Label-aware Document Representation via Hybrid Attention for Extreme Multi-Label Text Classification

CRAT-XML: Contrastive Representation Adversarial Training for Extremely Multi-Label Text Classification

Label-Specific Feature Augmentation for Long-Tailed Multi-Label Text Classification

Multi-label Text Classification Model Based on Multi-level Constraint Augmentation and Label Association Attention

Gate-Attention and Dual-End Enhancement Mechanism for Multi-Label Text Classification

Learning label-label correlations in Extreme Multi-label Classification via Label Features

Deep Learning for Extreme Multi-label Text Classification

A Deep Modular Label Attention Network for Multi-label Text Classification

Research of multi-label text classification based on label attention and correlation networks

LightXML: Transformer with Dynamic Negative Sampling for High-Performance Extreme Multi-label Text Classification.

Learning Label-Adaptive Representation for Large-Scale Multi-Label Text Classification

GUDN: A novel guide network with label reinforcement strategy for extreme multi-label text classification

Improving Tail Label Prediction for Extreme Multi-label Learning

Open-world Multi-label Text Classification with Extremely Weak Supervision

GNN-XML: Graph Neural Networks for Extreme Multi-label Text Classification

Fast Multi-Resolution Transformer Fine-tuning for Extreme Multi-label Text Classification