Abstract:Many real-world text classification tasks often deal with a large number of closely related categories organized in a hierarchical structure or taxonomy. Hierarchical multi-label text classification (HMTC) has become rather challenging when it requires handling large sets of closely related categories. The structural features of all categories in the entire hierarchy and the word semantics of their category labels are very helpful in improving text classification accuracy over large sets of closely related categories, which has been neglected in most of existing HMTC approaches. In this paper, we present a hybrid embedding-based text representation for HMTC with high accuracy. First, the hybrid embedding consists of both graph embedding of categories in the hierarchy and their word embedding of category labels. The Structural Deep Network Embedding-based graph embedding model is used to simultaneously encode the global and local structural features of a given category in the whole hierarchy for making the category structurally discriminable. We further use the word embedding technique to encode the word semantics of each category label in the hierarchy for making different categories semantically discriminable. Second, we presented a level-by-level HMTC approach based on the bidirectional Gated Recurrent Unit network model together with the hybrid embedding that is used to learn the representation of the text level-by-level. Last but not least, extensive experiments were made over five large-scale real-world datasets in comparison with the state-of-the-art hierarchical and flat multi-label text classification approaches, and the experimental results show that our approach is very competitive to the state-of-the-art approaches in classification accuracy, in particular maintaining computational costs while achieving superior performance.

Hierarchical Multilabel Text Classification Via Multitask Learning.

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach

Hierarchical Text Classification with Multi-Label Contrastive Learning and KNN

Hybrid embedding-based text representation for hierarchical multi-label text classification

Hierarchical Multi-label Text Classification: Self-adaption Semantic Awareness Network Integrating Text Topic and Label Level Information

Hierarchy-Aware and Label Balanced Model for Hierarchical Text Classification

Multi-label Text Classification Model Based on Multi-level Constraint Augmentation and Label Association Attention

Exploiting Global and Local Hierarchies for Hierarchical Text Classification

Joint Embedding of Words and Category Labels for Hierarchical Multi-label Text Classification

A Hierarchical Fine-Tuning Approach Based on Joint Embedding of Words and Parent Categories for Hierarchical Multi-label Text Classification

Recent Advances in Hierarchical Multi-label Text Classification: A Survey

Hierarchical Inter-Attention Network for Document Classification with Multi-Task Learning.

Hierarchical Multilabel Ship Classification in Remote Sensing Images Using Label Relation Graphs

MATCH: Metadata-Aware Text Classification in A Large Hierarchy

Hyperbolic Interaction Model For Hierarchical Multi-Label Classification

An Interactive Fusion Model for Hierarchical Multi-label Text Classification

HFT-ONLSTM: Hierarchical and Fine-Tuning Multi-label Text Classification

HE-HMTC: A hybrid embedding-based text representation for Hierarchical multi-label text classification

Adopting the Multi-answer Questioning Task with an Auxiliary Metric for Extreme Multi-label Text Classification Utilizing the Label Hierarchy

HAIN: Multi-label Classification with Hierarchical Attention-based Interaction Network for Multi-turn Dialogue Texts