Abstract:Many real-world text classification tasks often deal with a large number of closely related categories organized in a hierarchical structure or taxonomy. Hierarchical multi-label text classification (HMTC) has become rather challenging when it requires handling large sets of closely related categories. The structural features of all categories in the entire hierarchy and the word semantics of their category labels are very helpful in improving text classification accuracy over large sets of closely related categories, which has been neglected in most of existing HMTC approaches. In this paper, we present a hybrid embedding-based text representation for HMTC with high accuracy. First, the hybrid embedding consists of both graph embedding of categories in the hierarchy and their word embedding of category labels. The Structural Deep Network Embedding-based graph embedding model is used to simultaneously encode the global and local structural features of a given category in the whole hierarchy for making the category structurally discriminable. We further use the word embedding technique to encode the word semantics of each category label in the hierarchy for making different categories semantically discriminable. Second, we presented a level-by-level HMTC approach based on the bidirectional Gated Recurrent Unit network model together with the hybrid embedding that is used to learn the representation of the text level-by-level. Last but not least, extensive experiments were made over five large-scale real-world datasets in comparison with the state-of-the-art hierarchical and flat multi-label text classification approaches, and the experimental results show that our approach is very competitive to the state-of-the-art approaches in classification accuracy, in particular maintaining computational costs while achieving superior performance.

Exploiting Global and Local Hierarchies for Hierarchical Text Classification

Hierarchy-Aware Global Model For Hierarchical Text Classification

Hierarchy-Aware and Label Balanced Model for Hierarchical Text Classification

Hybrid embedding-based text representation for hierarchical multi-label text classification

Utilizing Local Hierarchy with Adversarial Training for Hierarchical Text Classification

Hierarchical Text Classification Based on the End-to-End MCHA-BERT

Hierarchical Multilabel Text Classification Via Multitask Learning.

Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification

Hierarchical Multi-Label Text Categorization with Global Margin Maximization

Hierarchical Multi-label Text Classification: Self-adaption Semantic Awareness Network Integrating Text Topic and Label Level Information

Hierarchical multi-class text categorization with global margin maximization

Large-Scale Hierarchical Text Classification Based On Path Semantic Information

Peer-Label Assisted Hierarchical Text Classification.

Hierarchical Text Categorization Based on Multiple Feature Selection and Fusion of Multiple Classifiers Approaches.

Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach

Flatten hierarchies for large-scale hierarchical text categorization

Label-Dividing Gated Graph Neural Network for Hierarchical Text Classification.

Hierarchical Classification Based on Label Distribution Learning.

Joint Embedding of Words and Category Labels for Hierarchical Multi-label Text Classification

Hierarchical Text Classification and Its Foundations: A Review of Current Research

Semi-Supervised Hierarchical Multi-Label Classifier Based on Local Information