Abstract:Many real-world text classification tasks often deal with a large number of closely related categories organized in a hierarchical structure or taxonomy. Hierarchical multi-label text classification (HMTC) has become rather challenging when it requires handling large sets of closely related categories. The structural features of all categories in the entire hierarchy and the word semantics of their category labels are very helpful in improving text classification accuracy over large sets of closely related categories, which has been neglected in most of existing HMTC approaches. In this paper, we present a hybrid embedding-based text representation for HMTC with high accuracy. First, the hybrid embedding consists of both graph embedding of categories in the hierarchy and their word embedding of category labels. The Structural Deep Network Embedding-based graph embedding model is used to simultaneously encode the global and local structural features of a given category in the whole hierarchy for making the category structurally discriminable. We further use the word embedding technique to encode the word semantics of each category label in the hierarchy for making different categories semantically discriminable. Second, we presented a level-by-level HMTC approach based on the bidirectional Gated Recurrent Unit network model together with the hybrid embedding that is used to learn the representation of the text level-by-level. Last but not least, extensive experiments were made over five large-scale real-world datasets in comparison with the state-of-the-art hierarchical and flat multi-label text classification approaches, and the experimental results show that our approach is very competitive to the state-of-the-art approaches in classification accuracy, in particular maintaining computational costs while achieving superior performance.

Hierarchical Taxonomy Preparation for Text Categorization Using Consistent Bipartite Spectral Graph Copartitioning

Hierarchical Taxonomy Preparation for Text Categorization Using Consistent Bipartite Spectral Graph Copartitioning

Text Categorization Based on Domain Ontology

A multiclass classification framework for document categorization

Large-Scale Hierarchical Text Classification Based On Path Semantic Information

Large-Scale Hierarchical Text Classification Based on Path Semantic Vector and Prior Information

An experimental study on large-scale web categorization.

Hierarchical Taxonomy-Aware and Attentional Graph Capsule RCNNs for Large-Scale Multi-Label Text Classification

Hybrid embedding-based text representation for hierarchical multi-label text classification

Heterogeneous Information Integration in Hierarchical Text Classification

Fast text categorization based on collaborative work in the semantic and class spaces

A Hierarchical Fine-Tuning Approach Based on Joint Embedding of Words and Parent Categories for Hierarchical Multi-label Text Classification

Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach

Hierarchical Multilabel Text Classification Via Multitask Learning.

Dimensionality Reduction With Category Information Fusion And Non-Negative Matrix Factorization For Text Categorization

An Integrated System for Building Enterprise Taxonomies

Support vector machines classification with a very large-scale taxonomy

Hierarchical Multi-Label Text Categorization with Global Margin Maximization

HFT-ONLSTM: Hierarchical and Fine-Tuning Multi-label Text Classification

Muli-label Text Categorization with Hidden Components.

Hierarchical Learning of Tree Classifiers for Large-Scale Plant Species Identification