Abstract:Many real-world text classification tasks often deal with a large number of closely related categories organized in a hierarchical structure or taxonomy. Hierarchical multi-label text classification (HMTC) has become rather challenging when it requires handling large sets of closely related categories. The structural features of all categories in the entire hierarchy and the word semantics of their category labels are very helpful in improving text classification accuracy over large sets of closely related categories, which has been neglected in most of existing HMTC approaches. In this paper, we present a hybrid embedding-based text representation for HMTC with high accuracy. First, the hybrid embedding consists of both graph embedding of categories in the hierarchy and their word embedding of category labels. The Structural Deep Network Embedding-based graph embedding model is used to simultaneously encode the global and local structural features of a given category in the whole hierarchy for making the category structurally discriminable. We further use the word embedding technique to encode the word semantics of each category label in the hierarchy for making different categories semantically discriminable. Second, we presented a level-by-level HMTC approach based on the bidirectional Gated Recurrent Unit network model together with the hybrid embedding that is used to learn the representation of the text level-by-level. Last but not least, extensive experiments were made over five large-scale real-world datasets in comparison with the state-of-the-art hierarchical and flat multi-label text classification approaches, and the experimental results show that our approach is very competitive to the state-of-the-art approaches in classification accuracy, in particular maintaining computational costs while achieving superior performance.

Deep Multi-task Learning for Hierarchical Classification

Hierarchical Convolutional Neural Network Via Hierarchical Cluster Validity Based Visual Tree Learning

Hierarchical Bilinear Convolutional Neural Network for Image Classification.

Deep Multi-task Learning for Large-Scale Image Classification

Two-level Hierarchical Feature Learning for Image Classification

Feature Selection-Based Hierarchical Deep Network for Image Classification

Discriminative Fast Hierarchical Learning for Multiclass Image Classification

Hierarchical classification based on coarse- to fine-grained knowledge transfer

MMF: Multi-Task Multi-Structure Fusion for Hierarchical Image Classification

Semantic Guided Level-Category Hybrid Prediction Network for Hierarchical Image Classification.

Deep collaborative multi-task network: A human decision process inspired model for hierarchical image classification

HD-MTL: Hierarchical Deep Multi-Task Learning for Large-Scale Visual Recognition

Tree-Like Branching Network for Multi-class Classification

Hierarchical Multi-label Text Classification with Horizontal and Vertical Category Correlations

Hybrid embedding-based text representation for hierarchical multi-label text classification

HCAM-CL: A Novel Method Integrating a Hierarchical Cross-Attention Mechanism with CNN-LSTM for Hierarchical Image Classification

Joint Hierarchical Category Structure Learning and Large-Scale Image Classification

Hierarchical Transfer Convolutional Neural Networks for Image Classification

Exploiting Related and Unrelated Tasks for Hierarchical Metric Learning and Image Classification

HD-CNN: Hierarchical Deep Convolutional Neural Networks for Large Scale Visual Recognition

Building Hierarchical Class Structures for Extreme Multi-Class Learning