Abstract:Hierarchical multi-label text classification (HMTC) is a fundamental but challenging task of numerous applications (e.g., patent annotation), where documents are assigned to multiple categories stored in a hierarchical structure. Categories at different levels of a document tend to have dependencies. However, the majority of prior studies for the HMTC task employ classifiers to either deal with all categories simultaneously or decompose the original problem into a set of flat multi-label classification subproblems, ignoring the associations between texts and the hierarchical structure and the dependencies among different levels of the hierarchical structure. To that end, in this paper, we propose a novel framework called Hierarchical Attention-based Recurrent Neural Network (HARNN) for classifying documents into the most relevant categories level by level via integrating texts and the hierarchical category structure. Specifically, we first apply a documentation representing layer for obtaining the representation of texts and the hierarchical structure. Then, we develop an hierarchical attention-based recurrent layer to model the dependencies among different levels of the hierarchical structure in a top-down fashion. Here, a hierarchical attention strategy is proposed to capture the associations between texts and the hierarchical structure. Finally, we design a hybrid method which is capable of predicting the categories of each level while classifying all categories in the entire hierarchical structure precisely. Extensive experimental results on two real-world datasets demonstrate the effectiveness and explanatory power of HARNN.

Research on Hierarchical Text Categorization Using Approach of Multiple Feature Selection and Multiple Classifier Fusion

Hierarchical Text Categorization Based on Multiple Feature Selection and Fusion of Multiple Classifiers Approaches.

Web Page Classification Based on Heterogeneous Features and a Combination of Multiple Classifiers.

A Fusion of Multiple Classifiers Approach Based on Reliability Function for Text Categorization.

An Approach of Multi-hierarchy Text Classification Based on Vector Space Model

Hierarchical Classification Approach of Hierarchical Feature Selection and Error Control

Hierarchical Categorization Methods of Chinese Text Based on Vector Space Model

Hierarchical Chinese Document Categorization

Hierarchical classification model based on MD feature selection method

A re-ranking approach for categorization information retrieval based on multiple feature selection

Recent Advances in Hierarchical Multi-label Text Classification: A Survey

Improved Document Feature Selection with Categorical Parameter for Text Classification.

A METHOD OF HIERARCHICAL DOCUMENT AUTOMATIC CLASSIFICATION IN E-RESEARCH

Deep classifier for large scale hierarchical text classification

Fuzzy Rough Set Based Feature Selection for Large-Scale Hierarchical Classification.

A Hierarchical Neural-Network-Based Document Representation Approach for Text Classification

Hierarchical Multi-label Text Classification: Self-adaption Semantic Awareness Network Integrating Text Topic and Label Level Information

A Hierarchical Fine-Tuning Approach Based on Joint Embedding of Words and Parent Categories for Hierarchical Multi-label Text Classification

MMF: Multi-Task Multi-Structure Fusion for Hierarchical Image Classification

Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach

A Multi-feature Fusion Method with Attention Mechanism for Long Text Classification