Abstract:The human mind grows in learning new knowledge, which finally organizes and develops a basic mental pattern called cognitive structure. Hierarchical multi-label text classification (HMLTC), a fundamental but challenging task in many real-world applications, aims to classify the documents with hierarchical labels to form a resembling cognitive structure learning process. Existing approaches for HMLTC mainly focus on partial new knowledge learning or the global cognitive-structure-like label structure utilization in a cognitive view. However, the complete cognitive structure learning model is a unity that is indispensably constructed by the global label structure utilization and partial knowledge learning, which is ignored among those HMLTC approaches. To address this problem, we will imitate the cognitive structure learning process into the HMLTC learning and propose a unified framework called Hierarchical Cognitive Structure Learning Model (HCSM) in this paper. HCSM is composed of the Attentional Ordered Recurrent Neural Network (AORNN) submodule and Hierarchical Bi-Directional Capsule (HBiCaps) submodule. Both submodules utilize the partial new knowledge and global hierarchical label structure comprehensively for the HMLTC task. On the one hand, AORNN extracts the semantic vector as partial new knowledge from the original text by the word-level and hierarchy-level embedding granularities. On the other hand, AORNN builds the hierarchical text representation learning corresponding to the global label structure by the document-level neurons ordering. HBiCaps employs an iteration to form a unified label categorization process similar to cognitive-structure learning: firstly, using the probability computation of local hierarchical relationships to maintain partial knowledge learning; secondly, modifying the global hierarchical label structure based on the dynamic routing mechanism between capsules. Moreover, the experimental results on four benchmark datasets demonstrate that HCSM outperforms or matches state-of-the-art text classification methods.

Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach

LA-HCN: Label-based Attention for Hierarchical Multi-label TextClassification Neural Network

Academic Resource Text Level Multi-label Classification based on Attention

Multi-task Hierarchical Cross-Attention Network for Multi-label Text Classification

Hierarchical Multi-label Text Classification with Horizontal and Vertical Category Correlations

Hierarchical Multi-Granularity Attention- Based Hybrid Neural Network for Text Classification.

Hybrid embedding-based text representation for hierarchical multi-label text classification

HFT-ONLSTM: Hierarchical and Fine-Tuning Multi-label Text Classification

HmcNet: A General Approach for Hierarchical Multi-Label Classification

HE-HMTC: A hybrid embedding-based text representation for Hierarchical multi-label text classification

A Hierarchical Fine-Tuning Approach Based on Joint Embedding of Words and Parent Categories for Hierarchical Multi-label Text Classification

Hierarchical Inter-Attention Network for Document Classification with Multi-Task Learning.

Hierarchical Multi-label Text Classification: Self-adaption Semantic Awareness Network Integrating Text Topic and Label Level Information

Hierarchical Multi-Attention Networks for Document Classification.

Hierarchical Hybrid Neural Networks with Multi-Head Attention for Document Classification

Cognitive structure learning model for hierarchical multi-label text classification

Hierarchical Taxonomy-Aware and Attentional Graph Capsule RCNNs for Large-Scale Multi-Label Text Classification

Joint Embedding of Words and Category Labels for Hierarchical Multi-label Text Classification

Recent Advances in Hierarchical Multi-label Text Classification: A Survey

A Hierarchical Multi-label Classification Algorithm for Scientific Papers Based on Graph Attention Networks.

HCAM-CL: A Novel Method Integrating a Hierarchical Cross-Attention Mechanism with CNN-LSTM for Hierarchical Image Classification