Abstract:The human mind grows in learning new knowledge, which finally organizes and develops a basic mental pattern called cognitive structure. Hierarchical multi-label text classification (HMLTC), a fundamental but challenging task in many real-world applications, aims to classify the documents with hierarchical labels to form a resembling cognitive structure learning process. Existing approaches for HMLTC mainly focus on partial new knowledge learning or the global cognitive-structure-like label structure utilization in a cognitive view. However, the complete cognitive structure learning model is a unity that is indispensably constructed by the global label structure utilization and partial knowledge learning, which is ignored among those HMLTC approaches. To address this problem, we will imitate the cognitive structure learning process into the HMLTC learning and propose a unified framework called Hierarchical Cognitive Structure Learning Model (HCSM) in this paper. HCSM is composed of the Attentional Ordered Recurrent Neural Network (AORNN) submodule and Hierarchical Bi-Directional Capsule (HBiCaps) submodule. Both submodules utilize the partial new knowledge and global hierarchical label structure comprehensively for the HMLTC task. On the one hand, AORNN extracts the semantic vector as partial new knowledge from the original text by the word-level and hierarchy-level embedding granularities. On the other hand, AORNN builds the hierarchical text representation learning corresponding to the global label structure by the document-level neurons ordering. HBiCaps employs an iteration to form a unified label categorization process similar to cognitive-structure learning: firstly, using the probability computation of local hierarchical relationships to maintain partial knowledge learning; secondly, modifying the global hierarchical label structure based on the dynamic routing mechanism between capsules. Moreover, the experimental results on four benchmark datasets demonstrate that HCSM outperforms or matches state-of-the-art text classification methods.

A Novel Hierarchical Structure Question Classifier

Structure Analysis and Computation-Based Chinese Question Classification

Question Classification Using Multiple Classifiers.

Classifying What-Type Questions by Head Noun Tagging.

Community question topic categorization via hierarchical kernelized classification.

Combined Multiple Classifiers Based on TBL Algorithm and Their Application in Question Classification

A Novel Feature Decomposition Method To Develop Multi-Hierarchy Model

General question module Word level ( a ) Hierarchical pyramid utterance encoder bother

Research on the Hierarchical Sentence Template and Its Application in the Automatic Answering System

Novel Design of Decision-Tree-Based Support Vector Machines Multi-Class Classifier

Question Classification By Ensemble Learning

Research on Building Methods of Hierarchical Structure in Text Classification

Cognitive structure learning model for hierarchical multi-label text classification

Question-Answering Aspect Classification with Hierarchical Attention Network.

Term Selection and Result Reranking for Question Retrieval by Exploiting Hierarchical Classification.

Sentiment Classification Towards Question-Answering with Hierarchical Matching Network

Multi-granularity Hierarchical Feature Extraction for Question-Answering Understanding

Hierarchical Classification Approach of Hierarchical Feature Selection and Error Control

HSAN-capsule: A novel text classification model

On Hierarchical Knowledge Acquisition and Application

Hierarchical classification of Chinese documents based onN-grams