An Interactive Fusion Model for Hierarchical Multi-label Text Classification

Xiuhao Zhao,Zhao Li,Xianming Zhang,Jibin Wang,Tong Chen,Zhengyu Ju,Canjun Wang,Chao Zhang,Yiming Zhan
DOI: https://doi.org/10.1007/978-3-031-17189-5_14
2022-01-01
Abstract:Scientific research literature usually has multi-level labels, and there are often dependencies between multi-level labels. It is crucial for the model to learn and integrate the information between multi-level labels for the hierarchical multi-label text classification (HMTC) of scientific research literature texts. Therefore, for the HMTC task in the scientific research literature, we use the pre-trained language model SciBERT trained on scientific texts. And we introduce a shared TextCNN layer in our multi-task learning architecture to learn the dependency information between labels at each level. Then the hierarchical feature information is fused and propagated from top to bottom according to the task level. We conduct ablation experiments on the dependency information interaction module and the hierarchical information fusion propagation module. Experimental results on the NLPCC2022 SharedTask5 Track1 dataset demonstrate the effectiveness of our model, and we rank 4th place in the task.
What problem does this paper attempt to address?