Text Classification Via Learning Semantic Dependency and Association
Guanqi Zhu,Hanqing Tao,Han Wu,Liyi Chen,Ye Liu,Qi Liu,Enhong Chen
DOI: https://doi.org/10.1109/ijcnn55064.2022.9892656
2022-01-01
Abstract:Text classification is a fundamental and classical problem in natural language processing. Existing methods in this area attach more attention to structure modeling of texts, while largely ignoring the cognitive principles of human reading. Actually, as an important aspect of exploring the characteristics of language comprehension, neuroscience research in recent years has demonstrated the human instinct for abstract thinking, where semantic processing and summarizing play essential roles. To this end, we propose a novel text classification method with Semantic Dependency and Association (SDA). To be specific, SDA comprises two coupled spaces, namely Dependency Space and Association Space, to imitate the real process when readers are inferring text semantics. Firstly, in Dependency Space, we devise a graph modeling structure to thoroughly capture the dependency relations between words. Then in Association Space, we associate the words with prior concepts and adopt attention mechanisms to match words with the most related concepts based on their dependency relations. Later, we synthesize the above two aspects to enhance the semantic representation of words. Afterwards, we design a Semantic Summarizing module to integrate the semantic information learned above. Finally, extensive experiments are conducted on four public English and Chinese text classification datasets, where experimental results not only demonstrate the effectiveness of our model but also reveal the superiority of the perspective from the human cognition for text comprehension.