Improving Text Categorization with Semantic Knowledge in Wikipedia

Xiang Wang,Yan Jia,Ruhua Chen,Hua Fan,Bin Zhou
DOI: https://doi.org/10.1587/transinf.e96.d.2786
2013-01-01
IEICE Transactions on Information and Systems
Abstract:Text categorization, especially short text categorization, is a difficult and challenging task since the text data is sparse and multidimensional. In traditional text classification methods, document texts are represented with "Bag of Words (BOW)" text representation schema, which is based on word co-occurrence and has many limitations. In this paper, we mapped document texts to Wildpedia concepts and used the Wikipedia-concept-based document representation method to take the place of traditional BOW model for text classification. In order to overcome the weakness of ignoring the semantic relationships among terms in document representation model and utilize rich semantic knowledge in Wikipedia, we constructed a semantic matrix to enrich Wikipedia-concept-based document representation. Experimental evaluation on five real datasets of long and short text shows that our approach outperforms the traditional BOW method.
What problem does this paper attempt to address?