Abstract:Most of the previous studies focused on enriching text representation to address text classification (TC) task. However, conventional classification approaches with VSM (vector space model) on Chinese text study intensively only the words and their relationship in some specific corpus/dataset but ignore the basic concept of categories and the general knowledge behind the words learned and used to recognize entities by people. This paper focuses on enriching text representation and proposes a novel approach, which complements information from the online Chinese encyclopedia Baidu Baike for Chinese TC. The similarities between every text and each concept of categories and the most related words from Baidu Baike are added to the feature space. The performance of the proposed approach is measured on the Fudan University TC corpus, which is an imbalanced Chinese dataset. In the experiments, the proposed Baidu Baike‐based concept similarity approach obtains promising results when compared with a previous research and the conventional method, with macro‐precision of 90.31%, recall of 75.45%, and F1 score 80.32%, which are about 0.02%, 0.15%, 0.12%, respectively, higher than the conventional method, which obviously improves the recall for some small categories while keeping precision at high level and improving the macro F1 score. Moreover, the proposed approach has good expandability, so that many other knowledge bases could be integrated and many other concepts could be referred to improve the effectiveness. © 2016 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.

Chinese Short-Text Categorization Based on the Key Classification Dictionary Words

Improving short text classification using public search engines

Improving Short Text Classification Through Better Feature Space Selection

Chinese Text Categorization Without Word Segmentation Using String Kernel

Algorithm for Chinese Short-Text Classification Using Concept Description

Improving Text Categorization Using the Importance of Words in Different Categories

Chinese Document Categorization without Dictionary Support and Segmentation Processing

Chinese Documents Categorization Based on N-gram Information

A Chinese Short Text Classification Method Based on TF-IDF and Gradient Boosting Decision Tree

Chinese Text Classification Using Key Characters String Kernel

Study on Categorization Techniques of Chinese Web Text Using KNN

A Kind of Self-Constructed Category Dictionary in Chinese Text Classification

Hierarchical Classification of Chinese Documents Based on N-grams

Chinese Documents Classification Based on N-Grams

Hybrid Chinese Text Classification Approach Using General Knowledge from Baidu Baike

Context Based Feature Description Model in Chinese Text Categorization

Short Text Classification Based on Strong Feature Thesaurus

N-grams based feature selection and text representation for Chinese Text Classification

Hierarchical classification of Chinese documents based onN-grams

Extremely Short Chinese Text Classification Method Based on Bidirectional Semantic Extension

Graph-Based Chinese Text Categorization