Abstract:In this paper, we perform Chinese text categorization using n-gram text representation on TanCorpV1.0 which is a new corpus, special for Chinese text classification of more than 14,000 texts divided in 12 classes. We use a combination of methods, including between inter-class feature reduction methods and cross-class feature selection methods. We use the C-SVC classifier (with a linear kernel) which is the SVM algorithm made for the multi-classification task. We perform our experiments in the TANAGRA platform. Our experiments concern: (1) the performance comparison between using both 1-, 2-grams and using 1-, 2-, 3- gram in Chinese text representation; (2) the performance comparison between using different feature representations: absolute text frequency, relative text frequency, absolute n-gram frequency and relative n-gram frequency; (3) the comparison of the sparseness in the "text*feature" matrix between using n-gram frequency and frequency in feature selection; (4) the performance comparison between two text coding methods: the 0/1 logical value and the n-gram frequency numeric value. We found out that in the case of using less than 3,000 features, the feature selection methods based on n-gram frequency (absolute or relative) always yield better results.

A Chinese Text Classifier Based on N-Gram Language Model and Chain Augmented Na(i)ve Bayesian Classifier

Study on an Improved Naive Bayesian Classifier Used in the Chinese Text Categorization

Text Classification Based on N-gram Language Model

Chinese Web Text Classification System Model Based on Naive Bayes

Chinese Text Categorization Without Word Segmentation Using String Kernel

Design of Chinese Text Categorization Classifier Based on Attribute Bagging

Comparing different text representation and feature selection methods on Chinese text classification using Character n-grams

Research on Korean Text Categorization Based on Naive Bayesian Classifier

Hierarchical classification of Chinese documents based onN-grams

Hierarchical Classification of Chinese Documents Based on N-grams

Research on Automatic Text Classification Based on a Hybrid Language Model

Chinese Documents Categorization Based on N-gram Information

Chinese Text Categorization Technology Using BP Neural Network

Text Categorization with Lee Model

Categorizing Web Information on Subject with Statistical Language Modeling

An Improved Algorithm of Bayesian Text Categorization.

N-grams based feature selection and text representation for Chinese Text Classification

Bayesian Multinomial Naïve Bayes Classifier to Text Classification.

C4.5Bagging algorithm for Chinese text categorization

Chinese Documents Classification Based on N-Grams

Classifying Chinese Texts in Two Steps.