Abstract:In this paper, we perform Chinese text categorization using n-gram text representation on TanCorpV1.0 which is a new corpus, special for Chinese text classification of more than 14,000 texts divided in 12 classes. We use a combination of methods, including between inter-class feature reduction methods and cross-class feature selection methods. We use the C-SVC classifier (with a linear kernel) which is the SVM algorithm made for the multi-classification task. We perform our experiments in the TANAGRA platform. Our experiments concern: (1) the performance comparison between using both 1-, 2-grams and using 1-, 2-, 3- gram in Chinese text representation; (2) the performance comparison between using different feature representations: absolute text frequency, relative text frequency, absolute n-gram frequency and relative n-gram frequency; (3) the comparison of the sparseness in the "text*feature" matrix between using n-gram frequency and frequency in feature selection; (4) the performance comparison between two text coding methods: the 0/1 logical value and the n-gram frequency numeric value. We found out that in the case of using less than 3,000 features, the feature selection methods based on n-gram frequency (absolute or relative) always yield better results.

A Comparative Study on Representing Units in Chinese Text Clustering

Experimental Study On Representing Units In Chinese Text Categorization

Application of Quantitative Characteristics of Chinese Genres in Text Clustering

A Comparative Study on Chinese Word Clustering

Comparing different text representation and feature selection methods on Chinese text classification using Character n-grams

A Comparison and Semi-Quantitative Analysis of Words and Character-Bigrams As Features in Chinese Text Categorization

A Comparative Study on Text Clustering Methods

Using Multiple Features and Statistical Model to Calculate Text Units Similarity

Distributional Character Clustering For Chinese Text Categorization

A Text Categorization Method Based on Features Clustering

A Linguistic Feature Based Text Clustering Method.

Influence of Part-of-Speech on Chinese and English Document Clustering

Text Categorization Based on Clustering Feature Selection

Enhancing Chinese Word Segmentation With Character Clustering

Short text clustering based on word embeddings and EMD

An Evaluation on Feature Selection for Text Clustering

Study on Application of Fuzzy Clustering in Chinese Text Categorization

N-grams based feature selection and text representation for Chinese Text Classification

A Comparative Study on K-Means Clustering with Different Cluster Representations

The Dictionary-Based Quantified Conceptual Relations For Hard And Soft Chinese Text Clustering

Chinese Text Chunking Based on Improved K-means Clustering