Abstract:Text clustering techniques were usually used to structure the text documents into topic related groups which can facilitate users to get a comprehensive understanding on corpus or results from information retrieval system. Most of existing text clustering algorithm which derived from traditional formatted data clustering heavily rely on term analysis methods and adopted Vector Space Model (VSM) as their document representation. But because of the essential characteristic underlying text such as high dimensionality features vector space, the problem of sparseness has a strong impact on the clustering algorithm. So feature reduction is an important preprocess step for improving the efficiency and accuracy of clustering algorithm by removing redundant and irrelevant terms from corpus. Even the clustering is considered as an unsupervised learning method, but in text, there is still some priori knowledge we can use from NLP analysis based approach. In this paper, we propose a semantic analysis based feature reduction method which used in Chinese text clustering. Our method bases on a dedicated Part-of-Speech tags selection and synonyms consolidation and can reduce the feature space of documents more effectively compared with traditional feature reduction method tfidf and stopwords removal, meanwhile it preserves or sometimes even improves the accuracy of clustering algorithm. In our experiment, we tested our feature reduction method using bisecting k-means algorithm which was proved be efficient in text clustering. The results show that our method can reduce the feature space significantly, and meanwhile have a better clustering accuracy in terms of the purity.

Cluster Correction on Polysemy and Synonymy

Document Clustering Based on Word Sense Cluster

Semantic smoothing of document models for agglomerative clustering

Semantic Smoothing for Model-based Document Clustering

Improving Online Clustering of Chinese Technology Web News with Bag-of-Near-Synonyms

A way for applying conceptual knowledge derived from a traditional dictionary to text clustering

WordNet and Semantic similarity based approach for document clustering

Solution Strategies for Word Sense Problems Based on Vector Space Model and Maximum Entropy Model

Semantic Feature Reduction in Chinese Document Clustering

A Clustering Algorithm for Short Documents Based On Concept Similarity

Semantic Correlation Network Based Text Clustering

Exploring Performance of Clustering Methods on Document Sentiment Analysis

Constrained Coclustering for Textual Documents.

Co-Clustering With Manifold And Double Sparse Representation

Cross-Lingual Document Clustering Based on Similarity Space Model

Pairwise Constrained Clustering with Group Similarity-Based Patterns

Towards Semantically Sensitive Text Clustering: a Feature Space Modeling Technology Based on Dimension Extension.

Word Clustering for Collocation-Based Word Sense Disambiguation

Semantic Term "Blurring" and Stochastic "Barcoding" for Improved Unsupervised Text Classification

Chinese semantic document classification based on strategies of semantic similarity computation and correlation analysis

Research on quantified lexical relationship within the dictionary based chinese text clustering