Abstract:Summary The feature selection is an important part in automatic classification. In this paper, we use the HowNet to extract the concept attributes from word to build a feature set. However, as the concept defi4nition sometimes is too weak in expression, we set a shielded level in the sememe Tree and filter the concept attributes which can not give enough information for classification, and reserve the word whose definition is too weak in expression. By this method, we build a feature set composing of both sememes from the HowNet and the Chinese words. We also give different sememes different values according to their expression ability and relation to the word when we extract them from the word. After comparing the weight theories and classification precise, we give the CHI-MCOR weight method, which is derived from two normal methods. Then we use the Self-Organizing Map (SOM) to realize automatic text clustering. The experiment result shows that if we can extract the sememes properly, we can not only reduce the feature dimension but also improve the classification precise. The combined weight method makes a good balance between the fuzzy words which have a high occurrence and the dividing words which have a middle or low occurrence, and the classification precise is higher than other weight methods. SOM can be used in text clustering in large scales and the clustering results are good when the concept feature is selected. Between-cluster distance of the texts of concept features is bigger than that of texts of word features, word features data nevertheless exhibit some clusters.

Information Bottleneck Based Feature Selection in Web Text Categorization

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

Text Categorization Using Distributional Clustering And Concept Extraction

Feature Selection Method on Imbalanced Text

Improving Short Text Classification Through Better Feature Space Selection

An Effective Feature Selection Method For Text Categorization

A Feature Selection Method Based on Class Feature Domains for Text Categorization

A Method of Feature Selection Based on Word2Vec in Text Categorization

Aggressive Dimensionality Reduction With Reinforcement Local Feature Selection For Text Categorization

A Feature Selection Methods Based on Concept Extraction and SOM Text Clustering Analysis

Select Strong Information Features to Improve Text Categorization Effectiveness

A New Approach of Feature Selection for Text Categorization

An Efficient Feature Selection Method Using Named Entity Recognition for Chinese Text Categorization

A General Framework of Feature Selection for Text Categorization

A High Performance Two-Class Chinese Text Categorization Method

A NER-Based Feature Selection Method for Text Classification

A Discriminative and Semantic Feature Selection Method for Text Categorization

Learning Effective Features for Chinese Text Categorization

Feature selection for image categorization

A New Feature Selection Method Based On Concept Extraction In Automatic Chinese Text Classification

Multitype Features Coselection for Web Document Clustering