Abstract:Abstract Many approaches to automatic classification begin with some prescribed features. However, the features for Chinese aspect classification are normally prescribed as several integrated linguistic feature sets involving temporal, lexical aspectual or grammatical features. The number of the features is often gradually expanded as the designers try to refine the conditions for classification until at last the features should be optimized to eliminate some of the useless or contradictory features. The features for Chinese aspect classification are difficult to be optimized as they are discrete, quite different from those in other classifications. A model-based approach is proposed in this study to optimize the features for Chinese aspect classification illustrated by ZHE aspect markers by estimating, processing and testing the correlations between the features. As an important preparation for building the model, dummy variables are firstly adopted in this study to represent the discrete Chinese ZHE aspect features. The correlations among the features are then estimated by contingency tables. The highly correlated variables are further combined using the Principal Component Analysis. The performances of the original and the optimized features are finally empirically verified by logistic models. The optimized 26 feature sets from the original 40 feature sets are tested with better performances after comparisons before and after the optimizations. Model-based feature selection approaches extensively used in economics have rarely been applied in NLP for Chinese up until now. It will shed some new light on the NLP feature selection method and have some implications in generating rules for revising the Chinese ZHE aspects to its target English categories before being automatically translated into English categories.

Improved Katz smoothing algorithms with POS information

Improved katz smoothing for language modeling in speech recogniton

An Empirical Study of Non-Stationary Ngram Model and its Smoothing Techniques

Smoothing Algorithm of the Task Adaptation Chinese N-gram Model

A similarity-based smoothing algorithm for Chinese language modeling and its application in pinyin-to-character conversion

An Enhanced Model for Chinese Word Segmentation and Part-of-Speech Tagging.

Automatic Abstraction of Long Chinese Patent Texts Based on P-Bertsum Model

An Adaptive Post-processing Method using Proofreading Information for Chinese Character Recognition

Comparison of Several Smoothing Methods in Statistical Language Model

A Smoothing Algorithm For The Task Adaptation Chinese Trigram Model

Exploiting Word Positional Information in Ngram Model for Chinese Text Input Method

A Model-based Feature Optimization Approach to Chinese Language Processing

Improving Naive Bayes Text Classifier Using Smoothing Methods.

Linear Interpolated Methods in Statistical Natural Language Processing

Human-Computer Interactive Chinese Word Segmentation: an Adaptive Dirichlet Process Mixture Model Approach.

A Model-based Feature Optimization Approach to Chinese Language Processing.

Reducing Approximation and Estimation Errors for Chinese Lexical Processing with Heterogeneous Annotations

POS-ATAEPE-BiLSTM: an aspect-based sentiment analysis algorithm considering part-of-speech embedding

An Improved Condensing Algorithm

Research on the Approach of Integrating Chinese Word Segmentation with Part-of-speech Tagging

An Improved K-Nearest Neighbor Algorithm for Text Categorization