Abstract:A framework for multi-class sentiment classification is proposed.A total of 3600 comparative experiments are conducted.Performances of different feature selection/machine learning algorithms are compared.The results are valuable for further studies on multi-class sentiment classification. Multi-class sentiment classification has extensive application backgrounds, whereas studies on this issue are still relatively scarce. In this paper, a framework for multi-class sentiment classification is proposed, which includes two parts: 1) selecting important features of texts using the feature selection algorithm, and 2) training multi-class sentiment classifier using the machine learning algorithm. Then, experiments are conducted for comparing the performances of four popular feature selection algorithms (document frequency, CHI statistics, information gain and gain ratio) and five popular machine learning algorithms (decision tree, nave Bayes, support vector machine, radial basis function neural network and K-nearest neighbor) in multi-class sentiment classification. The experiments are conducted on three public datasets which include twelve data subsets, and 10-fold cross validation is used to obtain the classification accuracy concerning each combination of feature selection algorithm, machine learning algorithm, feature set size and data subset. Based on the obtained 3600 classification accuracies (4 feature selection algorithms 5 machine learning algorithms 15 feature set sizes 12 data subsets), the average classification accuracy of each algorithm is calculated, and the Wilcoxon test is used to verify the existence of significant difference between different algorithms in multi-class sentiment classification. The results show that, in terms of classification accuracy, gain ratio performs best among the four feature selection algorithms and support vector machine performs best among the five machine learning algorithms. In terms of execution time, the similar comparisons are also conducted. The obtained results would be valuable for further improving the existing multi-class sentiment classifiers and developing new multi-class sentiment classifiers.

On Use of Different Feature Sets for Pattern Classification: an Alternative Method

A method of combining multiple probabilistic classifiers through soft competition on different feature sets

Improving Short Text Classification Through Better Feature Space Selection

Methods of Combining Multiple Classifiers with Different Features and Their Applications to Text-Independent Speaker Identification

A Modified Mixtures of Experts Architecture for Classification with Diverse Features

Methods of Linear Combination Based on Different Features

Intuitionistic fuzzy kernel-matching pursuit ensemble algorithm based on hybrid selection strategy

Multiple Classifiers Combination Based on Specialists' FIelds

Ensemble of feature sets and classification algorithms for sentiment classification

Multi-class sentiment classification: The experimental comparisons of feature selection and machine learning algorithms.

Combination of Multiple Classifier Using Feature Space Partitioning

A New Supervised Feature Selection Method for Pattern Classification.

Ensembles Of Neural Networks Based On The Alteration Of Input Feature Values

An Experimental Comparative Study On Several Soft And Hard-Cut Em Algorithms For Mixture Of Experts

An Adaptive Feature Selection Method for Multi-Class Classification.

A Hybrid and Ensemble Intelligent Pattern Classification Algorithm

On Improvement of Feature Extraction Algorithms for Discriminative Pattern Classification.

A study of audio classification on using different feature schemes with three classifiers

Permutation-invariant Feature Restructuring for Correlation-aware Image Set-based Recognition

Finding Optimal Diverse Feature Sets with Alternative Feature Selection

Combining Classifiers and Learning Mixture-of-Experts