Abstract:Existing feature selection methods easily neglect the distribution of data, and require most of the neighborhood radius in neighborhood rough sets (NRS) to be selected artificially. These limitations result in the misclassification of samples. To address these drawbacks, this paper presents a mixed measure-based feature selection method using the Fisher score and an NRS model. First, the variation coefficient of the features in different decision classes is defined to depict the dispersion degree of different features, based on which, the neighborhood class is described to develop a novel NRS model. The concepts of dependency degree, neighborhood knowledge granularity, and average neighborhood entropy are defined, and then a mixed measure combining the information and algebra views is proposed to measure the uncertainty in neighborhood decision systems. Second, the average correlation degree of the feature subset is computed to assess the redundancy of the reduced feature subset. By combining the classification accuracy of the selected features, the reduction rate of the classification result, and the average correlation degree of the reduced feature set, we can construct an adaptive neighborhood radius function to avoid the artificial selection of the optimal neighborhood radius. Then, an optimal feature subset can be obtained according to the internal and external significance of the features. Third, the variation coefficient of the samples in different decision classes in each feature is defined to compute the dispersion degree of the samples, and the average of all samples in each feature is added to the between-class scatter to eliminate the effect of the different measurement dimensions of the features; then, the Fisher score model is improved to eliminate the noise of the high-dimensional data. Finally, a heuristic feature selection algorithm with the Fisher score based on the new NRS model is designed to select an optimal feature subset. Experimental results applied to five low-dimensional UCI datasets and nine high-dimensional gene expression datasets showed that the developed algorithm is effective and can select an optimal reduced subset with high classification accuracy when compared with some of the latest algorithms.

Modeling of Feature Selection Based on Random Forest Algorithm and Pearson Correlation Coefficient

Identification of a Preferred Set of Molecular Descriptors for Compound Classification Based on Principal Component Analysis

Recursive Random Forests Enable Better Predictive Performance and Model Interpretation than Variable Selection by LASSO

Effect of molecular descriptor feature selection in support vector machine classification of pharmacokinetic and toxicological properties of chemical agents.

Gene Selection Algorithm Based on Correlation Analysis

Study of drug-drug combinations based on molecular descriptors and physicochemical properties.

Prediction of the Aquatic Toxicity of Aromatic Compounds to Tetrahymena Pyriformis Through Support Vector Regression

Distance Correlation-Based Feature Selection in Random Forest

Medical Datasets Classification using a Hybrid Genetic Algorithm for Feature Selection based on Pearson Correlation Coefficient

Descriptor Selection Via Log-Sum Regularization for the Biological Activities of Chemical Structure

Mixed Measure-Based Feature Selection Using the Fisher Score and Neighborhood Rough Sets

Protein-protein interface hot spots prediction based on a hybrid feature selection strategy

Feature selection based on network maximal correlation

Feature selection method reducing correlations among features by embedding domain knowledge

Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling

Feature Selection and Optimization of Random Forest Modeling

Feature selection in predicting the activity of cyclooxygenase-2 inhibitors

An Variable Selection Method of the Significance Multivariate Correlation Competitive Population Analysis for Near-Infrared Spectroscopy in Chemical Modeling

Predictive QSAR Models for Polyspecific Drug Targets: the Importance of Feature Selection

Feature selection with distance correlation

Feature selection using feature ranking, correlation analysis and chaotic binary particle swarm optimization