Abstract:Feature selection plays a crucial role in classification tasks as part of the data preprocessing process. Effective feature selection can improve the robustness and interpretability of learning algorithms, and accelerate model learning. However, traditional statistical methods for feature selection are no longer practical in the context of high-dimensional data due to the computationally complex. Ensemble learning, a prominent learning method in machine learning, has demonstrated exceptional performance, particularly in classification problems. To address the issue, we propose a three-stage feature selection algorithm framework for high-dimensional data based on ensemble learning (EFS-GINI). Firstly, highly linearly correlated features are eliminated using the Spearman coefficient. Then, a feature selector based on the F-test is employed for the first stage selection. For the second stage, four feature subsets are formed using mutual information (MI), ReliefF, SURF, and SURF* filters in parallel. The third stage involves feature selection using a combinator based on GINI coefficient. Finally, a soft voting approach is proposed to employ for classification, including decision tree, naive Bayes, support vector machine (SVM), k-nearest neighbors (KNN) and random forest classifiers. To demonstrate the effectiveness and efficiency of the proposed algorithm, eight high-dimensional datasets are used and five feature selection methods are employed to compare with our proposed algorithm. Experimental results show that our method effectively enhances the accuracy and speed of feature selection. Moreover, to explore the biological significance of the proposed algorithm, we apply it on the renal cell carcinoma dataset GSE40435 from the Gene Expression Omnibus database. Two feature genes, NOP2 and NSUN5, are selected by our proposed algorithm. They are directly involved in regulating m5c RNA modification, which reveals the biological importance of EFS-GINI. Through bioinformatics analysis, we shows that m5C-related genes play an important role in the occurrence and progression of renal cell carcinoma, and are expected to become an important marker to predict the prognosis of patients.

A Hybrid Feature Selection Algorithm Used in Disease Association Study

A Cancer Gene Selection Algorithm Based on the K-S Test and CFS

A hybrid feature selection algorithm combining information gain and grouping particle swarm optimization for cancer diagnosis

A Highly Discriminative Hybrid Feature Selection Algorithm for Cancer Diagnosis

Multiclass Cancer Classification by Using Fuzzy Support Vector Machine and Binary Decision Tree with Gene Selection

Medical Datasets Classification using a Hybrid Genetic Algorithm for Feature Selection based on Pearson Correlation Coefficient

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Gene selection for cancer classification using a hybrid of univariate and multivariate feature selection methods

Genetic heterogeneity analysis using genetic algorithm and network science

FS–GBDT: identification multicancer-risk module via a feature selection algorithm by integrating Fisher score and GBDT

A novel hybrid algorithm based on Harris Hawks for tumor feature gene selection

Hybrid Filter and Genetic Algorithm-Based Feature Selection for Improving Cancer Classification in High-Dimensional Microarray Data

A novel and innovative cancer classification framework through a consecutive utilization of hybrid feature selection

The Unsupervised Feature Selection Algorithms Based on Standard Deviation and Cosine Similarity for Genomic Data Analysis

Supervised Learning-Based Tagsnp Selection for Genome-Wide Disease Classifications

Lasso Algorithm and Support Vector Machine Strategy to Screen Pulmonary Arterial Hypertension Gene Diagnostic Markers

FG-HFS: A feature filter and group evolution hybrid feature selection algorithm for high-dimensional gene expression data

Risk Factors Selection for SGA Prediction

Optimizing Gene Selection and Cancer Classification with Hybrid Sine Cosine and Cuckoo Search Algorithm

An ensemble learning-based feature selection algorithm for identification of biomarkers of renal cell carcinoma