Abstract:Feature selection plays a crucial role in classification tasks as part of the data preprocessing process. Effective feature selection can improve the robustness and interpretability of learning algorithms, and accelerate model learning. However, traditional statistical methods for feature selection are no longer practical in the context of high-dimensional data due to the computationally complex. Ensemble learning, a prominent learning method in machine learning, has demonstrated exceptional performance, particularly in classification problems. To address the issue, we propose a three-stage feature selection algorithm framework for high-dimensional data based on ensemble learning (EFS-GINI). Firstly, highly linearly correlated features are eliminated using the Spearman coefficient. Then, a feature selector based on the F-test is employed for the first stage selection. For the second stage, four feature subsets are formed using mutual information (MI), ReliefF, SURF, and SURF* filters in parallel. The third stage involves feature selection using a combinator based on GINI coefficient. Finally, a soft voting approach is proposed to employ for classification, including decision tree, naive Bayes, support vector machine (SVM), k-nearest neighbors (KNN) and random forest classifiers. To demonstrate the effectiveness and efficiency of the proposed algorithm, eight high-dimensional datasets are used and five feature selection methods are employed to compare with our proposed algorithm. Experimental results show that our method effectively enhances the accuracy and speed of feature selection. Moreover, to explore the biological significance of the proposed algorithm, we apply it on the renal cell carcinoma dataset GSE40435 from the Gene Expression Omnibus database. Two feature genes, NOP2 and NSUN5, are selected by our proposed algorithm. They are directly involved in regulating m5c RNA modification, which reveals the biological importance of EFS-GINI. Through bioinformatics analysis, we shows that m5C-related genes play an important role in the occurrence and progression of renal cell carcinoma, and are expected to become an important marker to predict the prognosis of patients.

Genetic Algorithm-Partial Least Squares Algorithm As the Feature Selection Method for Proteomics Data of Ovarian Cancer

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Ovarian Cancer Detection based on Dimensionality Reduction Techniques and Genetic Algorithm

Discrimination Analysis of Mass Spectrometry Proteomics for Ovarian Cancer Detection

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

A Cancer Gene Selection Algorithm Based on the K-S Test and CFS

An Integrated Approach Utilizing Proteomics and Bioinformatics to Detect Ovarian Cancer

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

An ensemble learning-based feature selection algorithm for identification of biomarkers of renal cell carcinoma

Using proteomic approaches to identify new biomarkers for detection and monitoring of ovarian cancer.

Multiclass Cancer Classification by Using Fuzzy Support Vector Machine and Binary Decision Tree with Gene Selection

Proteomic profiling of ovarian cancer in serum using magnetic bead based sample fractionation and MALDI-TOF MS

An Effective Gene Selection Method for Cancer Subtype Classification Based on Predatory Search Genetic Algorithm and Support Vector Machine

Proteomic Studies of Early-Stage and Advanced Ovarian Cancer Patients.

Gene Features Selection for Three-Class Disease Classification via Multiple Orthogonal Partial Least Square Discriminant Analysis and S-Plot Using Microarray Data

A hybrid feature selection algorithm combining information gain and grouping particle swarm optimization for cancer diagnosis

The Unsupervised Feature Selection Algorithms Based on Standard Deviation and Cosine Similarity for Genomic Data Analysis

Feature Selection and Classification of MAQC-II Breast Cancer and Multiple Myeloma Microarray Gene Expression Data

Feature Extraction in the Analysis of Proteomic Mass Spectra

Proteomic markers for early detection of ovarian cancer

Feature extraction for proteomics imaging mass spectrometry data