Abstract:Feature selection plays a crucial role in classification tasks as part of the data preprocessing process. Effective feature selection can improve the robustness and interpretability of learning algorithms, and accelerate model learning. However, traditional statistical methods for feature selection are no longer practical in the context of high-dimensional data due to the computationally complex. Ensemble learning, a prominent learning method in machine learning, has demonstrated exceptional performance, particularly in classification problems. To address the issue, we propose a three-stage feature selection algorithm framework for high-dimensional data based on ensemble learning (EFS-GINI). Firstly, highly linearly correlated features are eliminated using the Spearman coefficient. Then, a feature selector based on the F-test is employed for the first stage selection. For the second stage, four feature subsets are formed using mutual information (MI), ReliefF, SURF, and SURF* filters in parallel. The third stage involves feature selection using a combinator based on GINI coefficient. Finally, a soft voting approach is proposed to employ for classification, including decision tree, naive Bayes, support vector machine (SVM), k-nearest neighbors (KNN) and random forest classifiers. To demonstrate the effectiveness and efficiency of the proposed algorithm, eight high-dimensional datasets are used and five feature selection methods are employed to compare with our proposed algorithm. Experimental results show that our method effectively enhances the accuracy and speed of feature selection. Moreover, to explore the biological significance of the proposed algorithm, we apply it on the renal cell carcinoma dataset GSE40435 from the Gene Expression Omnibus database. Two feature genes, NOP2 and NSUN5, are selected by our proposed algorithm. They are directly involved in regulating m5c RNA modification, which reveals the biological importance of EFS-GINI. Through bioinformatics analysis, we shows that m5C-related genes play an important role in the occurrence and progression of renal cell carcinoma, and are expected to become an important marker to predict the prognosis of patients.

ULDA-based heuristic feature selection method for proteomic profile analysis and biomarker discovery

Classification and feature selection of proteomic data by uncorrelated linear discriminant analysis

Proteomic Profile Analysis and Biomarker Discovery from Mass Spectra Using Independent Component Analysis Combined with Uncorrelated Linear Discriminant Analysis

Feature selection from proteomic mass spectrometric data using chemometric methods

Genetic Algorithm-Partial Least Squares Algorithm As the Feature Selection Method for Proteomics Data of Ovarian Cancer

Feature selection from proteomic mass spectrometric data using F-score and partial least square-discriminant analysis

A Hybrid Feature Selection Algorithm and Its Application in Bioinformatics

Uncorrelated linear discriminant analysis (ULDA): A powerful tool for exploration of metabolomics data

An Integrated Approach Utilizing Proteomics and Bioinformatics to Detect Ovarian Cancer

Using proteomic approaches to identify new biomarkers for detection and monitoring of ovarian cancer.

Discrimination Analysis of Mass Spectrometry Proteomics for Ovarian Cancer Detection

Urinary Hydrophilic and Hydrophobic Metabolic Profiling Based on Liquid Chromatography-Mass Spectrometry Methods: Differential Metabolite Discovery Specific to Ovarian Cancer

LDA Enhanced One-Bit Compressive Sensing Method for High-Throughput Mass Spectrometry Data Feature Selection

The Weight-Based Feature Selection (WBFS) Algorithm Classifies Lung Cancer Subtypes Using Proteomic Data

Profiling Ms Proteomics Data Using Smoothed Non-Linear Energy Operator and Bayesian Additive Regression Trees

Feature Extraction in the Analysis of Proteomic Mass Spectra

Proteomic profiling of ovarian cancer in serum using magnetic bead based sample fractionation and MALDI-TOF MS

An ensemble learning-based feature selection algorithm for identification of biomarkers of renal cell carcinoma

Ovarian Cancer Detection based on Dimensionality Reduction Techniques and Genetic Algorithm

Selection of Small Plasma Peptides for the Auxiliary Diagnosis and Prognosis of Epithelial Ovarian Cancer by Using UPLC/MS-based Nontargeted and Targeted Analyses.

Proteomic markers for early detection of ovarian cancer