Abstract:Feature selection plays a crucial role in classification tasks as part of the data preprocessing process. Effective feature selection can improve the robustness and interpretability of learning algorithms, and accelerate model learning. However, traditional statistical methods for feature selection are no longer practical in the context of high-dimensional data due to the computationally complex. Ensemble learning, a prominent learning method in machine learning, has demonstrated exceptional performance, particularly in classification problems. To address the issue, we propose a three-stage feature selection algorithm framework for high-dimensional data based on ensemble learning (EFS-GINI). Firstly, highly linearly correlated features are eliminated using the Spearman coefficient. Then, a feature selector based on the F-test is employed for the first stage selection. For the second stage, four feature subsets are formed using mutual information (MI), ReliefF, SURF, and SURF* filters in parallel. The third stage involves feature selection using a combinator based on GINI coefficient. Finally, a soft voting approach is proposed to employ for classification, including decision tree, naive Bayes, support vector machine (SVM), k-nearest neighbors (KNN) and random forest classifiers. To demonstrate the effectiveness and efficiency of the proposed algorithm, eight high-dimensional datasets are used and five feature selection methods are employed to compare with our proposed algorithm. Experimental results show that our method effectively enhances the accuracy and speed of feature selection. Moreover, to explore the biological significance of the proposed algorithm, we apply it on the renal cell carcinoma dataset GSE40435 from the Gene Expression Omnibus database. Two feature genes, NOP2 and NSUN5, are selected by our proposed algorithm. They are directly involved in regulating m5c RNA modification, which reveals the biological importance of EFS-GINI. Through bioinformatics analysis, we shows that m5C-related genes play an important role in the occurrence and progression of renal cell carcinoma, and are expected to become an important marker to predict the prognosis of patients.

Feature selection with vector-symbolic architectures: a case study on microbial profiles of shotgun metagenomic samples of colorectal cancer

A Hybrid Feature Selection Algorithm and Its Application in Bioinformatics

Forward variable selection improves the power of random forest for high-dimensional microbiome data

Signature Genes Selection and Functional Analysis of Phenotypes: A Comparative Study

Enhancing metastatic colorectal cancer prediction through advanced feature selection and machine learning techniques

FS–GBDT: identification multicancer-risk module via a feature selection algorithm by integrating Fisher score and GBDT

A novel feature selection method based on quantum support vector machine

Using Machine Learning Methods to Study Colorectal Cancer Tumor Micro-Environment and Its Biomarkers.

Stable feature selection utilizing Graph Convolutional Neural Network and Layer-wise Relevance Propagation for biomarker discovery in breast cancer

Analysis of ensemble feature selection for correlated high-dimensional RNA-Seq cancer data

biosigner: A New Method for the Discovery of Significant Molecular Signatures from Omics Data

The Unsupervised Feature Selection Algorithms Based on Standard Deviation and Cosine Similarity for Genomic Data Analysis

Detecting Novel Hypermethylated Genes in Breast Cancer Benefiting from Feature Selection.

An ensemble learning-based feature selection algorithm for identification of biomarkers of renal cell carcinoma

A comprehensive evaluation framework for benchmarking multi-objective feature selection in omics-based biomarker discovery

Gene Selection for Cancer Classification using Support Vector Machines

A Robust Fuzzy Rule Based Integrative Feature Selection Strategy for Gene Expression Data in TCGA

An Ensemble Correlation-Based Gene Selection Algorithm for Cancer Classification with Gene Expression Data

Feature Selection and Classification of MAQC-II Breast Cancer and Multiple Myeloma Microarray Gene Expression Data

Inflammatory Bowel Disease Biomarkers of Human Gut Microbiota Selected via Ensemble Feature Selection Methods