Abstract:Feature selection plays a crucial role in classification tasks as part of the data preprocessing process. Effective feature selection can improve the robustness and interpretability of learning algorithms, and accelerate model learning. However, traditional statistical methods for feature selection are no longer practical in the context of high-dimensional data due to the computationally complex. Ensemble learning, a prominent learning method in machine learning, has demonstrated exceptional performance, particularly in classification problems. To address the issue, we propose a three-stage feature selection algorithm framework for high-dimensional data based on ensemble learning (EFS-GINI). Firstly, highly linearly correlated features are eliminated using the Spearman coefficient. Then, a feature selector based on the F-test is employed for the first stage selection. For the second stage, four feature subsets are formed using mutual information (MI), ReliefF, SURF, and SURF* filters in parallel. The third stage involves feature selection using a combinator based on GINI coefficient. Finally, a soft voting approach is proposed to employ for classification, including decision tree, naive Bayes, support vector machine (SVM), k-nearest neighbors (KNN) and random forest classifiers. To demonstrate the effectiveness and efficiency of the proposed algorithm, eight high-dimensional datasets are used and five feature selection methods are employed to compare with our proposed algorithm. Experimental results show that our method effectively enhances the accuracy and speed of feature selection. Moreover, to explore the biological significance of the proposed algorithm, we apply it on the renal cell carcinoma dataset GSE40435 from the Gene Expression Omnibus database. Two feature genes, NOP2 and NSUN5, are selected by our proposed algorithm. They are directly involved in regulating m5c RNA modification, which reveals the biological importance of EFS-GINI. Through bioinformatics analysis, we shows that m5C-related genes play an important role in the occurrence and progression of renal cell carcinoma, and are expected to become an important marker to predict the prognosis of patients.

A multilevel optimal feature selection and ensemble learning for a specific CAD system-pulmonary nodule detection

A Multilevel Optimal Feature Selection and Ensemble Learning for a Specific CAD System-Pulmonary Nodule Detection

A Practical Feature Selection Based On An Optimal Feature Subset And Its Application For Detecting Lung Nodules In Chest Radiographs

A Multi-Kernel Based Framework for Heterogeneous Feature Selection and Over-Sampling for Computer-Aided Detection of Pulmonary Nodules

An Automatic and Efficient Pulmonary Nodule Detection System Based on Multi-Model Ensemble

Unsupervised Representation Learning for Pulmonary Nodule Classification

A ROC-based Feature Selection Method for Computer-Aided Detection and Diagnosis

Feature Selection and Classification Algorithm for Region of Interest in Lung Cancer CAD System

An ensemble learning-based feature selection algorithm for identification of biomarkers of renal cell carcinoma

Feature selection based on dynamic crow search algorithm for high-dimensional data classification

Unsupervised feature selection algorithm with a multi-objective evolutionary model for fault diagnosis

Improvement of Feature Selection in Multi-phase CT Images of Hepatic Lesions

Feature selection using feature ranking, correlation analysis and chaotic binary particle swarm optimization

Lung Nodule Detection Based on the Combination of Morphometric and Texture Features

Automatically detecting lung nodules based on shape descriptor and semi-supervised learning

Lung Nodules Detection System Using Support Vector Machine Classifier Combined Linear Discriminant Analysis-Based Feature Selection with Rule-Based Feature Pruning

Pulmonary Nodule Classification Using a Multiview Residual Selective Kernel Network

Optimal Combination of Feature Selection and Classification Via Local Hyperplane Based Learning Strategy

Differential Evolution Based Feature Selection: A Niching-based Multi-objective Approach

Computer-aided Detection of Pulmonary Nodules Using Dynamic Self-Adaptive Template Matching and a FLDA Classifier.

Research on Key Algorithms of the Lung CAD System Based on Cascade Feature and Hybrid Swarm Intelligence Optimization for MKL-SVM