Abstract:The identification of suitable feature subsets from High-Dimensional Low-Sample-Size (HDLSS) data is of paramount importance because this dataset often contains numerous redundant and irrelevant features, leading to poor classification performance. However, the selection of an optimal feature subset from a vast feature space creates a significant computational challenge. In the domain of HDLSS data, conventional feature selection methods often face challenges in achieving a balance between reducing the number of features and preserving high classification accuracy. Addressing these issues, the study introduces an effective framework that employs a filter and wrapper-based strategy specifically designed to address the classification challenges inherent in HDLSS data. The framework adopts a multi-step approach where ensemble feature selection integrates five filter ranking approaches: Chi-square ( ), Gini index (GI), F-score, Mutual Information (MI), and Symmetric uncertainty (SU) to identify the top-ranking features. In the subsequent stage, a wrapper-based search method is utilized, which employs the Differential Evaluation (DE) metaheuristic algorithm as the search strategy. The fitness of feature subsets during this search is assessed based on a weighted combination of the error rate of the Support Vector Machine (SVM) classifier and the ratio of feature cardinality. The datasets, after undergoing dimensionality reduction, are then utilized to construct classification models using SVM, K-Nearest Neighbors (KNN), and Logistic Regression (LR). The approach was evaluated on 13 HDLSS datasets to assess its efficacy in selecting appropriate feature subsets and improving Classification Accuracy (ACC) analog with Area Under the Curve (AUC). Results show that the proposed ensemble with wrapper-based approach produces a smaller number of features (ranging between 2 and 9 for all datasets), while maintaining a commendable average AUC and ACC (between 98% and 100%). The comparative analysis reveals that the proposed method surpasses both ensemble feature selection and non-feature selection approaches in terms of feature reduction and ACC. Additionally, when compared to various other state-of-the-art methods, this approach demonstrates commendable performance.

Efficient feature selection using one-pass generalized classifier neural network and binary bat algorithm with a novel fitness function

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A Novel Unsupervised Feature Selection Approach Using Genetic Algorithm on Partitioned Data

An efficient binary chimp optimization algorithm for feature selection in biomedical data classification

A novel hybrid wrapper–filter approach based on genetic algorithm, particle swarm optimization for feature subset selection

Feature Subset Selection for High-Dimensional, Low Sampling Size Data Classification Using Ensemble Feature Selection With a Wrapper-Based Search

Improving Performance of the k-Nearest Neighbor Classifier by Combining Feature Selection with Feature Weighting.

An Efficient High-Dimensional Gene Selection Approach based on Binary Horse Herd Optimization Algorithm for Biological Data Classification

Feature Selection Using Localized Generalization Error for Supervised Classification Problems Using RBFNN

Two-stage improved Grey Wolf optimization algorithm for feature selection on high-dimensional classification

A General Wrapper Approach to Selection of Class-Dependent Features

Feature selection using feature ranking, correlation analysis and chaotic binary particle swarm optimization

Performance enhancement of classifiers through Bio inspired feature selection methods for early detection of lung cancer from microarray genes

A GA-like Dynamic Probability Method With Mutual Information for Feature Selection

Parallel Immune Clonal Selection for Feature Selection

Bio-Inspired Feature Selection Via an Improved Binary Golden Jackal Optimization Algorithm

Supervised Feature Selection via Collaborative Neurodynamic Optimization

Feature Selection Using a Neural Framework With Controlled Redundancy

Feature selection based on dataset variance optimization using Hybrid Sine Cosine – Firehawk Algorithm (HSCFHA)

Binary northern goshawk optimization for feature selection on micro array cancer datasets

High-dimensional Feature Selection in Classification: A Length-Adaptive Evolutionary Approach.