Abstract:Feature extraction is significant for pattern analysis and classification. Those based on genetic algorithms are promising owing to their potential parallelizability and possible applications in large scale and high dimensional data classification. Most recently, Zhao et al. presented a direct evolutionary feature extraction algorithm(DEFE) which can reduce the space complexity and improve the efficiency, thus overcoming the limitations of many genetic algorithm based feature extraction algorithms(EFE). However, DEFE does not consider the outlier problem which could deteriorate the classification performance, especially when the training sample set is small. Moreover when there are many classes, the null space of within-class scatter matrix(S-omega) becomes small, resulting in poor discrimination performance in that space. In this paper we propose a bagging evolutionary feature extraction algorithm(BEFE) incorporating bagging into a revised DEFE algorithm to improve the DEFE's performance in cases of small training sets and large number of classes. The proposed algorithm has been applied to face recognition and testified using the Yale and ORL face databases. Feature extraction is significant for pattern analysis and classification. Those based on genetic algorithms are promising owing to their potential parallelizability and possible applications in large scale and high dimensional data classification. Most recently, Zhao et al. presented a direct evolutionary feature extraction algorithm(DEFE) which can reduce the space complexity and improve the efficiency, thus overcoming the limitations of many geneti. c algorithm basedJeature extraction algorithms(EFE). However, DEFE does not consider the outlier problem which could deteriorate the classification performance, especially when the training sample set is small. Moreover when there are many classes, the null space of within-class scatter matrix(S-omega) becomes small, resulting in poor discrimination performance in that space. In this paper we propose a bagging evolutionary feature extraction algorithm(BEFE) incorporating bagging into a revised DEFE algorithm to improve the DEFE's performance in cases of small training sets and large number of classes. The proposed algorithm has been applied to face recognition and testified using the Yale and ORLJace databases.

Evolutionary Automated Feature Engineering

Visible-hidden Hybrid Automatic Feature Engineering Via Multi-Agent Reinforcement Learning

Toward Efficient Automated Feature Engineering

DIFER: Differentiable Automated Feature Engineering

Enhancing the Precision of Redundant Data in Feature Extraction by an Improved Evolutionary Algorithm

DAFEE: A Scalable Distributed Automatic Feature Engineering Algorithm for Relational Datasets

AEFE: Automatic Embedded Feature Engineering for Categorical Features

Feature Selection Based on a Large-Scale Many-Objective Evolutionary Algorithm

Beyond Deep Learning: An Evolutionary Feature Engineering Approach to Tabular Data Classification

Cross-data Automatic Feature Engineering via Meta-learning and Reinforcement Learning.

Evolutionary Large Language Model for Automated Feature Transformation

Bagging Evolutionary Feature Extraction Algorithm For Classification

A Method To Study Evolutionary Algorithm: Feature Analysis

Catch: Collaborative Feature Set Search for Automated Feature Engineering

A Knowledge-Guided Competitive Co-Evolutionary Algorithm for Feature Selection

Learning Features for Discriminative Behavior Analysis of Evolutionary Algorithms Via Slow Feature Analysis

Feature Selection in High-Dimensional Classification Via an Adaptive Multifactor Evolutionary Algorithm with Local Search

High-dimensional Feature Selection in Classification: A Length-Adaptive Evolutionary Approach.

Adaptive Differential Evolution Based on Exploration and Exploitation Control

Automatic Financial Feature Construction

Automatic Feature Engineering by Deep Reinforcement Learning