Abstract:Feature ordering is a significant data preprocessing method in Incremental Attribute Learning (IAL), a novel machine learning approach which gradually trains features according to a given order. Previous research has shown that, similar to feature selection, feature ordering is also important based on each feature's discrimination ability, and should be sorted in a descending order of their discrimination ability. However, such an ordering is crucial for the performance of IAL. As the number of feature dimensions in IAL is increasing, feature discrimination ability also should be calculated in the corresponding incremental way. Based on Single Discriminability (SD), where only the feature discrimination ability is computed, a new filter statistical feature discrimination ability predictive metric, called the Accumulative Discriminability (AD), is designed for the dynamical feature discrimination ability estimation. Moreover, a criterion that summarizes all the produced values of AD is employed with a GA (Genetic Algorithm)-based approach to obtain the optimum feature ordering for classification problems based on neural networks by means of IAL. Compared with the feature ordering obtained by other approaches, the method proposed in this paper exhibits better performance in the final classification results. Such a phenomenon indicates that, (i) the feature discrimination ability should be incrementally estimated in IAL, and (ii) the feature ordering derived by AD and its corresponding approaches are applicable with IAL.

Feature Ordering for Neural Incremental Attribute Learning Based on Fisher's Linear Discriminant

Feature Discriminability for Pattern Classification Based on Neural Incremental Attribute Learning

Linear Feature Sensibility for Output Partitioning in Ordered Neural Incremental Attribute Learning.

OPTIMIZED NEURAL INCREMENTAL ATTRIBUTE LEARNING FOR CLASSIFICATION BASED ON STATISTICAL DISCRIMINABILITY

Statistical Discriminability Estimation for Pattern Classification Based on Neural Incremental Attribute Learning

Ordered Incremental Attribute Learning based on mRMR and Neural Networks

Evolving Linear Discriminant in a Continuously Growing Dimensional Space for Incremental Attribute Learning.

Regression Based on Neural Incremental Attribute Learning with Correlation-Based Feature Ordering

Neural Incremental Attribute Learning in Groups.

Feature selection in growing dimensional space for classification based on neural incremental attribute learning

Integrated Feature Preprocessing for Classification Based on Neural Incremental Attribute Learning.

Pattern Classification with Ordered Features Using Mrmr and Neural Networks

Neural Incremental Attribute Learning Based on Principal Component Analysis

FisherMask: Enhancing Neural Network Labeling Efficiency in Image Classification Using Fisher Information

Adaptive Quasiconformal Kernel Fisher Discriminant Analysis Via Weighted Maximum Margin Criterion

Output Effect Evaluation Based on Input Features in Neural Incremental Attribute Learning for Better Classification Performance

Improved kernel direct Fisher discriminant analysis and face recognition

Incremental Fisher linear discriminant based on data denoising

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

An Extension of Fisher's Criterion: Theoretical Results with a Neural Network Realization

Feature screening for ultrahigh-dimensional binary classification via linear projection