Abstract:In the era of big data, the amount of class labels is growing rapidly, which poses a great challenge to classification tasks. The hierarchical classification was thus introduced to address this issue by considering the structural information between different class labels. In this paper, we propose an incremental feature selection algorithm for handling the arrival of new samples by using the theory of fuzzy rough sets. As a preliminary step, we propose a non-incremental hierarchical feature selection algorithm, which is an improved version of the existing method. Then utilizing the sibling strategy, the incremental calculation of the dependency degree at the arrival of samples is discussed. Based on the analysis of dependency degree change, we design feature addition and deletion strategies, as well as the incremental feature selection algorithm. In the experimental section, two versions of algorithms are designed. The experimental results show that our improvement of the existing method is highly effective and can significantly accelerate the process of feature selection. In addition, version 2 of the incremental algorithm exhibits much higher efficiency than the improved non-incremental algorithm on several datasets, as well as the existing method. Compared to six hierarchical feature selection algorithms, our algorithm achieves better results on the classification accuracy and three hierarchical evaluation metrics. The effectiveness and efficiency of version 1 are also verified by the comparison of version 2 and other results.

Feature selection in growing dimensional space for classification based on neural incremental attribute learning

Neural Incremental Attribute Learning in Groups.

Evolving Linear Discriminant in a Continuously Growing Dimensional Space for Incremental Attribute Learning.

CLDA: Feature Selection for Text Categorization Based on Constrained LDA

Incremental Subgraph Feature Selection for Graph Classification.

Statistical Discriminability Estimation for Pattern Classification Based on Neural Incremental Attribute Learning

Feature Discriminability for Pattern Classification Based on Neural Incremental Attribute Learning

OPTIMIZED NEURAL INCREMENTAL ATTRIBUTE LEARNING FOR CLASSIFICATION BASED ON STATISTICAL DISCRIMINABILITY

Neural Incremental Attribute Learning Based on Principal Component Analysis

Integrated Feature Preprocessing for Classification Based on Neural Incremental Attribute Learning.

Ordered Incremental Attribute Learning based on mRMR and Neural Networks

Regression Based on Neural Incremental Attribute Learning with Correlation-Based Feature Ordering

Linear Feature Sensibility for Output Partitioning in Ordered Neural Incremental Attribute Learning.

Feature Ordering for Neural Incremental Attribute Learning Based on Fisher's Linear Discriminant

Output Effect Evaluation Based on Input Features in Neural Incremental Attribute Learning for Better Classification Performance

Pattern Classification with Ordered Features Using Mrmr and Neural Networks

Uncertainty Measure-Based Incremental Feature Selection For Hierarchical Classification

Adaptive Feature Selection With Augmented Attributes

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Fuzzy Rough Sets-Based Incremental Feature Selection for Hierarchical Classification

Incremental feature selection for large-scale hierarchical classification with the arrival of new samples