Abstract:Data classification is a fundamental task in data mining. Within this field, the classification of multi-labeled data has been seriously considered in recent years. In such problems, each data entity can simultaneously belong to several categories. Multi-label classification is important because of many recent real-world applications in which each entity has more than one label. To improve the performance of multi-label classification, feature selection plays an important role. It involves identifying and removing irrelevant and redundant features that unnecessarily increase the dimensions of the search space for the classification problems. However, classification may fail with an extreme decrease in the number of relevant features. Thus, minimizing the number of features and maximizing the classification accuracy are two desirable but conflicting objectives in multi-label feature selection. In this article, we introduce a multi-objective optimization algorithm customized for selecting the features of multi-label data. The proposed algorithm is an enhanced variant of a decomposition-based multi-objective optimization approach, in which the multi-label feature selection problem is divided into single-objective subproblems that can be simultaneously solved using an evolutionary algorithm. This approach leads to accelerating the optimization process and finding more diverse feature subsets. The proposed method benefits from a local search operator to find better solutions for each subproblem. We also define a pool of genetic operators to generate new feature subsets based on old generation. To evaluate the performance of the proposed algorithm, we compare it with two other multi-objective feature selection approaches on eight real-world benchmark datasets that are commonly used for multi-label classification. The reported results of multi-objective method evaluation measures, such as hypervolume indicator and set coverage, illustrate an improvement in the results obtained by the proposed method. Moreover, the proposed method achieved better results in terms of classification accuracy with fewer features compared with state-of-the-art methods.

An evolutionary multiobjective method based on dominance and decomposition for feature selection in classification

A Multi-Task Decomposition-Based Evolutionary Algorithm for Tackling High-Dimensional Bi-Objective Feature Selection

Feature Selection Using Diversity-Based Multi-objective Binary Differential Evolution

Multiobjective Differential Evolution for Feature Selection in Classification

Differential Evolution Based Feature Selection: A Niching-based Multi-objective Approach

A bidirectional dynamic grouping multi-objective evolutionary algorithm for feature selection on high-dimensional classification

A Hybrid Initialization and Effective Reproduction-Based Evolutionary Algorithm for Tackling Bi-Objective Large-Scale Feature Selection in Classification

An Information-Based Elite-Guided Evolutionary Algorithm for Multi-Objective Feature Selection

Multi-objective Differential Evolution Algorithm for Multi-label Feature Selection in Classification.

Binary Differential Evolution with Self-Learning for Multi-Objective Feature Selection.

A Survey on Evolutionary Multiobjective Feature Selection in Classification: Approaches, Applications, and Challenges

Feature Selection Based on a Large-Scale Many-Objective Evolutionary Algorithm

An evolutionary multi-objective optimization framework of discretization-based feature selection for classification

A Decomposition based Multiobjective Evolutionary Algorithm with Semi-Supervised Classification

An evolutionary decomposition-based multi-objective feature selection for multi-label classification

MPEA-FS: A decomposition-based multi-population evolutionary algorithm for high-dimensional feature selection

Information Gain-based Multi-objective Evolutionary Algorithm for Feature Selection

A Knowledge-Guided Competitive Co-Evolutionary Algorithm for Feature Selection

Balancing Different Optimization Difficulty Between Objectives in Multi-Objective Feature Selection

Multi-objective unsupervised feature selection algorithm utilizing redundancy measure and negative epsilon-dominance for fault diagnosis.

A binary individual search strategy-based bi-objective evolutionary algorithm for high-dimensional feature selection