Abstract:Data classification is a fundamental task in data mining. Within this field, the classification of multi-labeled data has been seriously considered in recent years. In such problems, each data entity can simultaneously belong to several categories. Multi-label classification is important because of many recent real-world applications in which each entity has more than one label. To improve the performance of multi-label classification, feature selection plays an important role. It involves identifying and removing irrelevant and redundant features that unnecessarily increase the dimensions of the search space for the classification problems. However, classification may fail with an extreme decrease in the number of relevant features. Thus, minimizing the number of features and maximizing the classification accuracy are two desirable but conflicting objectives in multi-label feature selection. In this article, we introduce a multi-objective optimization algorithm customized for selecting the features of multi-label data. The proposed algorithm is an enhanced variant of a decomposition-based multi-objective optimization approach, in which the multi-label feature selection problem is divided into single-objective subproblems that can be simultaneously solved using an evolutionary algorithm. This approach leads to accelerating the optimization process and finding more diverse feature subsets. The proposed method benefits from a local search operator to find better solutions for each subproblem. We also define a pool of genetic operators to generate new feature subsets based on old generation. To evaluate the performance of the proposed algorithm, we compare it with two other multi-objective feature selection approaches on eight real-world benchmark datasets that are commonly used for multi-label classification. The reported results of multi-objective method evaluation measures, such as hypervolume indicator and set coverage, illustrate an improvement in the results obtained by the proposed method. Moreover, the proposed method achieved better results in terms of classification accuracy with fewer features compared with state-of-the-art methods.

Learning Label-Specific Features for Decomposition-Based Multi-Class Classification

Decompose Learning: Combine Feature Extraction and Classification

Image Classification Method by Combining Multi-features and Sparse Coding

Towards Enabling Binary Decomposition for Partial Multi-Label Learning

Automatic Feature Extraction Based Structure Decomposition Method for Multi-Classification

Multi-Dimensional Classification via Decomposed Label Encoding

Learning Disentangled Label Representations for Multi-label Classification

Two-Stage Label Embedding Via Neural Factorization Machine for Multi-Label Classification

An evolutionary decomposition-based multi-objective feature selection for multi-label classification

Multi-Label Classification with Label-Specific Feature Generation: A Wrapped Approach

A Divide-and-Conquer Approach for Large-Scale Multi-label Learning

Learning Common and Label-Specific Features for Multi-Label Classification With Missing Labels

Multi-scale and Discriminative Part Detectors Based Features for Multi-label Image Classification.

Binary Linear Compression for Multi-label Classification.

Feature decomposition and structural learning for multi-diverse and multi-view data clustering

A Novel Feature Decomposition Method To Develop Multi-Hierarchy Model

Multi-label Classification: Dealing with Imbalance by Combining Labels

Label Disentanglement in Partition-based Extreme Multilabel Classification

Lift: Multi-Label Learning with Label-Specific Features

Learning common and label-specific features for multi-Label classification with correlation information

Multi-Label Hyperspectral Classification with Discriminative Features.