Abstract:With the rapid advancement of big data technology, high-dimensional datasets comprising multi-label data have become prevalent in various fields. However, these datasets often contain more relevant and redundant features, which can adversely affect the performance of machine learning algorithms. Multi-label feature selection (MLFS) has emerged as a crucial pre-processing step in multi-label learning to address this issue. This survey provides an overview of multi-label learning and its algorithms, including problem transformation and algorithm adaptation. We also introduced three traditional strategies for MLFS: filter, wrapper, and embedded-based methods. Furthermore, we categorize existing research on multi-label feature selection into six aspects based on label fusion: label transformation-based (Binary Relevance-based and Label Powerset-based), label correlation-based (second and high-order, high and hybrid order), label specific-based, semi-supervised -learning-based, missing and noisy labels-based, and label enhancement-based approaches. We provide a detailed introduction to each method's common approaches and theories. Additionally, we conduct experimental comparisons on practical multi-label learning datasets to evaluate the advantages and disadvantages of different algorithms. We discuss the application of multi-label feature selection in various domains, such as data mining, computer vision, natural language processing, and bio-informatics. Finally, we outline potential future research directions in multi-label feature selection, including MLFS with online learning, active learning, label distribution learning, partial label learning, granular computing, and class-imbalanced learning.

Multi-label learning with label-specific feature reduction.

Multi-label Learning with Label-Specific Feature Selection

Multi-label Learning with Relief-based Label-Specific Feature Selection

Label-Specific Features on Multi-Label Learning Algorithm

Lift: Multi-Label Learning with Label-Specific Features

Common-Individual Semantic Fusion for Multi-View Multi-Label Learning

Multi-label learning based on neighborhood rough set label-specific features

ReliefF-based Multi-label Feature Selection

Group-preserving Label-Specific Feature Selection for Multi-Label Learning

Multi-label Learning with Label-Specific Features Via Clustering Ensemble

Multi-label feature selection based on stable label relevance and label-specific features

Feature Selection for Multi-Label Learning Based on Kernelized Fuzzy Rough Sets

Joint Feature Selection and Classification for Multilabel Learning

Multi-label feature selection based on fuzzy rough sets with metric learning and label enhancement

Partial Multi-label Learning with Label and Feature Collaboration

Learning Label-Specific Features for Multi-Label Classification with Missing Labels

Improving Multi-Label Classification with Missing Labels by Learning Label-Specific Features

A Survey on Multi-Label Feature Selection from Perspectives of Label Fusion.

Multi-Label Learning Through Label-Specific Features with Entropy Guided Clustering

LEFMIFS: Label enhancement and fuzzy mutual information for robust multilabel feature selection

MULFE: Multi-Label Learning via Label-Specific Feature Space Ensemble