Abstract:With the rapid advancement of big data technology, high-dimensional datasets comprising multi-label data have become prevalent in various fields. However, these datasets often contain more relevant and redundant features, which can adversely affect the performance of machine learning algorithms. Multi-label feature selection (MLFS) has emerged as a crucial pre-processing step in multi-label learning to address this issue. This survey provides an overview of multi-label learning and its algorithms, including problem transformation and algorithm adaptation. We also introduced three traditional strategies for MLFS: filter, wrapper, and embedded-based methods. Furthermore, we categorize existing research on multi-label feature selection into six aspects based on label fusion: label transformation-based (Binary Relevance-based and Label Powerset-based), label correlation-based (second and high-order, high and hybrid order), label specific-based, semi-supervised -learning-based, missing and noisy labels-based, and label enhancement-based approaches. We provide a detailed introduction to each method's common approaches and theories. Additionally, we conduct experimental comparisons on practical multi-label learning datasets to evaluate the advantages and disadvantages of different algorithms. We discuss the application of multi-label feature selection in various domains, such as data mining, computer vision, natural language processing, and bio-informatics. Finally, we outline potential future research directions in multi-label feature selection, including MLFS with online learning, active learning, label distribution learning, partial label learning, granular computing, and class-imbalanced learning.

A Review on Multi-Label Learning Algorithms

A Review on Multi-Label Learning Algorithms

A survey of multi-label classification based on supervised and semi-supervised learning

A Survey on Incomplete Multi-label Learning: Recent Advances and Future Trends

Deep Learning for Multi-Label Learning: A Comprehensive Survey

A Taxonomy of Label Ranking Algorithms.

A Survey on Multi-Label Feature Selection from Perspectives of Label Fusion.

The Emerging Trends of Multi-Label Learning

Multi-Instance Multi-Label Learning with Application to Scene Classification

Multi-Label Learning with Emerging New Labels

Multi-label Ranking: Mining Multi-label and Label Ranking Data

Multi-Label Learning with Block Diagonal Labels

ML-KNN: A lazy learning approach to multi-label learning

Multi-Instance Learning: A Survey

Multi-instance multi-label new label learning

Exploiting Label Relationship in Multi-Label Learning

A Divide-and-Conquer Approach for Large-Scale Multi-label Learning

Feature Selection for Multi-label Learning: A Systematic Literature Review and Some Experimental Evaluations

Multi-label Classification via Label-Topic Pairs

Dual Set Multi-Label Learning

Multi-Label Classification Algorithm Based on Association Rule Mining