Abstract:With the rapid advancement of big data technology, high-dimensional datasets comprising multi-label data have become prevalent in various fields. However, these datasets often contain more relevant and redundant features, which can adversely affect the performance of machine learning algorithms. Multi-label feature selection (MLFS) has emerged as a crucial pre-processing step in multi-label learning to address this issue. This survey provides an overview of multi-label learning and its algorithms, including problem transformation and algorithm adaptation. We also introduced three traditional strategies for MLFS: filter, wrapper, and embedded-based methods. Furthermore, we categorize existing research on multi-label feature selection into six aspects based on label fusion: label transformation-based (Binary Relevance-based and Label Powerset-based), label correlation-based (second and high-order, high and hybrid order), label specific-based, semi-supervised -learning-based, missing and noisy labels-based, and label enhancement-based approaches. We provide a detailed introduction to each method's common approaches and theories. Additionally, we conduct experimental comparisons on practical multi-label learning datasets to evaluate the advantages and disadvantages of different algorithms. We discuss the application of multi-label feature selection in various domains, such as data mining, computer vision, natural language processing, and bio-informatics. Finally, we outline potential future research directions in multi-label feature selection, including MLFS with online learning, active learning, label distribution learning, partial label learning, granular computing, and class-imbalanced learning.

A novel feature selection approach with Pareto optimality for multi-label data

A Multi-Objective Multi-Label Feature Selection Algorithm Based on Shapley Value

Multi-label feature selection based on stable label relevance and label-specific features

Multi-label feature selection by strongly relevant label gain and label mutual aid

Feature Selection for Multi-label Learning: A Systematic Literature Review and Some Experimental Evaluations

Enhanced multi-label feature selection considering label-specific relevant information

Parallel dual-channel multi-label feature selection

Label Correlation Guided Feature Selection for Multi-label Learning.

Multi-label feature selection based on HSIC and sparrow search algorithm

A Survey on Multi-Label Feature Selection from Perspectives of Label Fusion.

Novel multi-label feature selection via label enhancement and relative maximal discernibility pairs

Multiple reference points-based multi-objective feature selection for multi-label learning

Multi-Label Feature Selection via Label Enhancement and Analytic Hierarchy Process

Feature Selection For Multi-Label Learning Using Mutual Information And Ga

Multi-label feature selection with high-sparse personalized and low-redundancy shared common features

Multi-Label Feature Selection Based on High-Order Label Correlation Assumption

Multi-Label Feature Selection Via Positive or Negative Correlation.

Dual Sparse Structured Subspaces and Graph Regularisation for Particle Swarm Optimisation-Based Multi-Label Feature Selection

Label relaxation and shared information for multi-label feature selection

Multi-Label Feature Selection Method Combining Unbiased Hilbert-Schmidt Independence Criterion With Controlled Genetic Algorithm

Fast Multilabel Feature Selection via Global Relevance and Redundancy Optimization