Abstract:Multi-label feature selection can effectively improve the performance and efficiency of subsequent learning tasks by selecting important features within multi-label data. However, for handling multiple labels, many approaches group them to gather insights for label fusion, but ignore the different importance of these label groups and treat them equally, which seems unfair to individual label groups and fails to consider their distinct significances. Moreover, for handling the relationship between features and labels, many multi-label feature selection methods efficiently achieve linear fitting of features and labels through manifold learning, but ignore fitting spatial distribution between feature space and label space. Motivated by these, this paper integrates label distribution learning and spectral clustering to evaluate the unique significance of each label group and construct an improved label space, which is then aligned with the feature space through manifold distribution consistency for multi-label feature selection. First, we propose a hypothetical model indicating the existence of a relationship among labels, wherein this relationship involves clustering subordinate labels around a central core label. On this basis, we employ spectral clustering to generate distinct label clusters by integrating density peaks, thereafter combining this with label distribution learning to assess the significance of each cluster. Then, we design a manifold distribution consistency evaluation, i.e., quantifying the structural disparity between feature space and the enhanced label space achieved through spectral clustering-based label enhancement strategy, so as to obtain a low-dimensional feature space and the optimal feature subset. Finally, experimental results showcase the superiority of our proposed multi-label feature selection algorithm when compared with five other algorithms, across several datasets from diverse domains.

Probability-based Label Enhancement for Multi-Dimensional Classification

Multi-Dimensional Classification via Decomposed Label Encoding

Learning from Multi-Dimensional Partial Labels.

Dual Enhancement for Multi-Label Learning with Missing Labels

Maximum Margin Multi-Dimensional Classification

Scalable Label Distribution Learning for Multi-Label Classification

Incorporating Label Embedding and Feature Augmentation for Multi-Dimensional Classification.

Revisiting multi-dimensional classification from a dimension-wise perspective

Label Correlations-Based Multi-Label Feature Selection with Label Enhancement

LCBM: A Multi-View Probabilistic Model for Multi-Label Classification

Partial Multi-label Learning with Label and Feature Collaboration

Multi-label feature selection via spectral clustering-based label enhancement and manifold distribution consistency

Label Disentanglement in Partition-based Extreme Multilabel Classification

A hybrid principal label space transformation-based ridge regression and decision tree for multi-label classification

A Label Embedding Method via Conditional Covariance Maximization for Multi-label Classification.

Privileged Label Enhancement with Multi-Label Learning.

Label distribution for multimodal machine learning

A Generative Probabilistic Model for Multi-label Classification

Partial Classifier Chains with Feature Selection by Exploiting Label Correlation in Multi-Label Classification

Multi-label Text Classification Based on the Label Correlation Mixture Model.

Dynamic Ensemble Learning for Multi-label Classification