Abstract:Recently, some existing feature selection approaches neglect the correlation among labels, and almost manifold-based multilabel learning models do not considered the relationship between features and labels, which result in reducing classification effect. To overcome the shortcomings, our work develops a fresh sparse feature selection approach via local feature and high-order label correlation. First, the sparse processing is performed by applying the l 2,1 norm on the weight coefficient matrix, and a loss function between the sample and label matrices can be established to explore the potential relationship between features and labels. The designed loss function can be directly sparse by the weight coefficient matrix, which calculates this weight of each feature, and then some features with higher scores are selected. Second, the combination of manifold learning and Laplacian score is used to deal with local features to make full use of local feature correlation. The manifold regularization for the embedded feature selection can guide exploring potential real labels and selecting different features for individual labels. Finally, to safeguard the rank of the high-order label matrix from being damaged, a self-representation strategy is employed. Then the high-order label weight matrix and the label error term are defined to enhance the accuracy of label self-representation and correct the deviation between the self-representation scheme and the real label, and the Frobenius and the l 2 norm regularization can avoid those trivial solutions and overfitting issues. A representation function of high-order label correlation is proposed based on the self-representation strategy, which can accurately represent the potential information between high-order labels. Thus, those local features are scored by the Laplacian score for different features to select an optimal feature subset with higher scores. Experiments on 16 multilabel datasets illustrate that our constructed algorithm will be efficient in obtaining important feature set and implementing powerful classification efficacy on multilabel classification.

Manifold Regularized Discriminative Feature Selection for Multi-Label Learning

Fuzzy Neighborhood-Based Manifold Learning and Feature Weight Matrix for Multilabel Feature Selection

Multi-label feature selection via spectral clustering-based label enhancement and manifold distribution consistency

Multi-task Joint Feature Selection for Multi-label Classification

Label Correlations-Based Multi-Label Feature Selection with Label Enhancement

Semi-supervised Multi-Label Feature Selection with Adaptive Structure Learning and Manifold Learning

Multi-label feature selection based on stable label relevance and label-specific features

Label Correlation Guided Feature Selection for Multi-label Learning.

Multi-label feature selection by strongly relevant label gain and label mutual aid

Integrating Global and Local Feature Selection for Multi-Label Learning

Multi-label feature selection via constraint mapping space regularization

Geodesic Based Semi-supervised Multi-manifold Feature Extraction

Sparse Feature Selection Via Local Feature and High-Order Label Correlation

Non-negative multi-label feature selection with dynamic graph constraints

Multi-label Feature Selection Based on Correlation Label Enhancement

Multi-Label Feature Selection Via Positive or Negative Correlation.

Partial Multi-Label Learning with Global and Local Manifold Disambiguation

Joint Feature Selection and Classification for Multilabel Learning

Joint Multi-Label Classification and Label Correlations with Missing Labels and Feature Selection

Discriminative Sparse Subspace Learning with Manifold Regularization

Multi-Label Feature Selection Based on High-Order Label Correlation Assumption