Abstract:As for single-label learning, feature selection has become a crucial data pre-processing tool for multi-label learning due to its ability to reduce the feature dimensionality to mitigate the influence of “the curse of dimensionality”. In recent years, the multi-label feature selection (MFS) methods based on manifold learning and sparse regression have confirmed their superiority and gained more and more attention than other methods. However, most of these methods only consider exploiting the geometric structure distributed in the data manifold but ignore the geometric structure distributed in the feature manifold, resulting in incomplete information about the learned manifold. Aiming to simultaneously exploit the geometric information of data and feature spaces for feature selection, this paper proposes a novel MFS method named dual-graph based multi-label feature selection (DGMFS). In the framework of DGMFS, two nearest neighbor graphs are constructed to form a dual-graph regularization to explore the geometric structures of both the data manifold and the feature manifold simultaneously. Then, we combined the dual-graph regularization with a non-convex sparse regularization l 2,1 − 2 -norm to obtain a more sparse solution for the weight matrix, which can better deal with the redundancy features. Finally, we adopt the EM strategy to design an iterative updating optimization algorithm for DGMFS and provide the convergence analysis of the optimization algorithm. Extensive experimental results on ten benchmark multi-label data sets have shown that DGMFS is more effective than several state-of-the-art MFS methods.

Multi-label Feature Selection Via Robust Flexible Sparse Regularization

Multi-label Feature Selection Based on Manifold Regularization and Imbalance Ratio

Robust Feature Selection with Feature Correlation Via Sparse Multi-Label Learning

Multi-label feature selection based on stable label relevance and label-specific features

Multi-label feature selection with high-sparse personalized and low-redundancy shared common features

A Discriminative Multi-Class Feature Selection Method Via Weighted L2, 1-Norm and Extended Elastic Net

Semi-Supervised Multi-Label Feature Selection Based on Sparsity Regularization and Dependence Maximization

Dual-graph with Non-Convex Sparse Regularization for Multi-Label Feature Selection

Robust sparse and low-redundancy multi-label feature selection with dynamic local and global structure preservation

Multi-class feature selection via Sparse Softmax with a discriminative regularization

Multi-class Feature Selection Based on Softmax with $$L_{2,0}$$-Norm Regularization

Robust Feature Selection Via Simultaneous Sapped Norm and Sparse Regularizer Minimization

Manifold Regularized Discriminative Feature Selection for Multi-Label Learning

Robust Multi-Class Feature Selection Via L2,0-Norm Regularization Minimization

Feature Selection WithRegularization

Unsupervised Feature Selection with Constrained ℓ₂,₀-Norm and Optimized Graph

L2,1-Norm Minimization Based Negative Label Relaxation Linear Regression for Feature Selection

Robust Multi-Label Relief Feature Selection Based on Fuzzy Margin Co-Optimization

Multi-View Multi-Label Learning with Sparse Feature Selection for Image Annotation.

Multi-task Joint Feature Selection for Multi-label Classification

Multi-label Feature Selection Based on Label Correlations and Feature Redundancy