Abstract:Feature selection serves as a fundamental technique in machine learning and data analysis, playing a crucial role in extracting valuable features from large-scale and high-dimensional datasets that may contain irrelevant features. To enhance the performance of feature selection, regularizers like -norm or -norm are commonly utilized to encourage sparsity. Nonetheless, these traditional regularization techniques encounter certain challenges. When correlations exist among features, the sparsity-driven regularization can unfairly diminish weights of correlated features to zero, thus ignoring the feature correlations and lacking group sparsity properties. While a straightforward combination of -norm and -norm can uncover feature correlations, it lacks adaptability and effectively balancing sparsity and correlation. To address these challenges, we introduce a novel matrix-based regularization term, called a fuzzy elastic net, in the unsupervised feature selection model. Our model is founded on principal component analysis, a well-established dimensionality reduction technique adept at finding subspaces that retain most information from raw data. The model is enhanced by a fuzzy elastic net, which promotes group or sparsity properties through adaptive parameter tuning. The new regularization term introduces a flexible fuzzy weighted scheme combining the -norm and -norm ( ). This approach allows adaptive adjustment based on data characteristics, offering a tunable balance between selecting discriminative features and identifying correlated ones. Consequently, this regularization term equips the model to handle diverse data analysis tasks flexibly, thereby enhancing adaptability and generalization performance. Furthermore, we propose an efficient optimization strategy to solve this model. Extensive experiments conducted on UCI datasets and real-world datasets demonstrate the effectiveness and efficiency of our proposed method.

Fast unsupervised feature selection with anchor graph and ℓ 2,1 -norm regularization

Joint Adaptive Graph and Structured Sparsity Regularization for Unsupervised Feature Selection

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Joint learning of graph and latent representation for unsupervised feature selection

Efficient and Stable Unsupervised Feature Selection Based on Novel Structured Graph and Data Discrepancy Learning

Fast and Flexible Large Graph Embedding Based on Anchors

Unsupervised Feature Selection Algorithm Based on Graph Filtering and Self-representation

Unsupervised Spectral Feature Selection with Dynamic Hyper-graph Learning

Joint Adaptive Graph Learning and Discriminative Analysis for Unsupervised Feature Selection

Unsupervised Feature Selection via Nonnegative Orthogonal Constrained Regularized Minimization

Self-adjusted graph based semi-supervised embedded feature selection

Adaptive Unsupervised Feature Selection with Structure Regularization

Simultaneous local clustering and unsupervised feature selection via strong space constraint

Unsupervised feature selection via multiple graph fusion and feature weight learning

Fast Self-Supervised Clustering With Anchor Graph

Unsupervised feature extraction by low-rank and sparsity preserving embedding

L2,1-Norm Regularized Discriminative Feature Selection for Unsupervised Learning

G-Optimal Feature Selection with Laplacian regularization

Unsupervised Discriminative Feature Selection via Contrastive Graph Learning

Unsupervised Feature Selection Via Metric Fusion and Novel Low-Rank Approximation

Principal Component Analysis With Fuzzy Elastic Net for Feature Selection