Abstract:Feature selection serves as a fundamental technique in machine learning and data analysis, playing a crucial role in extracting valuable features from large-scale and high-dimensional datasets that may contain irrelevant features. To enhance the performance of feature selection, regularizers like -norm or -norm are commonly utilized to encourage sparsity. Nonetheless, these traditional regularization techniques encounter certain challenges. When correlations exist among features, the sparsity-driven regularization can unfairly diminish weights of correlated features to zero, thus ignoring the feature correlations and lacking group sparsity properties. While a straightforward combination of -norm and -norm can uncover feature correlations, it lacks adaptability and effectively balancing sparsity and correlation. To address these challenges, we introduce a novel matrix-based regularization term, called a fuzzy elastic net, in the unsupervised feature selection model. Our model is founded on principal component analysis, a well-established dimensionality reduction technique adept at finding subspaces that retain most information from raw data. The model is enhanced by a fuzzy elastic net, which promotes group or sparsity properties through adaptive parameter tuning. The new regularization term introduces a flexible fuzzy weighted scheme combining the -norm and -norm ( ). This approach allows adaptive adjustment based on data characteristics, offering a tunable balance between selecting discriminative features and identifying correlated ones. Consequently, this regularization term equips the model to handle diverse data analysis tasks flexibly, thereby enhancing adaptability and generalization performance. Furthermore, we propose an efficient optimization strategy to solve this model. Extensive experiments conducted on UCI datasets and real-world datasets demonstrate the effectiveness and efficiency of our proposed method.

Adaptive Weighted Sparse Principal Component Analysis for Robust Unsupervised Feature Selection

Adaptive Weighted Sparse Principal Component Analysis for Robust Unsupervised Feature Selection

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

Convex Sparse PCA for Unsupervised Feature Learning.

Fast Sparse PCA via Positive Semidefinite Projection for Unsupervised Feature Selection

Sparse PCA Via $L_{2,p}$-Norm Regularization for Unsupervised Feature Selection

Normalized Robust PCA With Adaptive Reconstruction Error Minimization

Self-representation and PCA Embedding for Unsupervised Feature Selection

A Convex Sparse PCA for Feature Analysis.

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Robust Principal Component Analysis Via Feature Self-Representation

Robust Principal Component Analysis Via Joint ℓ<inf>2,1</inf>-Norms Minimization

A New Adaptive Elastic Loss for Robust Unsupervised Feature Selection

Robust Principal Component Analysis via Discriminant Sample Weight Learning

Robust PCA Based on Adaptive Weighted Least Squares and Low-Rank Matrix Factorization

Adaptive Robust Principal Component Analysis

Robust Principal Component Analysis Via Joint Reconstruction and Projection.

Principal Component Analysis With Fuzzy Elastic Net for Feature Selection

Discrete Robust Principal Component Analysis Via Binary Weights Self-Learning

Adaptive Weighted Sparse Principal Component Analysis for Robust Unsupervised Feature Selection

Adaptive Weighted Sparse Principal Component Analysis for Robust Unsupervised Feature Selection

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection

Convex Sparse PCA for Unsupervised Feature Learning.

Fast Sparse PCA via Positive Semidefinite Projection for Unsupervised Feature Selection

Sparse PCA Via $L_{2,p}$-Norm Regularization for Unsupervised Feature Selection

Normalized Robust PCA With Adaptive Reconstruction Error Minimization

Self-representation and PCA Embedding for Unsupervised Feature Selection

A Convex Sparse PCA for Feature Analysis.

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Robust Principal Component Analysis Via Feature Self-Representation

Robust Principal Component Analysis Via Joint ℓ&lt;inf&gt;2,1&lt;/inf&gt;-Norms Minimization

A New Adaptive Elastic Loss for Robust Unsupervised Feature Selection

Robust Principal Component Analysis via Discriminant Sample Weight Learning

Robust PCA Based on Adaptive Weighted Least Squares and Low-Rank Matrix Factorization

Adaptive Robust Principal Component Analysis

Robust Principal Component Analysis Via Joint Reconstruction and Projection.

Principal Component Analysis With Fuzzy Elastic Net for Feature Selection

Discrete Robust Principal Component Analysis Via Binary Weights Self-Learning

Robust Principal Component Analysis Via Joint ℓ<inf>2,1</inf>-Norms Minimization