Abstract:Feature selection serves as a fundamental technique in machine learning and data analysis, playing a crucial role in extracting valuable features from large-scale and high-dimensional datasets that may contain irrelevant features. To enhance the performance of feature selection, regularizers like -norm or -norm are commonly utilized to encourage sparsity. Nonetheless, these traditional regularization techniques encounter certain challenges. When correlations exist among features, the sparsity-driven regularization can unfairly diminish weights of correlated features to zero, thus ignoring the feature correlations and lacking group sparsity properties. While a straightforward combination of -norm and -norm can uncover feature correlations, it lacks adaptability and effectively balancing sparsity and correlation. To address these challenges, we introduce a novel matrix-based regularization term, called a fuzzy elastic net, in the unsupervised feature selection model. Our model is founded on principal component analysis, a well-established dimensionality reduction technique adept at finding subspaces that retain most information from raw data. The model is enhanced by a fuzzy elastic net, which promotes group or sparsity properties through adaptive parameter tuning. The new regularization term introduces a flexible fuzzy weighted scheme combining the -norm and -norm ( ). This approach allows adaptive adjustment based on data characteristics, offering a tunable balance between selecting discriminative features and identifying correlated ones. Consequently, this regularization term equips the model to handle diverse data analysis tasks flexibly, thereby enhancing adaptability and generalization performance. Furthermore, we propose an efficient optimization strategy to solve this model. Extensive experiments conducted on UCI datasets and real-world datasets demonstrate the effectiveness and efficiency of our proposed method.

Principal Component Analysis Based Feature Selection for Clustering

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Sparsity Fuzzy C-Means Clustering With Principal Component Analysis Embedding

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

Heuristic feature selection method for clustering

A New Unsupervised Feature Selection Algorithm Using Similarity-Based Feature Clustering.

A Convex Sparse PCA for Feature Analysis.

Clustering-based feature subset selection with analysis on the redundancy–complementarity dimension

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Feature selection or extraction decision process for clustering using PCA and FRSD

Feature Selection Based on Data Clustering

Convex Sparse PCA for Unsupervised Feature Learning.

Principal Component Analysis With Fuzzy Elastic Net for Feature Selection

Deep Residual Principal Component Analysis As Feature Engineering for Industrial Data Analytics

Cascaded two-stage feature clustering and selection via separability and consistency in fuzzy decision systems

Feature Selection with Attributes Clustering by Maximal Information Coefficient

A Feature Selection Framework Based on Supervised Data Clustering

Unsupervised feature selection for multi-cluster data

PFA-Nipals: An Unsupervised Principal Feature Selection Based on Nonlinear Estimation by Iterative Partial Least Squares

A Novel Feature Subspace Selection Method in Random Forests for High Dimensional Data.

A Selective Overview of Sparse Principal Component Analysis