Abstract:Feature selection serves as a fundamental technique in machine learning and data analysis, playing a crucial role in extracting valuable features from large-scale and high-dimensional datasets that may contain irrelevant features. To enhance the performance of feature selection, regularizers like -norm or -norm are commonly utilized to encourage sparsity. Nonetheless, these traditional regularization techniques encounter certain challenges. When correlations exist among features, the sparsity-driven regularization can unfairly diminish weights of correlated features to zero, thus ignoring the feature correlations and lacking group sparsity properties. While a straightforward combination of -norm and -norm can uncover feature correlations, it lacks adaptability and effectively balancing sparsity and correlation. To address these challenges, we introduce a novel matrix-based regularization term, called a fuzzy elastic net, in the unsupervised feature selection model. Our model is founded on principal component analysis, a well-established dimensionality reduction technique adept at finding subspaces that retain most information from raw data. The model is enhanced by a fuzzy elastic net, which promotes group or sparsity properties through adaptive parameter tuning. The new regularization term introduces a flexible fuzzy weighted scheme combining the -norm and -norm ( ). This approach allows adaptive adjustment based on data characteristics, offering a tunable balance between selecting discriminative features and identifying correlated ones. Consequently, this regularization term equips the model to handle diverse data analysis tasks flexibly, thereby enhancing adaptability and generalization performance. Furthermore, we propose an efficient optimization strategy to solve this model. Extensive experiments conducted on UCI datasets and real-world datasets demonstrate the effectiveness and efficiency of our proposed method.

Redundancy-Controlled Feature Selection for Fuzzy Neural Networks

Principal Component Analysis With Fuzzy Elastic Net for Feature Selection

Feature Selection Using a Neural Framework With Controlled Redundancy

A smoothing Group Lasso based interval type-2 fuzzy neural network for simultaneous feature selection and system identification

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A New Method for Redundancy Analysis in Feature Selection

Interactive and Complementary Feature Selection Via Fuzzy Multigranularity Uncertainty Measures

Group-Feature (Sensor) Selection With Controlled Redundancy Using Neural Networks

Co-Regularized Ensemble for Feature Selection.

LSFSR: Local label correlation-based sparse multilabel feature selection with feature redundancy

Feature Selection With Local Density-Based Fuzzy Rough Set Model for Noisy Data

A Feature Selection Method Using Conditional Correlation Dispersion and Redundancy Analysis

G-Optimal Feature Selection with Laplacian regularization

A neurodynamic optimization approach to supervised feature selection via fractional programming

Multi-Label Feature Selection Combining Three Types of Conditional Relevance

Feature redundancy removal for text classification using correlated feature subsets

Multi-label feature selection with high-sparse personalized and low-redundancy shared common features

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

Label Correlation Guided Feature Selection for Multi-label Learning.