Abstract:Feature selection can help to reduce data redundancy and improve algorithm performance in actual tasks. Most of the embedded feature selection models are constructed based on square loss and hinge loss. However, these models based on the square loss cannot directly evaluate the discriminability of the sam-ples in the feature subspace, and these methods based on the hinge loss are difficult to solve due to their complex objective functions. To deal with these problems, a Feature Selection method with Multi-class Logistic Regression (FSMLR) is proposed in this paper. Firstly, we construct a linear function to measure the difference between the distance from samples to their regression hyperplane and the distance from these samples to regression hyperplanes of other classes, which could be used to strengthen the discrim-inant property of the embedded model. Then, we design a re-weighting matrix with a 2,0-norm pound sparse condition as well as a discrete condition, which is used to select features in the subspace. Considering that it is difficult to solve the re-weighting matrix with the discrete and sparse conditions in an optimization problem, we relax these two conditions and present a feature selection model via a re-weighted multi -class logistic regression with the two relaxed constraints. Finally, we add the F-norm regularization in our model to avoid overfitting, and its unconstrained equivalent transformation with 2 pound,p-norm regular-ization is derived to explore the function of the re-weighting matrix. The gradient descent algorithm could be used to solve the FSMLR. Especially, when the regularization term in the equivalence problem is set to 2,1-norm pound, the global optimal solution can be obtained. Extensive experiments on multiple public data sets prove that FSMLR outperforms other competitors.(c) 2023 Elsevier B.V. All rights reserved.

A General Framework for Feature Selection under Orthogonal Regression with Global Redundancy Minimization.

Feature Selection under Orthogonal Regression with Redundancy Minimizing.

Embedded Multi-label Feature Selection via Orthogonal Regression

A General Framework for Auto-Weighted Feature Selection via Global Redundancy Minimization.

Feature Selection Via Minimizing Global Redundancy for Imbalanced Data

Feature Selection Based on Dependency Margin

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A New Method for Redundancy Analysis in Feature Selection

Generalized Uncorrelated Regression with Adaptive Graph for Unsupervised Feature Selection

Adaptive Feature Redundancy Minimization

Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature Selection

Feature Selection with Maximal Relevance and Minimal Supervised Redundancy

Feature selection with multi-class logistic regression

A New Feature Selection Method for Handling Redundant Information in Text Classification

Feature Selection Methods In The Framework Of Mrmr

Supervised feature selection with orthogonal regression and feature weighting

MVMR-FS : Non-parametric feature selection algorithm based on Maximum inter-class Variation and Minimum Redundancy

Unsupervised Feature Selection Via Maximum Projection and Minimum Redundancy

Generalized Embedding Regression: A Framework for Supervised Feature Extraction

Supervised Feature Selection With Orthogonal Regression and Mountain Range Area

A comparative study of redundant feature detection based feature selection methods