Abstract:Classifiers based on least squares regression (LSR) are effective in multi-classification tasks. However, there are two main problems that greatly limit its performance. First of all, most of the existing methods use limited projections and cause a lot of loss of discriminative information, but excessive use of relaxed labels may lead to overfitting. Additionally, the traditional nuclear norm treats the weights of each singular value equally, and cannot fully discuss the influence of different weights on the rank. In order to solve these problems and improve the classification performance, this paper proposes a multi-class image classification method based on weighted nonconvex low-rank and discriminative least squares regression (WNLRDLSR). Specially, using relaxed labels to replace zero-one labels, which allows the margins from different classes of samples to be widened while enhancing the intra-class compactness and similarity, thus making the resulting projections more discriminative; Furthermore, introducing the weighted nonconvex low-rank constraint in the least squares regression model, applying the weighted nonconvex low-rank norm to fully explore the effect of different rank components on the label matrix while being close to the original low-rank hypothesis. Experiments show that it helps to learn more distinguished regression projections to achieve better classification performance. The classification accuracy on different face, object and handwriting datasets are higher than that of the contrastive methods, and experiments show that the proposed WNLRDLSR is superior to many state-of-the-art methods.

Denoising Low-Rank Discrimination based Least Squares Regression for image classification

Regularisation Constrained Denoising Discriminant Least Squares Regression for Image Classification

Low-rank discriminative least squares regression for image classification

Triple Sparse Denoising Discriminantive Least Squares Regression for Image Classification

Denoising Latent Subspace Based Subspace Learning for Image Classification

Double Constrained Discriminative Least Squares Regression for Image Classification

Low-light Level Image De-Noising Algorithm Based on PCA

Image classification based on weighted nonconvex low-rank and discriminant least squares regression

Constrained Low-Rank Learning Using Least Squares-Based Regularization

Low-Rank Preserving Projections.

Efficient and Robust Sparse Linear Discriminant Analysis for Data Classification

On low-rank regularized least squares for scalable nonlinear classification

Robust low-rank representation via residual projection for image classification

Robust sparse low-rank embedding for image dimension reduction

Discriminative and robust least squares regression for semi-supervised image classification

Semi-supervised Image Classification Via Nonnegative Least-Squares Regression

Integrated Low-Rank-Based Discriminative Feature Learning for Recognition

Robust Low-Rank Subspace Recovery And Face Image Denoising For Face Recognition

A Hierarchical Low-Rank Denoising Model for Remote Sensing Images Based on Deep Unfolding

The Rank Residual Constraint Model with Weighted Schatten p-Norm Minimization for Image Denoising

From Rank Estimation to Rank Approximation: Rank Residual Constraint for Image Denoising.