Abstract:In this paper, we aim at learning compact and discriminative linear regression models. Linear regression has been widely used in different problems. However, most of the existing linear regression methods exploit the conventional zero-one matrix as the regression targets, which greatly narrows the flexibility of the regression model. Another major limitation of these methods is that the learned projection matrix fails to precisely project the image features to the target space due to their weak discriminative capability. To this end, we present an elastic-net regularized linear regression (ENLR) framework, and develop two robust linear regression models which possess the following special characteristics. First, our methods exploit two particular strategies to enlarge the margins of different classes by relaxing the strict binary targets into a more feasible variable matrix. Second, a robust elastic-net regularization of singular values is introduced to enhance the compactness and effectiveness of the learned projection matrix. Third, the resulting optimization problem of ENLR has a closed-form solution in each iteration, which can be solved efficiently. Finally, rather than directly exploiting the projection matrix for recognition, our methods employ the transformed features as the new discriminate representations to make final image classification. Compared with the traditional linear regression model and some of its variants, our method is much more accurate in image classification. Extensive experiments conducted on publicly available data sets well demonstrate that the proposed framework can outperform the state-of-the-art methods. The MATLAB codes of our methods can be available at http://www.yongxu.org/lunwen.html.

Regularized Label Relaxation with Negative Technique for Image Classification

A Regularized Correntropy Framework for Robust Pattern Recognition

Regularized Label Relaxation Linear Regression

Semi-supervised Image Classification Via Nonnegative Least-Squares Regression

Discriminative Regression With Latent Label Learning for Image Classification

Image classification based on weighted nonconvex low-rank and discriminant least squares regression

Low-rank discriminative least squares regression for image classification

Regularisation Constrained Denoising Discriminant Least Squares Regression for Image Classification

Low-rank Discriminative Regression Learning for Image Classification

Single-Label Multi-Class Image Classification by Deep Logistic Regression

Imbalance Rectification in Deep Logistic Regression for Multi-Label Image Classification Using Random Noise Samples

Text Categorization Based on Regularization Extreme Learning Machine

Discriminative Elastic-Net Regularized Linear Regression.

Label and Orthogonality Regularized Non-Negative Matrix Factorization for Image Classification.

Double Constrained Discriminative Least Squares Regression for Image Classification

Sparse non-negative transition subspace learning for image classification

Denoising Low-Rank Discrimination based Least Squares Regression for image classification

Discriminative Face Recognition Methods with Structure and Label Information Via $$L_2$$-Norm Regularization

Visual Sentiment Classification Via Low-Rank Regularization and Label Relaxation

Discriminative and robust least squares regression for semi-supervised image classification

Robust double relaxed regression for image classification