Abstract:In this paper, we aim at learning compact and discriminative linear regression models. Linear regression has been widely used in different problems. However, most of the existing linear regression methods exploit the conventional zero-one matrix as the regression targets, which greatly narrows the flexibility of the regression model. Another major limitation of these methods is that the learned projection matrix fails to precisely project the image features to the target space due to their weak discriminative capability. To this end, we present an elastic-net regularized linear regression (ENLR) framework, and develop two robust linear regression models which possess the following special characteristics. First, our methods exploit two particular strategies to enlarge the margins of different classes by relaxing the strict binary targets into a more feasible variable matrix. Second, a robust elastic-net regularization of singular values is introduced to enhance the compactness and effectiveness of the learned projection matrix. Third, the resulting optimization problem of ENLR has a closed-form solution in each iteration, which can be solved efficiently. Finally, rather than directly exploiting the projection matrix for recognition, our methods employ the transformed features as the new discriminate representations to make final image classification. Compared with the traditional linear regression model and some of its variants, our method is much more accurate in image classification. Extensive experiments conducted on publicly available data sets well demonstrate that the proposed framework can outperform the state-of-the-art methods. The MATLAB codes of our methods can be available at http://www.yongxu.org/lunwen.html.

Linear Dilation-Erosion Perceptron for Binary Classification

Least-Squares Linear Dilation-Erosion Regressor Trained using a Convex-Concave Procedure

Gender Classification Based On Evolutionary Extreme Learning Machine

Training Single-Layer Morphological Perceptron Using Convex-Concave Programming

Morphological Perceptrons: Geometry and Training Algorithms

Discriminative Elastic-Net Regularized Linear Regression.

Bilateral Structure Based Matrix Regression Classification for Face Recognition

The Perceptron with Dynamic Margin

Regularisation Constrained Denoising Discriminant Least Squares Regression for Image Classification

Perceptron Training Algorithms Designed Using Discrete-Time Control Liapunov Functions

Triple Sparse Denoising Discriminantive Least Squares Regression for Image Classification

Boundary-Eliminated Pseudoinverse Linear Discriminant for Imbalanced Problems

Transparent Classification with Multilayer Logical Perceptrons and Random Binarization

Bilinear Neighborhood Discriminant Embedding And Its Non-Iterative Solution Algorithm

Perceptron Learning of Modified Quadratic Discriminant Function

Exponential Discriminative Metric Embedding in Deep Learning

A convergent solution to two dimensional linear discriminant analysis

Regularized Deep Linear Discriminant Analysis

Low-rank discriminative least squares regression for image classification

Discrepancy Algorithms for the Binary Perceptron

On Accelerated Perceptrons and Beyond