Abstract:In this paper, we aim at learning compact and discriminative linear regression models. Linear regression has been widely used in different problems. However, most of the existing linear regression methods exploit the conventional zero-one matrix as the regression targets, which greatly narrows the flexibility of the regression model. Another major limitation of these methods is that the learned projection matrix fails to precisely project the image features to the target space due to their weak discriminative capability. To this end, we present an elastic-net regularized linear regression (ENLR) framework, and develop two robust linear regression models which possess the following special characteristics. First, our methods exploit two particular strategies to enlarge the margins of different classes by relaxing the strict binary targets into a more feasible variable matrix. Second, a robust elastic-net regularization of singular values is introduced to enhance the compactness and effectiveness of the learned projection matrix. Third, the resulting optimization problem of ENLR has a closed-form solution in each iteration, which can be solved efficiently. Finally, rather than directly exploiting the projection matrix for recognition, our methods employ the transformed features as the new discriminate representations to make final image classification. Compared with the traditional linear regression model and some of its variants, our method is much more accurate in image classification. Extensive experiments conducted on publicly available data sets well demonstrate that the proposed framework can outperform the state-of-the-art methods. The MATLAB codes of our methods can be available at http://www.yongxu.org/lunwen.html.

Transfer Learning for High-Dimensional Linear Regression Via the Elastic Net

Transfer Learning for High Dimensional Robust Regression

A Group Adaptive Elastic-Net Approach for Variable Selection in High-Dimensional Linear Regression

Robust Transfer Learning for High-Dimensional Regression with Linear Constraints

Discriminative elastic-net regularized linear regression

Variance Estimation in High-Dimensional Linear Regression Via Adaptive Elastic-Net

Transfer Learning for High-Dimensional Quantile Regression Via Convolution Smoothing

Unified Transfer Learning Models in High-Dimensional Linear Regression

Estimation and inference for transfer learning with high-dimensional quantile regression

Transfer Learning for High-dimensional Quantile Regression via Convolution Smoothing

AdaTrans: Feature-wise and Sample-wise Adaptive Transfer Learning for High-dimensional Regression

Transfer Learning Under High-Dimensional Generalized Linear Models

Robust transfer learning for high-dimensional quantile regression model with linear constraints

Incremental Transfer Learning for Spatial Autoregressive Model with Linear Constraints

Latent Elastic-Net Transfer Learning.

The Common Intuition to Transfer Learning Can Win or Lose: Case Studies for Linear Regression

Discriminative Elastic-Net Regularized Linear Regression.

Simple Transferability Estimation for Regression Tasks

Transfer-Learning Across Datasets with Different Input Dimensions: An Algorithm and Analysis for the Linear Regression Case

Nonnegative Estimation and Variable Selection Via Adaptive Elastic-Net for High-Dimensional Data

High dimensional data regression using Lasso model and neural networks with random weights.