Abstract:Least square regression is a very popular supervised classification method. However, two main issues greatly limit its performance. The first one is that it only focuses on fitting the input features to the corresponding output labels while ignoring the correlations among samples. The second one is that the used label matrix, i.e., zero–one label matrix is inappropriate for classification. To solve these problems and improve the performance, this paper presents a novel method, i.e., inter-class sparsity based discriminative least square regression (ICS_DLSR), for multi-class classification. Different from other methods, the proposed method pursues that the transformed samples have a common sparsity structure in each class. For this goal, an inter-class sparsity constraint is introduced to the least square regression model such that the margins of samples from the same class can be greatly reduced while those of samples from different classes can be enlarged. In addition, an error term with row-sparsity constraint is introduced to relax the strict zero–one label matrix, which allows the method to be more flexible in learning the discriminative transformation matrix. These factors encourage the method to learn a more compact and discriminative transformation for regression and thus has the potential to perform better than other methods. Extensive experimental results show that the proposed method achieves the best performance in comparison with other methods for multi-class classification.

Semi-Supervised Kernel Discriminative Low-Rank Ridge Regression for Data Classification

Low-rank kernel regression with preserved locality for multi-class analysis

Low-rank Discriminative Regression Learning for Image Classification

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Manifold Adaptive Kernelized Low-Rank Representation for Semisupervised Image Classification

Semi-supervised classification via kernel low-rank representation graph.

An Efficient Kernel-Based Nonlinear Regression Method For Two-Class Classification

Denoising Low-Rank Discrimination based Least Squares Regression for image classification

Kernel linear regression for face recognition

Low-rank discriminative least squares regression for image classification

On low-rank regularized least squares for scalable nonlinear classification

Semi-Supervised Kernel Regression

Inter-class Sparsity Based Discriminative Least Square Regression.

Distributed Semi-Supervised Learning with Kernel Ridge Regression

Classification by Semi-Supervised Discriminative Regularization

Face Recognition Using Kernel Ridge Regression

Semi-supervised Low-Rank Representation for Image Classification.

Kernel Discriminant Learning for Ordinal Regression

Discriminative and robust least squares regression for semi-supervised image classification

Learning discriminative low-rank representation for image classification

Discriminative Ridge Machine: A Classifier for High-Dimensional Data or Imbalanced Data