Abstract:Least square regression (LSR) is popular in pattern classification. Compared against other matrix factorization based methods, it is simple yet efficient. However, LSR ignores unlabeled samples in the training stage, so the regression error could be large when the labeled samples are insufficient. To solve this problem, the Laplacian regularization can be used to penalize LSR. Extensive theoretical and experimental results have confirmed the validity of Laplacian regularized least square (LapRLS). However, multiple hyper-parameters have been introduced to estimate the intrinsic manifold induced by the regularization, and thus the time consuming cross-validation should be applied to tune these parameters. To alleviate this problem, we assume the intrinsic manifold is a linear combination of a given set of known manifolds. By further assuming the priors of the given manifolds are equivalent, we introduce the entropy maximization penalty to automatically learn the linear combination coefficients. The entropy maximization trades the smoothness off the complexity. Therefore, the proposed model enjoys the following advantages: (1) it is able to incorporate both labeled and unlabeled data into training process, (2) it is able to learn the manifold hyper-parameters automatically, and (3) it approximates the true probability distribution with respect to prescribed test data. To test the classification performance of our proposed model, we apply the model on three well-known human face datasets, i.e. FERET, ORL, and YALE. Experimental results on these three face datasets suggest the effectiveness and the efficiency of the new model compared against the traditional LSR and the Laplacian regularized least squares.

Co-regularization for Classification

Hessian-regularized Co-Training for Social Activity Recognition.

Enhanced Manifold Regularization for Semi-Supervised Classification.

Semi-Supervised Classification Method Based on Joint Regularization of Manifold and Pairwise Constraints

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning

Classification by Semi-Supervised Discriminative Regularization

Hyperspherical Consistency Regularization.

Transductive Classification Via Dual Regularization

Manifold adversarial training for supervised and semi-supervised learning

One of semi-supervised classification algorithm named Co-S3OM based on cooperative training

Semi-Supervised Label Distribution Learning with Co-regularization

Manifold Regularization Classification Model Based On Improved Diffusion Map

Manifold Regularized Multitask Learning for Semi-Supervised Multilabel Image Classification

Entropy controlled Laplacian regularization for least square regression

Regularized Label Relaxation Linear Regression

A Hybrid Regularization Semi-Supervised Extreme Learning Machine Method and Its Application.

A Semi-Supervised Face Recognition Method Based on Manifold Regularization

Nonnegative Matrix Factorization With Regularizations

Semi-supervised sparse subspace clustering with manifold regularization

Leave-one-out Manifold Regularization

Discriminative and robust least squares regression for semi-supervised image classification