Abstract:Kernel minimum square error (KMSE) model is computationally more tractable than other nonlinear methods, but it still has some drawbacks in theory and computational problems. Moreover, the characteristic that the classification efficiency of KMSE decreases as the size of the training sample set increases makes KMSE yield low classification efficiency for classification problems with a large number of training samples. In this paper, several methods which are developed for improving the classification efficiency of KMSE are assessed and their shortcomings are indicated. Then, KMSE is presented as a regression model. Taking advantage of local ridge regression, we develop an efficient KMSE classification technique. The proposed technique can sufficiently exploit the theoretical merit of local ridge regression which may produce more stable estimates with smaller variance than the least square error technique. This technique can also determine local regularization parameters properly and automatically, and then construct an improved KMSE model with lower structure complex which leads to a more efficient classification process. Experiments show that the improved KMSE model not only classifies much more efficiently but also obtains higher classification accuracy than KMSE, while outperforming several existing improved KMSE models.

Improved Kernel Minimum Squared Error Method and Its Implementations

Improvement of the Kernel Minimum Squared Error Model for Fast Feature Extraction

A New Kernel Mse Algorithm for Constructing Efficient Classification Procedure

A Learning Approach to Derive Sparse Kernel Minimum Square Error Model

M-estimator Based Support Vector Machine and Its Application

Sparsity Based Feature Extraction for Kernel Minimum Squared Error

Kernel Mse Algorithm: A Unified Framework for Kfd, Ls-Svm and Krr

An Improved Kernel Minimum Square Error Classification Algorithm Based on $L_{2,1}$ -Norm Regularization

Kernel Subclass Convex Hull Sample Selection Method and Its Application on SVM

A Feature Selection Algorithm Combining Within-Class Variance with Correlation Measure

A method for constructing simplified kernel model based on Kernel-MSE

Rapid and brief communication: Learning the kernel parameters in kernel minimum distance classifier

Regularized Kernel Forms of Minimum Squared Error Method

Learning the kernel parameters in kernel minimum distance classifier

Researches on Algorithm for Confidence Evaluation and Decision Modification of Svm

SVM-KNN Classifier--A New Method of Improving the Accuracy of SVM Classifier

Incremental Kernel Minimum Squared Error (KMSE)

An Efficient Kernel Evaluation Criterion for Multiclass Classification

Improved Minimum Squared Error Algorithm with Applications to Face Recognition.

A Fast KMSE Algorithm and Its Application on Anomaly Intrusion Detection

An improved least squares Twin Support Vector Machine