Abstract:Kernel methods have been widely used in pattern recognition. Many kernel classifiers such as Support Vector Machines (SVM) assume that data can be separated by a hyperplane in the kernel-induced feature space. These methods do not consider the data distribution and are difficult to output the probabilities or confidences for classification. This paper proposes a novel Kernel-based Maximum A Posteriori (KMAP) classification method, which makes a Gaussian distribution assumption instead of a linear separable assumption in the feature space. Robust methods are further proposed to estimate the probability densities, and the kernel trick is utilized to calculate our model. The model is theoretically and empirically important in the sense that: (1) it presents a more generalized classification model than other kernel-based algorithms, e.g., Kernel Fisher Discriminant Analysis (KFDA); (2) it can output probability or confidence for classification, therefore providing potential for reasoning under uncertainty; and (3) multi-way classification is as straightforward as binary classification in this model, because only probability calculation is involved and no one-against-one or one-against-others voting is needed. Moreover, we conduct an extensive experimental comparison with state-of-the-art classification methods, such as SVM and KFDA, on both eight UCI benchmark data sets and three face data sets. The results demonstrate that KMAP achieves very promising performance against other models.

A Kernel Function Optimization And Selection Algorithm Based On Cost Function Maximization

The Optimization for Parameter of Kernel Function with GA

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Cross-validatory Framework for Optimal Parameter Estimation of KPCA and KPLS Models

Infrared Point Target Detection Based on Kernel Least Squares Algorithm

Kernel optimization-based discriminant analysis for face recognition

Learning a Data-Dependent Kernel Function for KPCA-based Nonlinear Process Monitoring

Rapid and brief communication: Learning the kernel parameters in kernel minimum distance classifier

Kernel Selection for Modal Linear Regression: Optimal Kernel and IRLS Algorithm

A General Kernelization Framework for Learning Algorithms Based on Kernel PCA.

Feature Selection in a Kernel Space

Learning the kernel parameters in kernel minimum distance classifier

A Novel Kernel-Based Maximum a Posteriori Classification Method

Generalized Semisupervised Self-Optimizing Kernel Model for Quality-Related Industrial Process Monitoring.

An Efficient Kernel Evaluation Criterion for Multiclass Classification

Multiclass Kernel Polarization and Its Application to Parameter Selection of RBF Kernel with Multiple Widths

Kernel Parameter Optimization for KFDA Based on the Maximum Margin Criterion.

Adaptive Kernel Principal Component Analysis with Unsupervised Learning of Kernels

Kernel-based retrieval models for hyperspectral image data optimized with Kernel Flows

Optimizing Kernel Pca Using Sparse Representation-Based Classifier for Mstar Sar Image Target Recognition

An Overview of Kernel Alignment and Its Applications