Abstract:Kernel methods have been widely used in pattern recognition. Many kernel classifiers such as Support Vector Machines (SVM) assume that data can be separated by a hyperplane in the kernel-induced feature space. These methods do not consider the data distribution and are difficult to output the probabilities or confidences for classification. This paper proposes a novel Kernel-based Maximum A Posteriori (KMAP) classification method, which makes a Gaussian distribution assumption instead of a linear separable assumption in the feature space. Robust methods are further proposed to estimate the probability densities, and the kernel trick is utilized to calculate our model. The model is theoretically and empirically important in the sense that: (1) it presents a more generalized classification model than other kernel-based algorithms, e.g., Kernel Fisher Discriminant Analysis (KFDA); (2) it can output probability or confidence for classification, therefore providing potential for reasoning under uncertainty; and (3) multi-way classification is as straightforward as binary classification in this model, because only probability calculation is involved and no one-against-one or one-against-others voting is needed. Moreover, we conduct an extensive experimental comparison with state-of-the-art classification methods, such as SVM and KFDA, on both eight UCI benchmark data sets and three face data sets. The results demonstrate that KMAP achieves very promising performance against other models.

A New Method for Determining the Parameter of Gaussian Kernel

The Optimization for Parameter of Kernel Function with GA

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Novel Linear Search for Support Vector Machine Parameter Selection

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Distance-Based Classifier Via the Kernel Trick.

Cross-validatory Framework for Optimal Parameter Estimation of KPCA and KPLS Models

An information-geometrical method for improving the performance of support vector machine classifiers

A Novel Kernel-Based Maximum a Posteriori Classification Method

An Approach to Choosing Gaussian Kernel Parameter for One-Class SVMs Via Tightness Detecting

Two Methods of Selecting Gaussian Kernel Parameters for One-Class Svm and Their Application to Fault Detection

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Kernel optimization-based discriminant analysis for face recognition

Parameter selection of Gaussian kernel for one-class SVM.

A geometrical method to improve performance of the support vector machine.

Kernel GMM and Its Application to Image Binarization

A New Method for SVM Hyper-parameters Optimization

Kernel discriminant analysis based on support vectors

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

Scaling the kernel function to improve performance of the support vector machine