Abstract:Kernel methods have been widely used in pattern recognition. Many kernel classifiers such as Support Vector Machines (SVM) assume that data can be separated by a hyperplane in the kernel-induced feature space. These methods do not consider the data distribution and are difficult to output the probabilities or confidences for classification. This paper proposes a novel Kernel-based Maximum A Posteriori (KMAP) classification method, which makes a Gaussian distribution assumption instead of a linear separable assumption in the feature space. Robust methods are further proposed to estimate the probability densities, and the kernel trick is utilized to calculate our model. The model is theoretically and empirically important in the sense that: (1) it presents a more generalized classification model than other kernel-based algorithms, e.g., Kernel Fisher Discriminant Analysis (KFDA); (2) it can output probability or confidence for classification, therefore providing potential for reasoning under uncertainty; and (3) multi-way classification is as straightforward as binary classification in this model, because only probability calculation is involved and no one-against-one or one-against-others voting is needed. Moreover, we conduct an extensive experimental comparison with state-of-the-art classification methods, such as SVM and KFDA, on both eight UCI benchmark data sets and three face data sets. The results demonstrate that KMAP achieves very promising performance against other models.

Model Selection for Support Vector Machines Based on Kernel Density Estimation

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Novel Linear Search for Support Vector Machine Parameter Selection

Multivariate Statistical Process Monitoring Using Kernel Density Estimation

M-estimator Based Support Vector Machine and Its Application

Density Estimation Based on Multi-Kernel Support Vector Machines

A Kernel Function Optimization And Selection Algorithm Based On Cost Function Maximization

Cross-validatory Framework for Optimal Parameter Estimation of KPCA and KPLS Models

Density Estimation Based on Support Vector Machines

Generalized Semisupervised Self-Optimizing Kernel Model for Quality-Related Industrial Process Monitoring.

An MPEC Model for Selecting Optimal Parameter in Support Vector Machines

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

Feature Selection in a Kernel Space

Kernel density weighted method of obtaining the least square support vector machines weightes

An optimal transport approach for selecting a representative subsample with application in efficient kernel density estimation

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Model selection of polynomial kernel regression

A Novel Kernel-Based Maximum a Posteriori Classification Method

A Support Vector Machine with a Hybrid Kernel and Minimal Vapnik-Chervonenkis Dimension

A New Method for Determining the Parameter of Gaussian Kernel

Modal Regression using Kernel Density Estimation: a Review