Abstract:Kernel methods have been widely used in pattern recognition. Many kernel classifiers such as Support Vector Machines (SVM) assume that data can be separated by a hyperplane in the kernel-induced feature space. These methods do not consider the data distribution and are difficult to output the probabilities or confidences for classification. This paper proposes a novel Kernel-based Maximum A Posteriori (KMAP) classification method, which makes a Gaussian distribution assumption instead of a linear separable assumption in the feature space. Robust methods are further proposed to estimate the probability densities, and the kernel trick is utilized to calculate our model. The model is theoretically and empirically important in the sense that: (1) it presents a more generalized classification model than other kernel-based algorithms, e.g., Kernel Fisher Discriminant Analysis (KFDA); (2) it can output probability or confidence for classification, therefore providing potential for reasoning under uncertainty; and (3) multi-way classification is as straightforward as binary classification in this model, because only probability calculation is involved and no one-against-one or one-against-others voting is needed. Moreover, we conduct an extensive experimental comparison with state-of-the-art classification methods, such as SVM and KFDA, on both eight UCI benchmark data sets and three face data sets. The results demonstrate that KMAP achieves very promising performance against other models.

Kernel Covering Algorithm for Machine Learning

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Distance-Based Classifier Via the Kernel Trick.

Exploring Kernel Machines and Support Vector Machines: Principles, Techniques, and Future Directions

A Novel Kernel-Based Maximum a Posteriori Classification Method

A dissimilarity based kernel space for support vector machines

Relationship Between Support Vector Set and Kernel Functions in SVM

A New Compound Kernel Function for SVM.

SVM Classification:Its Contents and Challenges

An information-geometrical method for improving the performance of support vector machine classifiers

L2 Soft Margin Support Vector Machines With A Hybrid Kernel For Pattern Recognition

Key Issues of Support Vector Machines and Future Prospects

Research on Kernel-based Learning Machines

Enhanced SVM Based on Integrated Subspace Adaptive Kernel Function

A Modified Constructive Neural Networks And Its Application For Large-Scale Data Mining

Kernel-based learning machines research overview

Multiple Kernel Multivariate Performance Learning Using Cutting Plane Algorithm

Improving Support Vector Machine Classifiers By Modifying Kernel Functions

An efficient Kernel-based matrixized least squares support vector machine

Support Vector Machine Algorithm in Machine Learning