Abstract:Kernel methods have been widely used in pattern recognition. Many kernel classifiers such as Support Vector Machines (SVM) assume that data can be separated by a hyperplane in the kernel-induced feature space. These methods do not consider the data distribution and are difficult to output the probabilities or confidences for classification. This paper proposes a novel Kernel-based Maximum A Posteriori (KMAP) classification method, which makes a Gaussian distribution assumption instead of a linear separable assumption in the feature space. Robust methods are further proposed to estimate the probability densities, and the kernel trick is utilized to calculate our model. The model is theoretically and empirically important in the sense that: (1) it presents a more generalized classification model than other kernel-based algorithms, e.g., Kernel Fisher Discriminant Analysis (KFDA); (2) it can output probability or confidence for classification, therefore providing potential for reasoning under uncertainty; and (3) multi-way classification is as straightforward as binary classification in this model, because only probability calculation is involved and no one-against-one or one-against-others voting is needed. Moreover, we conduct an extensive experimental comparison with state-of-the-art classification methods, such as SVM and KFDA, on both eight UCI benchmark data sets and three face data sets. The results demonstrate that KMAP achieves very promising performance against other models.

Top-k Multiclass SVM

Top-k Multi-Class SVM Using Multiple Features

Robust Top-k Multiclass SVM for Visual Category Recognition

A Multi-Class Large Margin Classifier

Generalized Convexity-Based Inexact Projection Method for Multiple Kernel Learning

Optimizing Top-k Multiclass SVM via Semismooth Newton Algorithm.

Top-$k$ Classification and Cardinality-Aware Prediction

Classification Under Ambiguity: When Is Average-K Better Than Top-K?

Multi-Class SVM Classifier Based on Pairwise Coupling

Cardinality-Aware Set Prediction and Top-$k$ Classification

A Novel Kernel-Based Maximum a Posteriori Classification Method

Transductive Optimization of Top k Precision

Within-class Penalty Based Multi-Class Support Vector Machine.

A Simplified Multi-Class Support Vector Machine with Reduced Dual Optimization

Confidence sets with expected sizes for Multiclass Classification

Consistent Polyhedral Surrogates for Top-$k$ Classification and Variants

Two-stage sparse multi-kernel optimization classifier method for more accurate and explainable prediction

Image Classification Based on KPCA and SVM with Randomized Hyper-parameter Optimization

2 Indirect Multi-Class SVM 2 . 2 . 1 SVM Classification

Max-Margin Dictionary Learning For Multiclass Image Categorization

An Improved Multiclass Algorithm For Svms