Abstract:Kernel methods have been widely used in pattern recognition. Many kernel classifiers such as Support Vector Machines (SVM) assume that data can be separated by a hyperplane in the kernel-induced feature space. These methods do not consider the data distribution and are difficult to output the probabilities or confidences for classification. This paper proposes a novel Kernel-based Maximum A Posteriori (KMAP) classification method, which makes a Gaussian distribution assumption instead of a linear separable assumption in the feature space. Robust methods are further proposed to estimate the probability densities, and the kernel trick is utilized to calculate our model. The model is theoretically and empirically important in the sense that: (1) it presents a more generalized classification model than other kernel-based algorithms, e.g., Kernel Fisher Discriminant Analysis (KFDA); (2) it can output probability or confidence for classification, therefore providing potential for reasoning under uncertainty; and (3) multi-way classification is as straightforward as binary classification in this model, because only probability calculation is involved and no one-against-one or one-against-others voting is needed. Moreover, we conduct an extensive experimental comparison with state-of-the-art classification methods, such as SVM and KFDA, on both eight UCI benchmark data sets and three face data sets. The results demonstrate that KMAP achieves very promising performance against other models.

A Novel Kernel for Text Classification Based on Semantic and Statistical Information

Incorporating Knowledge into Neural Network for Text Representation.

A multiclass classification framework for document categorization

A Novel Text Classification Algorithm Based on Naïve Bayes and KL-Divergence

Chinese Text Classification Using Key Characters String Kernel

A Tensor Space Model-Based Deep Neural Network for Text Classification

Fast text categorization based on collaborative work in the semantic and class spaces

Text Classification With Heterogeneous Information Network Kernels

Research of Chinese Text Classification Methods Based on Semantic Vector and Semantic Similarity

Non-Negative Sparse Semantic Coding for Text Categorization

A Non-VSM kNN algorithm for text classification

$k$-Nearest Neighbor Augmented Neural Networks for Text Classification

A Novel Kernel-Based Maximum a Posteriori Classification Method

Dimensionality Reduction With Category Information Fusion And Non-Negative Matrix Factorization For Text Categorization

Label Distribution Learning-Enhanced Dual-KNN for Text Classification

An Improved K-Nearest Neighbor Algorithm for Text Categorization

A Novel Neural Network-Based Method for Medical Text Classification

A Novel Text Clustering Algorithm Based on Inner Product Space Model of Semantic

Accurate Knn Chinese Text Classification Via Multiple Strategies

A Novel Method Using Local Feature to Enhance GCN for Text Classification