Abstract:Learned distance metrics measure the difference of the data according to the intrinsic properties of the data points and classes. Distance metric learning approaches are typically used to linearly distinguish the samples of different classes and do not perform well on real-world nonlinear data classes. A kernel-based nonlinear distance metric learning approach is proposed in this article which exploits the density of multimodal classes to properly differentiate the classes while reducing the within-class separation. Here, multimodality refers to the disjoint distribution of a class, resulting in each class having multiple density components. In the proposed kernel density-based distance metric learning approach, kernel trick is applied on the original data and maps the data to a higher-dimensional space. Then, given the possibility of multimodal classes, a mixture of multivariate Gaussian densities is considered for the distribution of each class. The number of components is calculated using a density-based clustering approach, and then the parameters of the Gaussian components are estimated using maximum a posteriori density estimation. Then, an iterative method is used to maximize the Bhattacharya distance among the classes' Gaussian mixtures. The distance among the external components is increased, while the distance among samples of each component is decreased to provide a wide between-class margin. The results of the experiments show that using the proposed approach significantly improves the efficiency of the simple K nearest neighbor algorithm on the imbalanced data set, but when the imbalance ratio is very high, the kernel function does not have a significant effect on the efficiency of the distance metric.

Supervised kernel-based multi-modal Bhattacharya distance learning for imbalanced data classification

Distance-Based Classifier Via the Kernel Trick.

A Dual-Layer Supervised Mahalanobis Kernel for the Classification of Hyperspectral Images

Learning Distance Metric for Support Vector Machine: A Multiple Kernel Learning Approach.

Kernel Density Metric Learning

A Classfication Method For Imbalance Data Set Based on Kernel SMOTE

Nonlinear Metric Learning with Kernel Density Estimation

Bhattacharyya distance based kernel method for hyperspectral data multi-class classification

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

Joint Learning of Distance Metric and Kernel Classifier via Multiple Kernel Learning.

KPML: A Novel Probabilistic Perspective Kernel Mahalanobis Distance Metric Learning Model for Semi-supervised Clustering

Learning in Multimodal and Mixmodal Data: Locality Preserving Discriminant Analysis with Kernel and Sparse Representation Techniques.

Learning Bregman Distance Functions for Semi-Supervised Clustering

Gravitation Balanced Multiple Kernel Learning for Imbalanced Classification

Learning A Mahalanobis Distance Metric for Data Clustering and Classification

Distance Metric Learning Via Iterated Support Vector Machines

A Kernel Classification Framework for Metric Learning.

Metric Learning on Healthcare Data with Incomplete Modalities.

A Semi-Supervised Metric Learning for Content-Based Image Retrieval

Bayesian Active Distance Metric Learning

Scalable Large-Margin Mahalanobis Distance Metric Learning