Abstract:This paper proposes a probabilistic deep metric learning (PDML) framework for hyperspectral image classification, which aims to predict the category of each pixel for an image captured by hyperspectral sensors. The core problem for hyperspectral image classification is the spectral variability between intraclass materials and the spectral similarity between interclass materials, motivating the further incorporation of spatial information to differentiate a pixel based on its surrounding patch. However, different pixels and even the same pixel in one patch might not encode the same material due to the low spatial resolution of most hyperspectral sensors, leading to an inconsistent judgment of a specific pixel. To address this issue, we propose a probabilistic deep metric learning framework to model the categorical uncertainty of the spectral distribution of an observed pixel. We propose to learn a global probabilistic distribution for each pixel in the patch and a probabilistic metric to model the distance between distributions. We treat each pixel in a patch as a training sample, enabling us to exploit more information from the patch compared with conventional methods. Our framework can be readily applied to existing hyperspectral image classification methods with various network architectures and loss functions. Extensive experiments on four widely used datasets including IN, UP, KSC, and Houston 2013 datasets demonstrate that our framework improves the performance of existing methods and further achieves the state of the art. Code is available at: <a class="link-external link-https" href="https://github.com/wzzheng/PDML" rel="external noopener nofollow">this https URL</a>.

LAM3L: Locally Adaptive Maximum Margin Metric Learning for Visual Data Classification

Discriminative Cnn Via Metric Learning For Hyperspectral Classification

Local Large-Margin Multi-Metric Learning for Face and Kinship Verification

Adaptive maximum margin criterion for image classification

Risk-based Adaptive Metric Learning for Nearest Neighbour Classification

Mixture Correntropy-Based Robust Distance Metric Learning for Classification

Large margin nearest local mean classifier

Multi-view metric learning for visual classification

Local and Weighted Maximum Margin Discriminant Analysis

Margin Loss Based on Adaptive Metric for Image Recognition

Hierarchical Large Margin Nearest Neighbor Classification

Discriminative Latent Subspace Learning with Adaptive Metric Learning

Collaborative Multi-View Metric Learning For Visual Classification

Improving the discriminant ability of local margin based learning method by incorporating the global between-class separability criterion

Learning Label-Specific Multiple Local Metrics for Multi-Label Classification

Hierarchical Distance Metric Learning for Large Margin Nearest Neighbor Classification.

Metric Learning with Adaptive Density Discrimination

Hyperspectral Imagery Classification with Deep Metric Learning

Distance Metric-Based Learning for Long-Tail Object Detection

Scalable Large-Margin Mahalanobis Distance Metric Learning

Probabilistic Deep Metric Learning for Hyperspectral Image Classification