Abstract:Introduction: Metric learning, as a fundamental research direction in the field of computer vision, has played a crucial role in image matching. Traditional metric learning methods aim at constructing two-branch siamese neural networks to address the challenge of image matching, but they often overlook to cross-source and cross-view scenarios. Methods: In this article, a multi-branch metric learning model is proposed to address these limitations. The main contributions of this work are as follows: Firstly, we design a multi-branch siamese network model that enhances measurement reliability through information compensation among data points. Secondly, we construct a non-local information perception and fusion model, which accurately distinguishes positive and negative samples by fusing information at different scales. Thirdly, we enhance the model by integrating semantic information and establish an information consistency mapping between multiple branches, thereby improving the robustness in cross-source and cross-view scenarios. Results: Experimental tests which demonstrate the effectiveness of the proposed method are carried out under various conditions, including homologous, heterogeneous, multi-view, and crossview scenarios. Compared to the state-of-the-art comparison algorithms, our proposed algorithm achieves an improvement of ~1, 2, 1, and 1% in terms of similarity measurement Recall@10, respectively, under these four conditions. Discussion: In addition, our work provides an idea for improving the crossscene application ability of UAV positioning and navigation algorithm.

Collaborative Multi-View Metric Learning For Visual Classification

Multi-view metric learning for visual classification

Sharable and Individual Multi-View Metric Learning.

Image classification with multi-view multi-instance metric learning

Multi-view metric learning based on KL-divergence for similarity measurement.

Multi-view Deep Metric Learning for Image Classification.

Multi-View Metric Learning For Multi-Label Image Classification

Hierarchical Multi-View Metric Learning with HSIC Regularization

Multi-View Cosine Similarity Learning with Application to Face Verification

Self-Weighted Multiview Metric Learning by Maximizing the Cross Correlations

Multi-metric learning by a pair of twin-metric learning framework

Metric networks for enhanced perception of non-local semantic information

Joint Learning of Latent Similarity and Local Embedding for Multi-View Clustering

Multiview Metric Learning with Global Consistency and Local Smoothness

Local Large-Margin Multi-Metric Learning for Face and Kinship Verification

Multi-View Metric Learning for Multi-View Video Summarization

Multi-model Fusion Metric Learning for Image Set Classification

Two-Level Multi-Task Metric Learning with Application to Multi-Classification

Multi-view Collaborative Locally Adaptive Clustering with Minkowski Metric

Robust Multi-view Common Component Learning.

Multi-View Deep Metric Learning for Volumetric Image Recognition.