Abstract:Introduction: Metric learning, as a fundamental research direction in the field of computer vision, has played a crucial role in image matching. Traditional metric learning methods aim at constructing two-branch siamese neural networks to address the challenge of image matching, but they often overlook to cross-source and cross-view scenarios. Methods: In this article, a multi-branch metric learning model is proposed to address these limitations. The main contributions of this work are as follows: Firstly, we design a multi-branch siamese network model that enhances measurement reliability through information compensation among data points. Secondly, we construct a non-local information perception and fusion model, which accurately distinguishes positive and negative samples by fusing information at different scales. Thirdly, we enhance the model by integrating semantic information and establish an information consistency mapping between multiple branches, thereby improving the robustness in cross-source and cross-view scenarios. Results: Experimental tests which demonstrate the effectiveness of the proposed method are carried out under various conditions, including homologous, heterogeneous, multi-view, and crossview scenarios. Compared to the state-of-the-art comparison algorithms, our proposed algorithm achieves an improvement of ~1, 2, 1, and 1% in terms of similarity measurement Recall@10, respectively, under these four conditions. Discussion: In addition, our work provides an idea for improving the crossscene application ability of UAV positioning and navigation algorithm.

Image Classification Method Based on Feature Complement Ratio Matrix

Image Classification Method by Combining Multi-features and Sparse Coding

Research on Image Classification Method of Features of Combinatorial Convolution

Image Retrieval Based on Fuzzy Semantic Relevance Matrix

Combining similarity measures in content-based image retrieval guided by mutual information

An image representation method based on the similarity of feature points

Image Classification Method Rationally Utilizing Spatial Information of the Image

Bridging the Semantic Gap Between Image Contents and Tags

Research of improving semantic image segmentation based on a feature fusion model

Image classification based on support vector machine and the fusion of complementary features

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

Improving Image Retrieval with Semantic Classification Using Relevance Feedback

Combining Eye Movements for Semantic Image Classification

A data-driven study of image feature extraction and fusion

Deep-seated features histogram: A novel image retrieval method

A new method of feature fusion and its application in image recognition

Exploiting Multi-Context Analysis in Semantic Image Classification

Zero-Shot Image Classification Method Based on Attention Mechanism and Semantic Information Fusion

Semantic-Spatial Matching for Image Classification

Feature-matching method based on keypoint response constraint using binary encoding of phase congruency

Metric networks for enhanced perception of non-local semantic information