Airborne Image Matching Based on Fine-Grained Features and Mutual Attention

Yu Xinrui,Yao Zhuxian,Lian Siming,Ding Zhushun
DOI: https://doi.org/10.3969/j.issn.1006-3242.2023.02.007
2023-01-01
Abstract:Regarding the difficulty of multi-view and multi-angle airborne image matching, an image matching method based on mutual attention mechanism and fine-grained feature segmentation and alignment is proposed in this paper. Based on the usage of convolutional neural network to extract local fine-grained features, self attention mechanism is used to excavate global information and fine-grained features are incorporated into the expression by introducing this method, and then similarity fine-grained features among matched images are enhanced by the mutual attention mechanism. Thereafter, the features are segmented and aligned according to the attention score of each fine-grained feature. Finally, the improved triplet loss is used to constrain the entire model, and the model is established more robust on multi-view and multi-perspective data. The experimental results on the University-1652 data set show that the matching performance of the proposed method is better than that of current state-of-the-art methods.
What problem does this paper attempt to address?