HIERARCHICAL ATTENTION FUSION FOR GEO-LOCALIZATION

Liqi Yan,Yiming Cui,Yingjie Chen,Dongfang Liu
DOI: https://doi.org/10.1109/ICASSP39728.2021.9414517
2021-01-01
Abstract:Geo-localization is a critical task in computer vision. In this work, we cast the geo-localization as a 2D image retrieval task. Current state-of-the-art methods for 2D geolocalization are not robust to locate a scene with drastic scale variations because they only exploit features from one semantic level for image representations. To address this limitation, we introduce a hierarchical attention fusion network using multi-scale features for geo-localization. We extract the hierarchical feature maps from a convolutional neural network (CNN) and organically fuse the extracted features for image representations. Our training is self-supervised using adaptive weights to control the attention of feature emphasis from each hierarchical level. Evaluation results on the image retrieval and the large-scale geo-localization benchmarks indicate that our method outperforms the existing state-of-the-art methods. Code is available here: https://github.com/YanLiqi/HAF.
What problem does this paper attempt to address?