Abstract:The homography estimation of infrared and visible images, a key technique for assisting perception, is an integral element within the 6G Space–Air–Ground Integrated Network (6G SAGIN) framework. It is widely applied in the registration of these two image types, leading to enhanced environmental perception and improved efficiency in perception computation. However, the traditional estimation methods are frequently challenged by insufficient feature points and the low similarity in features when dealing with these images, which results in poor performance. Deep-learning-based methods have attempted to address these issues by leveraging strong deep feature extraction capabilities but often overlook the importance of precisely guided feature matching in regression networks. Consequently, exactly acquiring feature correlations between multi-modal images remains a complex task. In this study, we propose a feature correlation transformer method, devised to offer explicit guidance for feature matching for the task of homography estimation between infrared and visible images. First, we propose a feature patch, which is used as a basic unit for correlation computation, thus effectively coping with modal differences in infrared and visible images. Additionally, we propose a novel cross-image attention mechanism to identify correlations between varied modal images, thus transforming the multi-source images homography estimation problem into a single-source images problem by achieving source-to-target image mapping in the feature dimension. Lastly, we propose a feature correlation loss (FCL) to induce the network into learning a distinctive target feature map, further enhancing source-to-target image mapping. To validate the effectiveness of the newly proposed components, we conducted extensive experiments to demonstrate the superiority of our method compared with existing methods in both quantitative and qualitative aspects.

Bilevel progressive homography estimation via correlative region-focused transformer

Recurrent Homography Estimation Using Homography-Guided Image Warping and Focus Transformer

MCNet: Rethinking the Core Ingredients for Accurate and Efficient Homography Estimation

Deep Homography Estimation With Feature Correlation Transformer

AbHE: All Attention-Based Homography Estimation

LocalTrans: A Multiscale Local Transformer Network for Cross-Resolution Homography Estimation

Edge-aware Correlation Learning for Unsupervised Progressive Homography Estimation

Coarse-to-Fine Homography Estimation for Infrared and Visible Images

Combining Convolutional Neural Network and Photometric Refinement for Accurate Homography Estimation.

Multi-Scale Correlation for Deep Homography Estimation

ETO:Efficient Transformer-based Local Feature Matching by Organizing Multiple Homography Hypotheses

Geometrized Transformer for Self-Supervised Homography Estimation

Homography Estimation with Adaptive Query Transformer and Gated Interaction Module

Unsupervised deep homography with multi-scale global attention.

STN-Homography: Direct Estimation of Homography Parameters for Image Pairs

Homography Estimation Network Based on Dense Correspondence

Multi-Modal Image Fusion Via Deep Laplacian Pyramid Hybrid Network

SRHEN: Stepwise-Refining Homography Estimation Network via Parsing Geometric Correspondences in Deep Latent Space

LGFCTR: Local and Global Feature Convolutional Transformer for Image Matching

CrossHomo: Cross-Modality and Cross-Resolution Homography Estimation

Infrared and Visible Image Homography Estimation Based on Feature Correlation Transformers for Enhanced 6G Space–Air–Ground Integrated Network Perception