Abstract:Accurate image matching is the basis for many information fusion-related applications. Conventional methods fail when handling multimodal image pairs with severe nonlinear radiation distortion (NRD) and geometric transformations. To address this problem, we present an effective method, termed modality-invariant feature transform with global-to-local searching (GLS-MIFT). First, we addressed scale changes by constructing the image scale space. Then, we obtained multi-scale, multi-orientation filtering results based on first-order Gaussian steerable filters to exploit their robustness to NRD. Next, we introduced a feature response aggregation model to synthesize the filtering results to generate a feature map, and used it to detect highly repeatable features. Additionally, we designed an adaptive partitioning descriptor to achieve rotation-invariant feature description, involving the following six steps: generation of statistical histograms of multi-orientation filtering values, synthesis of histograms on multiple scales, estimation and updating of the primary direction, determination of the sampling direction, normalization of the feature vector in sub-regions, and finally, obtaining the complete description vector. A convolutional image grouping strategy was used to enhance the rotational invariance of the method. We developed a new feature matcher based on the GLS strategy. Guided by the results of global searching stage, the local searching stage further improved the matching accuracy and reliability of the results. Our experimental results confirmed that GLS-MIFT achieved high-quality matching for a large-scale dataset of 1110 image pairs, with various multimodal image types from the fields of computer vision, medicine, and remote sensing. GLS-MIFT outperformed state-of-the-art methods including SIFT, RIFT, HOWP, OFM, MatchFormer, SemLA and GIFT in qualitative and quantitative evaluations. Our implementation and datasets are available at: https://github.com/Zhongli-Fan/GLS-MIFT .

GMS: Grid-Based Motion Statistics for Fast, Ultra-robust Feature Correspondence

FMS:Features Motion Statistics for Incorrect Matched-pair Removal

A GMS-Guided Approach for 2D Feature Correspondence Selection

Grid Motion Statistics Fast Matching Algorithm for Rotating Images

Aerial Image Stitching Algorithm Based on Improved GMS

Image Matching for Space Objects Based on Grid-Based Motion Statistics.

Geometry-aware Feature Matching for Large-Scale Structure from Motion

Robust Feature Matching Via Graph Neighborhood Motion Consensus

Feature matching based on Gaussian kernel convolution and minimum relative motion

Ensemble Learning with Advanced Fast Image Filtering Features for Semi-Global Matching

An Error-Matching Exclusion Method for Accelerating Visual SLAM

Misalignment-eliminated warping image stitching method with grid-based motion statistics matching

An Improved ORB-GMS Image Feature Extraction and Matching Algorithm*

UGC: Real-Time, Ultra-Robust Feature Correspondence Via Unilateral Grid-Based Clustering.

RGM: A Robust Generalizable Matching Model

Image Matching Via Feature Fusion and Coherent Constraint.

GLS-MIFT: A Modality Invariant Feature Transform with Global-to-Local Searching

Sift In Gms-Selected Areas: A Method For Feature Point Matching Between Photographs And Rendered Images

Fast Verification Via Statistical Geometric for Mobile Visual Search

Robust Image Feature Matching Via Progressive Sparse Spatial Consensus

An Evaluation of Feature Matchers Forfundamental Matrix Estimation.