Abstract:Accurate image matching is the basis for many information fusion-related applications. Conventional methods fail when handling multimodal image pairs with severe nonlinear radiation distortion (NRD) and geometric transformations. To address this problem, we present an effective method, termed modality-invariant feature transform with global-to-local searching (GLS-MIFT). First, we addressed scale changes by constructing the image scale space. Then, we obtained multi-scale, multi-orientation filtering results based on first-order Gaussian steerable filters to exploit their robustness to NRD. Next, we introduced a feature response aggregation model to synthesize the filtering results to generate a feature map, and used it to detect highly repeatable features. Additionally, we designed an adaptive partitioning descriptor to achieve rotation-invariant feature description, involving the following six steps: generation of statistical histograms of multi-orientation filtering values, synthesis of histograms on multiple scales, estimation and updating of the primary direction, determination of the sampling direction, normalization of the feature vector in sub-regions, and finally, obtaining the complete description vector. A convolutional image grouping strategy was used to enhance the rotational invariance of the method. We developed a new feature matcher based on the GLS strategy. Guided by the results of global searching stage, the local searching stage further improved the matching accuracy and reliability of the results. Our experimental results confirmed that GLS-MIFT achieved high-quality matching for a large-scale dataset of 1110 image pairs, with various multimodal image types from the fields of computer vision, medicine, and remote sensing. GLS-MIFT outperformed state-of-the-art methods including SIFT, RIFT, HOWP, OFM, MatchFormer, SemLA and GIFT in qualitative and quantitative evaluations. Our implementation and datasets are available at: https://github.com/Zhongli-Fan/GLS-MIFT .

MFD: Mutual feature description for image matching

SIFT-Based Image Retrieval Combining the Distance Measure of Global Image and Sub-Image

KPB-SIFT

Cgci-Sift: A More Efficient and Compact Representation of Local Descriptor

Scale and Color Invariant Image Feature Description

Augmented Distinctive Features With Color And Scale Invariance

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Affine-invariant SIFT Descriptor with Global Context

An Effective Local Invariant Descriptor Combining Luminance and Color Information

Remote Sensing Image Matching Based on Adaptive Binning SIFT Descriptor

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

An Optimized SIFT Algorithm Based on Color Space Normalization

The Image Matching Method Based on the Improved SIFT Descriptor

Image matching based on a local invariant descriptor

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

Description of Interest Regions Based on Combined Local Binary Patterns

Image Matching Based on Orientation–magnitude Histograms and Global Consistency

Distinctive image features from illumination and scale invariant keypoints

Contourlet-SIFT Feature Matching Algorithm

S-SIFT: A Shorter SIFT without Least Discriminability Visual Orientation

GLS-MIFT: A Modality Invariant Feature Transform with Global-to-Local Searching