Abstract:Multimodal image matching suffers from severe geometric and nonlinear intensity distortion (NID). Towards this problem, we propose a multimodal image matching algorithm based on multi-orientation filtering results, called position-orientation-scale guided geometric and intensity-invariant feature transformation (POS-GIFT). First, we design a multi-layer circular point sampling pattern to effectively capture the local image structure. Then, we propose a novel feature descriptor that can work robustly across rotational differences in [0°, 360°) in the presence of NID. Specifically, we (1) integrate the multi-orientation filtering response in the local neighborhood with a Gaussian weight to form the feature of each sampled point (GFP), (2) build feature vectors for each orientation by concatenating the features of points grouped by orientation, (3) estimate the primary orientation by finding the feature vector with the largest norm which is constructed in the previous step, (4) modify the order of elements of GFP, and (5) finally concatenate the features of all sampled points in a certain order to form the complete feature descriptor. At last, we propose a position-orientation-scale guided inlier recovery strategy (POS) by integrating the global position, orientation, and scale information and local texture information to further improve the matching performance, especially the number and distribution of correct matches in texture-less and complex areas. Experimental results on various multimodal datasets from remote sensing, medical, and computer vision imaging domains show that POS-GIFT outperforms the top eight state-of-the-art multimodal image feature matching algorithms which are five handcrafted-based methods, OS-SIFT, PSO-SIFT, LGHD, RIFT, and LNIFT, and three learning-based methods RedFeat, MatchFormer, and SemLA by several times in terms of correct matches while improving the root-mean-square error to around 1 pixel. Our implementation is available at https://github.com/Zhuolu-Hou/POS-GIFT .

Robust and Efficient Method for Matching Features in Omnidirectional Images

Performance evaluation of feature detection and matching in stereo visual odometry.

Real-time and High Precision Feature Matching Between Blur Aerial Images

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Multi-features Guided Robust Visual Tracking.

A Robust Correspondence Matching Algorithm of Ground Images along the Optic Axis

Equivalent Projection Based Distortion Invariant Visual Tracking for Omnidirectional Vision.

A Robust Oriented Filter-Based Matching Method for Multisource, Multitemporal Remote Sensing Images

A robust image feature matching algorithm

Detector-Free Feature Matching for Optical and SAR Images Based on a Two-Step Strategy

Robust Template Matching with Large Angle Localization.

A Novel Fast and Robust Multimodal Images Matching Method Based on Primary Structure-Weighted Orientation Consistency

Binocular Visual Measurement Method Based on Feature Matching

A Robust Method for Constructing Rotational Invariant Descriptors

Visual Adaptive Tracking for Monocular Omnidirectional Camera

POS-GIFT: A Geometric and Intensity-Invariant Feature Transformation for Multimodal Images

Binocular Vision Sequence Image Feature Correspondence and Motion Detection Based on Cross Ratio Invariant

The Inter-Frame Feature Matching and Tracking of Binocular Vision Based on the ORB-PyrLK Algorithm

A radiometric and rotational invariant feature descriptor for multimodal remote sensing image matching using the monogenic signal

An Efficient and Precise Remote Sensing Optical Image Matching Technique Using Binary-Based Feature Points

Feature Matching Based on Triangle Guidance and Constraints