Abstract:Traditional image feature matching methods cannot obtain satisfactory results for multi-modal remote sensing images (MRSIs) in most cases because different imaging mechanisms bring significant nonlinear radiation distortion differences (NRD) and complicated geometric distortion. The key to MRSI matching is trying to weakening or eliminating the NRD and extract more edge features. This paper introduces a new robust MRSI matching method based on co-occurrence filter (CoF) space matching (CoFSM). Our algorithm has three steps: (1) a new co-occurrence scale space based on CoF is constructed, and the feature points in the new scale space are extracted by the optimized image gradient; (2) the gradient location and orientation histogram algorithm is used to construct a 152-dimensional log-polar descriptor, which makes the multi-modal image description more robust; and (3) a position-optimized Euclidean distance function is established, which is used to calculate the displacement error of the feature points in the horizontal and vertical directions to optimize the matching distance function. The optimization results then are rematched, and the outliers are eliminated using a fast sample consensus algorithm. We performed comparison experiments on our CoFSM method with the scale-invariant feature transform (SIFT), upright-SIFT, PSO-SIFT, and radiation-variation insensitive feature transform (RIFT) methods using a multi-modal image dataset. The algorithms of each method were comprehensively evaluated both qualitatively and quantitatively. Our experimental results show that our proposed CoFSM method can obtain satisfactory results both in the number of corresponding points and the accuracy of its root mean square error. The average number of obtained matches is namely 489.52 of CoFSM, and 412.52 of RIFT. As mentioned earlier, the matching effect of the proposed method was significantly greater than the three state-of-art methods. Our proposed CoFSM meth-d achieved good effectiveness and robustness. Executable programs of CoFSM and MRSI datasets are published: https://skyearth.org/publication/project/CoFSM/

Multispectral Image Alignment with Nonlinear Scale-Invariant Keypoint and Enhanced Local Feature Matrix

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Multiscale Point Correspondence Using Feature Distribution and Frequency Domain Alignment

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

Multimodal Image Alignment Through a Multiscale Chain of Neural Networks with Application to Remote Sensing

Image Matching by Multiscale Oriented Corner Correlation

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

Multifeature Alignment and Matching Network for SAR and Optical Image Registration

CNLPA-MVS: Coarse-Hypotheses Guided Non-Local PatchMatch Multi-View Stereo

Optical and SAR Image Registration Based on Multi-Scale Orientated Map of Phase Congruency

Shared contents alignment across multiple granularities for robust SAR-optical image matching

Feature Matching for Remote-Sensing Image Registration via Neighborhood Topological and Affine Consistency

Nonlinear Intensity, Scale and Rotation Invariant Matching for Multimodal Images

Multi-sensor Image Matching Based on Line Features under Complex Object Conditions

Robust Optical and SAR Image Matching Using Attention-Enhanced Structural Features

Multi-Modal Remote Sensing Image Matching Considering Co-Occurrence Filter

Reliable Line Segment Matching for Multispectral Images Guided by Intersection Matches

Multispectral Remote Sensing Image Matching via Image Transfer by Regularized Conditional Generative Adversarial Networks and Local Feature

Remote Sensing Multimodal Image Matching Based on Structure Feature and Learnable Matching Network

A Novel Fast and Robust Multimodal Images Matching Method Based on Primary Structure-Weighted Orientation Consistency