Abstract:The nonlinear radiation distortions (NRD) among multimodal remote sensing images bring enormous challenges to image registration. The traditional feature-based registration methods commonly use the image intensity or gradient information to detect and describe the features that are sensitive to NRD. However, the nonlinear mapping of the corresponding features of the multimodal images often results in failure of the feature matching, as well as the image registration. In this paper, a modality-free multimodal remote sensing image registration method (SRIFT) is proposed for the registration of multimodal remote sensing images, which is invariant to scale, radiation, and rotation. In SRIFT, the nonlinear diffusion scale (NDS) space is first established to construct a multi-scale space. A local orientation and scale phase congruency (LOSPC) algorithm are then used so that the features of the images with NRD are mapped to establish a one-to-one correspondence, to obtain sufficiently stable key points. In the feature description stage, a rotation-invariant coordinate (RIC) system is adopted to build a descriptor, without requiring estimation of the main direction. The experiments undertaken in this study included one set of simulated data experiments and nine groups of experiments with different types of real multimodal remote sensing images with rotation and scale differences (including synthetic aperture radar (SAR)/optical, digital surface model (DSM)/optical, light detection and ranging (LiDAR) intensity/optical, near-infrared (NIR)/optical, short-wave infrared (SWIR)/optical, classification/optical, and map/optical image pairs), to test the proposed algorithm from both quantitative and qualitative aspects. The experimental results showed that the proposed method has strong robustness to NRD, being invariant to scale, radiation, and rotation, and the achieved registration precision was better than that of the state-of-the-art methods.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the challenges brought by Nonlinear Radiation Distortions (NRD) encountered in multi - modal remote sensing image registration. Traditional feature - based registration methods usually use image intensity or gradient information to detect and describe features, and these features are sensitive to NRD. However, due to the nonlinear mapping of corresponding features between multi - modal images caused by different imaging mechanisms, feature matching often fails, which in turn affects the effect of image registration. Therefore, this paper proposes a new multi - modal remote sensing image registration method - Scale - Radiation - Rotation - Invariant Feature Transform (SRIFT), aiming to overcome the above problems and achieve robustness to scale, radiation and rotation changes. Specifically, the SRIFT method captures structural features by constructing a Nonlinear Diffusion Scale (NDS), and uses the Local Orientation and Scale Phase Congruency (LOSPC) algorithm to establish a unified space, so that the image features with NRD can establish a one - to - one correspondence, thereby obtaining sufficiently stable feature points. In the feature description stage, a Rotation - Invariant Coordinate (RIC) system is used to construct descriptors, and rotation invariance can be achieved without estimating the main direction. Experimental results show that the proposed SRIFT method has strong robustness to NRD, performs well in terms of scale, radiation and rotation, and the registration accuracy is better than existing methods.

Modality-Free Feature Detector and Descriptor for Multimodal Remote Sensing Image Registration

A Novel Robust Feature Descriptor for Multi-Source Remote Sensing Image Registration

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

An Iterative SIFT Based on Intensity and Spatial Information for Remote Sensing Image Registration

A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation

Iterative Scale-Invariant Feature Transform for Remote Sensing Image Registration

Robust Multimodal Remote Sensing Image Registration Based on Local Statistical Frequency Information

A New Registration Algorithm for Multimodal Remote Sensing Images.

Multi-source Remote Sensing Image Registration Based on Sift and Optimization of Local Self-Similarity Mutual Information

A novel multimodal remote-sensing image registration algorithm using phase symmetry and rank-based local self-similarity

Multimodal Remote Sensing Image Registration Based on Adaptive Spectrum Congruency

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

Universal SAR and optical image registration via a novel SIFT framework based on nonlinear diffusion and a polar spatial-frequency descriptor

Optical Remote Sensing Image Registration Using Spatial-Consistency and Average Regional Information Divergence Minimization Via Quantum-Behaved Particle Swarm Optimization.

Optical and SAR Image Registration Based on Multi-Scale Orientated Map of Phase Congruency

A Robust Multisource Image Automatic Registration System Based on the Sift Descriptor

A Fast and Robust Matching System for Multimodal Remote Sensing Image Registration

Combining Optimized SAR-SIFT Features and RD Model for Multisource SAR Image Registration

Multi-sensor Image Registration by Combining Local Self-Similarity Matching and Mutual Information

Remote Sensing Image Registration Using Multiple Image Features

Multi-spectral Remote Sensing Image Registration Via Spatial Relationship Analysis on Sift Keypoints