Abstract:The nonlinear radiation distortions (NRD) among multimodal remote sensing images bring enormous challenges to image registration. The traditional feature-based registration methods commonly use the image intensity or gradient information to detect and describe the features that are sensitive to NRD. However, the nonlinear mapping of the corresponding features of the multimodal images often results in failure of the feature matching, as well as the image registration. In this paper, a modality-free multimodal remote sensing image registration method (SRIFT) is proposed for the registration of multimodal remote sensing images, which is invariant to scale, radiation, and rotation. In SRIFT, the nonlinear diffusion scale (NDS) space is first established to construct a multi-scale space. A local orientation and scale phase congruency (LOSPC) algorithm are then used so that the features of the images with NRD are mapped to establish a one-to-one correspondence, to obtain sufficiently stable key points. In the feature description stage, a rotation-invariant coordinate (RIC) system is adopted to build a descriptor, without requiring estimation of the main direction. The experiments undertaken in this study included one set of simulated data experiments and nine groups of experiments with different types of real multimodal remote sensing images with rotation and scale differences (including synthetic aperture radar (SAR)/optical, digital surface model (DSM)/optical, light detection and ranging (LiDAR) intensity/optical, near-infrared (NIR)/optical, short-wave infrared (SWIR)/optical, classification/optical, and map/optical image pairs), to test the proposed algorithm from both quantitative and qualitative aspects. The experimental results showed that the proposed method has strong robustness to NRD, being invariant to scale, radiation, and rotation, and the achieved registration precision was better than that of the state-of-the-art methods.

An Infrared-Optical Image Registration Method for Industrial Blower Monitoring Based on Contour-Shape Descriptors

A Fully Automatic Registration Approach Based on Contour and SIFT for HJ-1 Images

Abnormal Temperature Detection of Blower Components Based on Infrared Video Images Analysis

Infrared and Visible Image Registration in UAV Inspection

A Robust Method for Electrical Equipment Infrared and Visible Image Registration

Image-based Process Monitoring Using Deep Learning Framework

A Robust Infrared and Visible Image Registration Method for Dual Sensor UAV System

Robust and Efficient Registration of Infrared and Visible Images for Vehicular Imaging Systems

Registration of infrared and visible light image based on visual saliency and scale invariant feature transform

Research on Infrared and Visible Image Registration Algorithm for Complex Road Scenes.

Radiation-Variation Insensitive Coarse-to-Fine Image Registration for Infrared and Visible Remote Sensing Based on Zero-Shot Learning

Visible And Infrared Image Registration Algorithm Based On Nsct And Gradient Mirroring

Automatic image registration by local descriptors in remote sensing

Modality-Free Feature Detector and Descriptor for Multimodal Remote Sensing Image Registration

Towards RGB-NIR Cross-modality Image Registration and Beyond

An Image Registration Method Using Deep Residual Network Features for Multisource High-Resolution Remote Sensing Images

A Hierarchical Bayesian Fusion Method of Infrared and Visible Images for Temperature Monitoring of High-Speed Direct-Drive Blower

Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images

A Global-to-Local Algorithm for High-Resolution Optical and SAR Image Registration.

Multi-sensor Image Registration Using Multi-Resolution Shape Analysis

Medical Image Registration via Neural Fields