Abstract:Deep convolutional networks are powerful for local feature learning and have shown advantages in image matching and registration. However, the significant differences between cross-modal images increase the challenge of image registration. The deep network should extract modality-invariant features to identify the matching samples and discriminative features to separate the nonmatching samples. The deep network can extract features invariant to the image modality changes by multiple nonlinear mapping layers. However, it does not inevitably lose rich details and affect the discrimination of features, degrading registration performances. This article proposes a novel deep wavelet learning network (DW-Net) for local feature learning. It incorporates spectral information into deep convolutional features for improving cross-modal image matching and registration. Specifically, this article aims to learn the multiresolution wavelet features through multilevel wavelet transform (WT) and the convolutional network. The cross-modal images are divided into low-frequency and high-frequency parts through WT. DW-Net can adaptively extract the shared features from the low-frequency part and useful details from the high-frequency part, which can enhance the modality invariance and discrimination of features. Additionally, the multiresolution wavelet features contain multiscale information and contribute to improving the matching accuracy. Extensive experiments demonstrate the significant advantages in terms of the accuracy and robustness of DW-Net on cross-modal remote sensing image registration. DW-Net can increase the image patch matching accuracy by 3.7% and improve image registration probability by 12.1%. Moreover, DW-Net shows strong generalization performances from low resolution to high resolution and from optical– synthetic aperture radar to other cross-modal image registration.

MoatNet: Registration for Multi-Temporal Optical Remote Sensing Images Using Deep Convolutional Features

Rotation-Invariant Siamese Network for Low-Altitude Remote-Sensing Image Registration

Registration of Multimodal Remote Sensing Image Based on Deep Fully Convolutional Neural Network

DRFD-Net: Using Dual Receptive Field Descriptors for Multitemporal Optical Remote Sensing Image Registration

Remote Sensing Image Registration Using Convolutional Neural Network Features.

Multimodal Remote Sensing Image Registration Based on Image Transfer and Local Features

Deep Feature Correlation Learning for Multi-Modal Remote Sensing Image Registration

A Multiscale Framework with Unsupervised Learning for Remote Sensing Image Registration

Remote Sensing Image Registration Based on Multi-Head Self-Attention Mechanism

A Deep Learning Framework for Remote Sensing Image Registration

Selective Context Network with Neighbourhood Consensus for Aerial Image Registration

A Two-Stage Deep Learning Registration Method for Remote Sensing Images Based on Sub-Image Matching

Robust registration of multi-modal remote sensing images based on multi-dimensional oriented self-similarity features

Self-Supervised Keypoint Detection and Cross-Fusion Matching Networks for Multimodal Remote Sensing Image Registration

An Image Registration Method Using Deep Residual Network Features for Multisource High-Resolution Remote Sensing Images

Efficient and Robust: A Cross-Modal Registration Deep Wavelet Learning Method for Remote Sensing Images

Registration of Multiresolution Remote Sensing Images Based on L2-Siamese Model

ADRNet: Affine and Deformable Registration Networks for Multimodal Remote Sensing Images

Multi-Feature Alignment and Matching Network for SAR and Optical Image Registration

A Novel Two-Step Registration Method for Remote Sensing Images Based on Deep and Local Features

Unsupervised Multimodal Remote Sensing Image Registration Via Domain Adaptation