Abstract:Deep convolutional networks are powerful for local feature learning and have shown advantages in image matching and registration. However, the significant differences between cross-modal images increase the challenge of image registration. The deep network should extract modality-invariant features to identify the matching samples and discriminative features to separate the nonmatching samples. The deep network can extract features invariant to the image modality changes by multiple nonlinear mapping layers. However, it does not inevitably lose rich details and affect the discrimination of features, degrading registration performances. This article proposes a novel deep wavelet learning network (DW-Net) for local feature learning. It incorporates spectral information into deep convolutional features for improving cross-modal image matching and registration. Specifically, this article aims to learn the multiresolution wavelet features through multilevel wavelet transform (WT) and the convolutional network. The cross-modal images are divided into low-frequency and high-frequency parts through WT. DW-Net can adaptively extract the shared features from the low-frequency part and useful details from the high-frequency part, which can enhance the modality invariance and discrimination of features. Additionally, the multiresolution wavelet features contain multiscale information and contribute to improving the matching accuracy. Extensive experiments demonstrate the significant advantages in terms of the accuracy and robustness of DW-Net on cross-modal remote sensing image registration. DW-Net can increase the image patch matching accuracy by 3.7% and improve image registration probability by 12.1%. Moreover, DW-Net shows strong generalization performances from low resolution to high resolution and from optical– synthetic aperture radar to other cross-modal image registration.

Multiresolution Algorithm of Wavelet Network Learning from Absent Training Data

Super-resolution Reconstruction Algorithms Based on Fusion of Deep Learning Mechanism and Wavelet

Identifying nonlinear dynamic system using the improved multiresolution wave-net

Wavelet Siamese Network for Change Detection in Remote Sensing Images

Model of Information Security Risk Assessment Based on Improved Wavelet Neural Network.

A Multilayer Complex Neural Network Training Algorithm and Its Application in Adaptive Equalization

Unsupervised Learning with Waveform Multi-Branch Attention Mechanism for Erratic Noise Attenuation

A Hierarchical Evolutionary Algorithm for Constructing and Training Wavelet Networks.

Distributed wavelet neural networks

Seismic Data Reconstruction via Wavelet-Based Residual Deep Learning

Wavelet Regularization Benefits Adversarial Training

Residual Attention Network for Wavelet Domain Super-Resolution

Dual-Attention-Based Wavelet Integrated CNN Constrained Via Stochastic Structural Similarity for Seismic Data Reconstruction

Wavelet Based OE Model Identification with Random Missing Data

Prediction of Low-Frequency Seismic Data Without Relying on Wavelet Using Deep Learning

Efficient and Robust: A Cross-Modal Registration Deep Wavelet Learning Method for Remote Sensing Images

An Innovative Networks in Federated Learning

Task-Driven Learning Downsampling Network Based Phase-Resolved Wave Fields Reconstruction with Remote Optical Observations

MLWAN: Multi-Scale Learning Wavelet Attention Module Network for Image Super Resolution

Unsupervised Learning Method for the Wave Equation Based on Finite Difference Residual Constraints Loss

WaveSNet: Wavelet Integrated Deep Networks for Image Segmentation