Abstract:A scheme that can achieve fast template matching by both traditional methods and neural network methods, called Hybrid Matching by Pixel Distribution Mapping (HMPDM), is proposed for the matching difficulty caused by the problem of nonlinear intensity differences between multi-modal images. The HMPDM scheme first extracts the distribution information of image pixels through the developed expanded Slice Transform (eSLT) matrix, to overcome the nonlinear intensity differences between visible and thermal infrared images; and then maps the eSLT matrices corresponding to different modal images into correlation surface images with the same modality through traditional integer mapping mechanism or neural network mapping mechanism; finally, template matching between visible and thermal infrared images is achieved by evaluating the similarity of correlation surface images through the Zero-mean Normalized Cross-Correlation (ZNCC) algorithm. The fast and classic ZNCC algorithm ensures the real-time performance of the HMPDM scheme in the most time-consuming sliding window matching stage. The traditional integer mapping mechanism and the neural network mapping mechanism enable the HMPDM scheme to use the traditional method and the neural network method alone to achieve template matching, or to combine the two methods to achieve template matching. The comprehensive utilization of traditional methods and neural network methods makes the HMPDM scheme adaptable to various platforms with limited hardware resources. The experimental results show that, on a hardware platform with limited resources, it only takes 0.18 seconds for a 64×64 template image to slide on a 256×256 query image to achieve template matching; and it only takes at least 1.2 seconds for neural network training on the CPU. The matching performance is also better than many popular multi-modal image template matching algorithms.

Fourier Domain Adaptive Multi-Modal Remote Sensing Image Template Matching Based on Siamese Network

Remote Sensing Multimodal Image Matching Based on Structure Feature and Learnable Matching Network

Fast and Robust Matching for Multimodal Remote Sensing Image Registration

Optical and SAR Image Matching Using Pixelwise Deep Dense Features

Explore Better Network Framework for High-Resolution Optical and SAR Image Matching

A Novel Neural Network for Remote Sensing Image Matching

StateNet: Deep State Learning for Robust Feature Matching of Remote Sensing Images

Multimodal Remote Sensing Image Matching via Learning Features and Attention Mechanism

A Light-weight Transformer-based Self-supervised Matching Network for Heterogeneous Images

Multifeature Alignment and Matching Network for SAR and Optical Image Registration

Unsupervised SAR and Optical Image Matching Using Siamese Domain Adaptation

Fast Template Matching in Multi-modal Image under Pixel Distribution Mapping

TS-Net: Combining modality specific and common features for multimodal patch matching

Deep Siamese Domain Adaptation Convolutional Neural Network for Cross-domain Change Detection in Multispectral Images

Multimodal Remote Sensing Image Matching Combining Learning Features and Delaunay Triangulation

Multispectral Remote Sensing Image Matching via Image Transfer by Regularized Conditional Generative Adversarial Networks and Local Feature

SFOC: A NOVEL MULTI-DIRECTIONAL AND MULTI-SCALE STRUCTURAL DESCRIPTOR FOR MULTIMODAL REMOTE SENSING IMAGE MATCHING

DRFD-Net: Using Dual Receptive Field Descriptors for Multitemporal Optical Remote Sensing Image Registration

Multi-Modal Target Detection Method Based on Adaptive Feature Search

Deep Feature Correlation Learning for Multi-Modal Remote Sensing Image Registration

Adaptive Multiscale Deep Fusion Residual Network for Remote Sensing Image Classification