Abstract:Deep feature learning methods have shown significant advantages over handcrafted feature-based methods in remote sensing image matching and registration. Existing deep learning methods usually introduce complex modules into the deep convolutional network for more robust feature learning. However, they usually require high computation and memory resources for the computing device and have expensive time costs for image registration. As a basic image processing task, it is crucial to build a lightweight matching network for fast and accurate image matching and registration. Unfortunately, the image matching performance will decrease significantly when we directly compress the deep model to a lightweight one. This paper proposes a lightweight matching network (LM-Net) based on the knowledge distillation (KD) learning framework for remote sensing image matching and registration. We first build an LM-Net with three convolutional layers. Then, this paper proposes an effective knowledge distillation approach for network optimization, which transfers the effective knowledge from the deep matching network to LM-Net to improve image matching performances. Specifically, this paper considers the useful information in the instance samples and the relation information between samples. It designs the feature and feature relation distillation learning for LM-Net training. Extensive experimental results and analysis have shown the effectiveness and advantages of the proposed LM-Net. LM-Net can reduce the number of parameters and computational complexity of the matching network. Meanwhile, LM-Net can significantly decrease the time cost and achieve results comparable to those of the deep model. It reduces the average image registration time by 42% on remote sensing image matching and registration. Additionally, LM-Net generalizes well on other multi-modal remote sensing images.

LTFormer: A Light-Weight Transformer-Based Self-Supervised Matching Network for Heterogeneous Remote Sensing Images

A Light-weight Transformer-based Self-supervised Matching Network for Heterogeneous Images

Self-Supervised Keypoint Detection and Cross-Fusion Matching Networks for Multimodal Remote Sensing Image Registration

LM-Net: A Lightweight Matching Network for Remote Sensing Image Matching and Registration

LSV-ANet: Deep Learning on Local Structure Visualization for Feature Matching

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

LMAFormer: Local Motion Aware Transformer for Small Moving Infrared Target Detection

STFNet: Self-Supervised Transformer for Infrared and Visible Image Fusion

SAR–Optical Image Matching Using Self-Supervised Detection and a Transformer–CNN-Based Network

Learning Enriched Feature Descriptor for Image Matching and Visual Measurement

Near-infrared Fusion for Deep Lightness Enhancement

Image Matching and Localization Based on Fusion of Handcrafted and Deep Features

A Novel Neural Network for Remote Sensing Image Matching

Explore Better Network Framework for High-Resolution Optical and SAR Image Matching

StateNet: Deep State Learning for Robust Feature Matching of Remote Sensing Images

UAV image matching from handcrafted to deep local features

A Robust Multisource Remote Sensing Image Matching Method Utilizing Attention and Feature Enhancement Against Noise Interference

Multimodal Remote Sensing Image Matching via Learning Features and Attention Mechanism

MFST: Multi-Modal Feature Self-Adaptive Transformer for Infrared and Visible Image Fusion

A lightweight deep convolutional network with inverted residuals for matching optical and SAR images