Abstract:Deep feature learning methods have shown significant advantages over handcrafted feature-based methods in remote sensing image matching and registration. Existing deep learning methods usually introduce complex modules into the deep convolutional network for more robust feature learning. However, they usually require high computation and memory resources for the computing device and have expensive time costs for image registration. As a basic image processing task, it is crucial to build a lightweight matching network for fast and accurate image matching and registration. Unfortunately, the image matching performance will decrease significantly when we directly compress the deep model to a lightweight one. This paper proposes a lightweight matching network (LM-Net) based on the knowledge distillation (KD) learning framework for remote sensing image matching and registration. We first build an LM-Net with three convolutional layers. Then, this paper proposes an effective knowledge distillation approach for network optimization, which transfers the effective knowledge from the deep matching network to LM-Net to improve image matching performances. Specifically, this paper considers the useful information in the instance samples and the relation information between samples. It designs the feature and feature relation distillation learning for LM-Net training. Extensive experimental results and analysis have shown the effectiveness and advantages of the proposed LM-Net. LM-Net can reduce the number of parameters and computational complexity of the matching network. Meanwhile, LM-Net can significantly decrease the time cost and achieve results comparable to those of the deep model. It reduces the average image registration time by 42% on remote sensing image matching and registration. Additionally, LM-Net generalizes well on other multi-modal remote sensing images.

LM-Net: A Lightweight Matching Network for Remote Sensing Image Matching and Registration

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Self-Distillation Feature Learning Network for Optical and SAR Image Registration

Deep Metric Learning Based on Scalable Neighborhood Components for Remote Sensing Scene Characterization

Deep Feature Correlation Learning for Multi-Modal Remote Sensing Image Registration

A Light-weight Transformer-based Self-supervised Matching Network for Heterogeneous Images

Deep Continuous Matching Network for More Robust Multi-Modal Remote Sensing Image Patch Matching

StateNet: Deep State Learning for Robust Feature Matching of Remote Sensing Images

LTFormer: A Light-Weight Transformer-Based Self-Supervised Matching Network for Heterogeneous Remote Sensing Images

Explore Better Network Framework for High-Resolution Optical and SAR Image Matching

Sparse-to-Dense Matching Network for Large-scale LiDAR Point Cloud Registration

A Novel Neural Network for Remote Sensing Image Matching

A Lightweight Convolutional Neural Network Based on Channel Multi-Group Fusion for Remote Sensing Scene Classification

Lightweight High-Resolution Remote Sensing Scene Classification via Adaptive Enhanced Knowledge Distillation.

A Deep Learning Framework for Remote Sensing Image Registration

A Light-Weight Stereo Matching Network Based on Multi-Scale Features Fusion and Robust Disparity Refinement

HDMNet: A Hierarchical Matching Network with Double Attention for Large-scale Outdoor LiDAR Point Cloud Registration

UNSUPERVISED MULTI-CONSTRAINT DEEP NEURAL NETWORK FOR DENSE IMAGE MATCHING

Lightweight Progressive Multilevel Feature Collaborative Network for Remote Sensing Image Salient Object Detection

LM-Net: A light-weight and multi-scale network for medical image segmentation

Deep Generative Matching Network for Optical and SAR Image Registration