Abstract:Deep feature learning methods have shown significant advantages over handcrafted feature-based methods in remote sensing image matching and registration. Existing deep learning methods usually introduce complex modules into the deep convolutional network for more robust feature learning. However, they usually require high computation and memory resources for the computing device and have expensive time costs for image registration. As a basic image processing task, it is crucial to build a lightweight matching network for fast and accurate image matching and registration. Unfortunately, the image matching performance will decrease significantly when we directly compress the deep model to a lightweight one. This paper proposes a lightweight matching network (LM-Net) based on the knowledge distillation (KD) learning framework for remote sensing image matching and registration. We first build an LM-Net with three convolutional layers. Then, this paper proposes an effective knowledge distillation approach for network optimization, which transfers the effective knowledge from the deep matching network to LM-Net to improve image matching performances. Specifically, this paper considers the useful information in the instance samples and the relation information between samples. It designs the feature and feature relation distillation learning for LM-Net training. Extensive experimental results and analysis have shown the effectiveness and advantages of the proposed LM-Net. LM-Net can reduce the number of parameters and computational complexity of the matching network. Meanwhile, LM-Net can significantly decrease the time cost and achieve results comparable to those of the deep model. It reduces the average image registration time by 42% on remote sensing image matching and registration. Additionally, LM-Net generalizes well on other multi-modal remote sensing images.

A KM-Net Model Based on K-Means Weight Initialization for Images Classification

Initialization of CNN Models for Training on a Small Dataset Using Importance of Filter Parameters

How To Initialize The Cnn For Small Datasets: Extracting Discriminative Filters From Pre-Trained Model

Remote Sensing Image Classification Method Based on Deep Convolution Neural Network and Multi-kernel Learning

Isomorphic Model-Based Initialization for Convolutional Neural Networks

Gaussian process image classification based on multi-layer convolution kernel function

Automatic Kernel Size Determination for Deep Neural Networks Based Hyperspectral Image Classification

JM-Net and Cluster-SVM for Aerial Scene Classification

A New Convolutional Kernel Classifier for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Spatial and Spectral Kernels Generation Network

Kolmogorov-Arnold Network for Satellite Image Classification in Remote Sensing

KLDivNet: An unsupervised neural network for multi-modality image registration

Research on a Convolution Kernel Initialization Method for Speeding Up the Convergence of CNN

LKM-UNet: Large Kernel Vision Mamba UNet for Medical Image Segmentation

LM-Net: A Lightweight Matching Network for Remote Sensing Image Matching and Registration

DKM: Differentiable K-Means Clustering Layer for Neural Network Compression

Learning Kernel for Conditional Moment-Matching Discrepancy-Based Image Classification

A Multi-size Kernels CNN with Eye Movement Guided Task-Specific Initialization for Aurora Image Classification.

Deep Convolutional Representations and Kernel Extreme Learning Machines for Image Classification

LMFRNet: A Lightweight Convolutional Neural Network Model for Image Analysis

M+Mnet: A Multibranch Network with Mixed Precision Training for Image Aesthetics Assessment