Abstract:Recently, feature relation learning has attracted extensive attention in cross-spectral image patch matching. However, most feature relation learning methods can only extract shallow feature relations and are accompanied by the loss of useful discriminative features or the introduction of disturbing features. Although the latest multi-branch feature difference learning network can relatively sufficiently extract useful discriminative features, the multi-branch network structure it adopts has a large number of parameters. Therefore, we propose a novel two-branch feature interaction learning network (FIL-Net). Specifically, a novel feature interaction learning idea for cross-spectral image patch matching is proposed, and a new feature interaction learning module is constructed, which can effectively mine common and private features between cross-spectral image patches, and extract richer and deeper feature relations with invariance and discriminability. At the same time, we re-explore the feature extraction network for the cross-spectral image patch matching task, and a new two-branch residual feature extraction network with stronger feature extraction capabilities is constructed. In addition, we propose a new multi-loss strong-constrained optimization strategy, which can facilitate reasonable network optimization and efficient extraction of invariant and discriminative features. Furthermore, a public VIS-LWIR patch dataset and a public SEN1-2 patch dataset are constructed. At the same time, the corresponding experimental benchmarks are established, which are convenient for future research while solving few existing cross-spectral image patch matching datasets. Extensive experiments show that the proposed FIL-Net achieves state-of-the-art performance in three different cross-spectral image patch matching scenarios.

Rf-Net: An End-To-End Image Matching Network Based On Receptive Field

RFNet - Recurrent Forward Network for Dense Point Cloud Completion.

NeRF-Loc: Visual Localization with Conditional Neural Radiance Field.

RFN-Nest: An end-to-end residual fusion network for infrared and visible images

A Novel Neural Network for Remote Sensing Image Matching

The NeRFect Match: Exploring NeRF Features for Visual Localization

RF-Net: Unsupervised Low-Light Image Enhancement Based on Retinex and Exposure Fusion

Representative Feature Matching Network for Image Retrieval

Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identification

RF-Next: Efficient Receptive Field Search for Convolutional Neural Networks

Efficient Feature Relation Learning Network for Cross-Spectral Image Patch Matching

A Concurrent Multiscale Detector for End-to-End Image Matching

LRF-Net: Learning Local Reference Frames for 3D Local Shape Description and Matching

StateNet: Deep State Learning for Robust Feature Matching of Remote Sensing Images

PersonNet: Person Re-identification with Deep Convolutional Neural Networks

FT-MDnet: A Deep-Frozen Transfer Learning Framework for Person Search

DSD-MatchingNet: Deformable Sparse-to-Dense Feature Matching for Learning Accurate Correspondences

RFP-Net: Receptive field-based proposal generation network for object detection

Feature Interaction Learning Network for Cross-Spectral Image Patch Matching

Refined Feature Enhancement Network for Object Detection

Person Re-Identification With Patch-Based Local Sparse Matching And Metric Learning