Abstract:Local feature extraction and matching has lately attracted increasing attention due to its wide application, especially in real-time automated systems. However, existing image matching methods struggle to balance the global receptive field and the efficient computation, which limits the practical applications. Recently, the State Space Model (SSM) has shown great potential in linear complexity and long-range dependency modeling. Therefore, in this paper, a local feature extraction and matching method using the SSM is proposed, which aims to achieve the tradeoff between global information extraction and model complexity. Firstly, a Local and Global Information Fusion (LGIF) block is developed to integrate local and global information and reduce model parameters through parallel SSM. Secondly, a backbone based on Euclidean group E(2) equivariant steerable Convolution (E2Conv) is designed to improve the model's robustness against geometric transformations. Finally, a self-supervised learning framework is constructed, which optimizes the ability of the network in local feature detection and description by combining four loss functions: keypoint localization loss, keypoint confidence score loss, descriptor triplet loss, and keypoint correspondence loss. Experimental results on public benchmark datasets Hpatches and RDNIM demonstrate that the proposed method has a significant advantage over existing methods in homography estimation tasks. Notably, our method outperforms the end-to-end dense matching method LoFTR by 6.11% under the 1-pixel error threshold on the Hpatches dataset, simultaneously with a smaller number of parameters and less average matching time.

Sparse-to-Local-Dense Matching for Geometry-Guided Correspondence Estimation.

Learning Two-View Correspondences and Geometry Via Local Neighborhood Correlation.

Geometry-aware Feature Matching for Large-Scale Structure from Motion

Sparse Representation with Geometric Configuration Constraint for Line Segment Matching

Non-rigid Dense Correspondence with Applications for Image Enhancement

DSD-MatchingNet: Deformable Sparse-to-Dense Feature Matching for Learning Accurate Correspondences

Unsupervised Feature Learning for Dense Correspondences Across Scenes

Geometric-aware Dense Matching Network for 6D Pose Estimation of Objects from RGB-D Images

U-Match: Exploring Hierarchy-Aware Local Context for Two-View Correspondence Learning

DeMatch: Deep Decomposition of Motion Field for Two-View Correspondence Learning

Dense Stereo Correspondence with Contrast Context Histogram, Segmentation-Based Two-Pass Aggregation and Occlusion Handling

MambaLF: an Efficient Local Feature Extraction and Matching with State Space Model

Two-View Correspondence Learning with Local Consensus Transformer

Learning Two-View Correspondences and Geometry Using Order-Aware Network

Dense Correspondence Using Non-Local DAISY Forest

Matching-to-Detecting: Establishing Dense and Reliable Correspondences Between Images.

Nonrigid Registration of Remote Sensing Images Via Sparse and Dense Feature Matching.

Efficient and Robust Shape Correspondence via Sparsity-Enforced Quadratic Assignment

Coarse-to-Fine PatchMatch for Dense Correspondence

SCENES: Subpixel Correspondence Estimation With Epipolar Supervision

Exploiting Correspondences with All-pairs Correlations for Multi-view Depth Estimation