Abstract:Local feature extraction plays a crucial role in numerous critical visual tasks. However, there remains room for improvement in both descriptors and keypoints, particularly regarding the discriminative power of descriptors and the localization precision of keypoints. To address these challenges, this study introduces a novel local feature extraction pipeline named OSDFeat (Object and Spatial Discrimination Feature). OSDFeat employs a decoupling strategy, training descriptor and detection networks independently. Inspired by semantic correspondence, we propose an Object and Spatial Discrimination ResUNet (OSD-ResUNet). OSD-ResUNet captures features from the feature map that differentiate object appearance and spatial context, thus enhancing descriptor performance. To further improve the discriminative capability of descriptors, we propose a Discrimination Information Retained Normalization module (DIRN). DIRN complementarily integrates spatial-wise normalization and channel-wise normalization, yielding descriptors that are more distinguishable and informative. In the detection network, we propose a Cross Saliency Pooling module (CSP). CSP employs a cross-shaped kernel to aggregate long-range context in both vertical and horizontal dimensions. By enhancing the saliency of keypoints, CSP enables the detection network to effectively utilize descriptor information and achieve more precise localization of keypoints. Compared to the previous best local feature extraction methods, OSDFeat achieves Mean Matching Accuracy of 79.4% in local feature matching task, improving by 1.9% and achieving state-of-the-art results. Additionally, OSDFeat achieves competitive results in Visual Localization and 3D Reconstruction. The results of this study indicate that object and spatial discrimination can improve the accuracy and robustness of local feature, even in challenging environments. The code is available at https://github.com/pandaandyy/OSDFeat.

LoDisc: Learning Global-Local Discriminative Features for Self-Supervised Fine-Grained Visual Recognition

Align Yourself: Self-supervised Pre-training for Fine-grained Recognition via Saliency Alignment.

Exploring Localization for Self-supervised Fine-grained Contrastive Learning

Point Contrastive Prediction with Semantic Clustering for Self-Supervised Learning on Point Cloud Videos

Distilling Localization for Self-Supervised Representation Learning

Saliency Guided Contrastive Learning on Scene Images

Self-Supervised Global–Local Contrastive Learning for Fine-Grained Change Detection in VHR Images

Localized Region Contrast for Enhancing Self-Supervised Learning in Medical Image Segmentation

Local Feature Discriminant Projection

Learning multi-view visual correspondences with self-supervision

Contrastive Self-supervised Representation Learning Using Synthetic Data

P4Contrast: Contrastive Learning with Pairs of Point-Pixel Pairs for RGB-D Scene Understanding

Unsupervised Local Discrimination for Medical Images

LPCL: Localized Prominence Contrastive Learning for Self-Supervised Dense Visual Pre-Training

Object and spatial discrimination makes weakly supervised local feature better

SegContrast: 3D Point Cloud Feature Representation Learning Through Self-Supervised Segment Discrimination

Searching and Learning Discriminative Regions for Fine-Grained Image Retrieval and Classification

Self-Adaptive Local Fisher Discriminant Analysis for Semi-Supervised Image Recognition

Dense Semantic Contrast for Self-Supervised Visual Representation Learning

On Learning Discriminative Features from Synthesized Data for Self-Supervised Fine-Grained Visual Recognition

Dcpoint: Global-Local Dual Contrast for Self-Supervised Representation Learning of 3d Point Clouds