Abstract:Local feature extraction plays a crucial role in numerous critical visual tasks. However, there remains room for improvement in both descriptors and keypoints, particularly regarding the discriminative power of descriptors and the localization precision of keypoints. To address these challenges, this study introduces a novel local feature extraction pipeline named OSDFeat (Object and Spatial Discrimination Feature). OSDFeat employs a decoupling strategy, training descriptor and detection networks independently. Inspired by semantic correspondence, we propose an Object and Spatial Discrimination ResUNet (OSD-ResUNet). OSD-ResUNet captures features from the feature map that differentiate object appearance and spatial context, thus enhancing descriptor performance. To further improve the discriminative capability of descriptors, we propose a Discrimination Information Retained Normalization module (DIRN). DIRN complementarily integrates spatial-wise normalization and channel-wise normalization, yielding descriptors that are more distinguishable and informative. In the detection network, we propose a Cross Saliency Pooling module (CSP). CSP employs a cross-shaped kernel to aggregate long-range context in both vertical and horizontal dimensions. By enhancing the saliency of keypoints, CSP enables the detection network to effectively utilize descriptor information and achieve more precise localization of keypoints. Compared to the previous best local feature extraction methods, OSDFeat achieves Mean Matching Accuracy of 79.4% in local feature matching task, improving by 1.9% and achieving state-of-the-art results. Additionally, OSDFeat achieves competitive results in Visual Localization and 3D Reconstruction. The results of this study indicate that object and spatial discrimination can improve the accuracy and robustness of local feature, even in challenging environments. The code is available at https://github.com/pandaandyy/OSDFeat.

Local Metric Learning for Exemplar-Based Object Detection.

A Lightweight SE-YOLOv3 Network for Multi-Scale Object Detection in Remote Sensing Imagery.

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Beyond Local Search: Tracking Objects Everywhere with Instance-Specific Proposals

Object and spatial discrimination makes weakly supervised local feature better

EMD Metric Learning

MM-FSOD: Meta and metric integrated few-shot object detection

An Object-Level Change Detection Method based on Lightweight Object Detector and Metric Matrix

Depth-discriminative Metric Learning for Monocular 3D Object Detection

In defense of local descriptor-based few-shot object detection

Metric networks for enhanced perception of non-local semantic information

Local feature matching from detector-based to detector-free: a survey

Localized Multifeature Metric Learning for Image-Set-Based Face Recognition

Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images

Localization-Aware Active Learning for Object Detection

Improving Object Detection via Local-global Contrastive Learning

Deep Localized Metric Learning.

3DLG-Detector: 3D Object Detection via Simultaneous Local-Global Feature Learning

Local to global purification strategy to realize collaborative camouflaged object detection

Object and Patch Based Anomaly Detection and Localization in Crowded Scenes