Abstract:Local features detection and description are widely used in many vision applications with high industrial and commercial demands. With large-scale applications, these tasks raise high expectations for both the accuracy and speed of local features. Most existing studies on local features learning focus on the local descriptions of individual keypoints, which neglect their relationships established from global spatial awareness. In this paper, we present AWDesc with a consistent attention mechanism (CoAM) that opens up the possibility for local descriptors to embrace image-level spatial awareness in both the training and matching stages. For local features detection, we adopt local features detection with feature pyramid to obtain more stable and accurate keypoints localization. For local features description, we provide two versions of AWDesc to cope with different accuracy and speed requirements. On the one hand, we introduce Context Augmentation to address the inherent locality of convolutional neural networks by injecting non-local context information, so that local descriptors can "look wider to describe better". Specifically, well-designed Adaptive Global Context Augmented Module (AGCA) and Diverse Surrounding Context Augmented Module (DSCA) are proposed to construct robust local descriptors with context information from global to surrounding. On the other hand, we design an extremely lightweight backbone network coupled with the proposed special knowledge distillation strategy to achieve the best trade-off in accuracy and speed. What is more, we perform thorough experiments on image matching, homography estimation, visual localization, and 3D reconstruction tasks, and the results demonstrate that our method surpasses the current state-of-the-art local descriptors. Code is available at: https://github.com/vignywang/AWDesc.

The Variants of Weber Local Descriptor and Their Applications for Biometrics.

Learning a Locality Preserving Subspace for Visual Recognition.

WLD: A Robust Local Image Descriptor

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Weber Vector Local Pattern

A Robust Descriptor Based on Weber’s Law

A Novel Weber Local Binary Descriptor for Fingerprint Liveness Detection

Weber Binary Pattern and Weber Ternary Pattern for Illumination-Robust Face Recognition.

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

A Novel Face Recognition Method Based on IWLD and IWBC.

Face Recognition Based on Curvelets and Local Binary Pattern Features Via Using Local Property Preservation

Face Recognition Using Data Driven Local Appearance Features

Attention Weighted Local Descriptors

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

Face Recognition Using Local Variation

A Performance Evaluation of Local Descriptors, Direction Coding and Correlation Filters for Palm Vein Recognition.

Feature Extraction By Locality-Based Linear Discriminant Analysis

Local Binary Patterns and Its Application to Facial Image Analysis: A Survey

Local Feature Descriptor for Image Matching: A Survey

An enhanced Local Ternary Patterns method for face recognition