Abstract:Recent advances on feature descriptors for image matching put more emphasis on encoding invariances (e.g. illumination invariance) to promote the descriptors’ discriminative power. However, according to the information entropy, more invariance implies greater certainty and less informativeness in a descriptor. Consequently, descriptors encoding too many invariances usually show poor generalization to unknown image changes, lacking enough informativeness to cover the large uncertainty in unseen scenes. This limits the application scenarios of learned descriptors. In this paper, we propose to alleviate this issue from the perspective of informativeness and we thus design hierarchical consistent constraint by introducing regression feedback in a self-supervised manner. Combined with the hardest-within-batch matching constraint, we form a novel dual supervision framework, to encourage the descriptor to learn an informative representation while maintaining a good discriminative power. Moreover, to fully mine the context information hidden in image and boost the informativeness in turn, we present AANet, a descriptor network that efficiently predicts dense description by the powerful Attentional Aggregation of multi-level features. Experiments across challenging feature matching on HPatches, RDNIM datasets, and visual localization tasks on Aachen Day-night dataset show that our method outperforms recent state-of-the-art descriptors while keeping encouraging efficiency. The application of visual 3D reconstruction on various scenarios also demonstrates the high generalization ability of our method.

A Novel Supervised Approach to Learning Efficient Kernel Descriptors for High Accuracy Object Recognition

Supervised Kernel Descriptors for Visual Recognition

Efficient kernel descriptor for image categorization via pivots selection

Discriminative Kernel Feature Extraction and Learning for Object Recognition and Detection.

SEKD: Self-Evolving Keypoint Detection and Description

Efficient Image Representation for Object Recognition Via Pivots Selection

Object Classification And Detection With Context Kernel Descriptors

Kernel optimization-based discriminant analysis for face recognition

Learning to Combine Kernels for Object Categorization

Learning Kernel Extended Dictionary for Face Recognition

Object Classification Using Context Cue and Kernel Entropy Component Analysis

Semi-supervised Object Recognition Using Structure Kernel

Supervised Transfer Kernel Sparse Coding for Image Classification

Kernel-Optimized Based Machine for Image Recognition

Kernel Optimization Based Semi-Supervised KBDA Scheme for Image Retrieval.

Class specific discriminant dictionary learning with kernels for face recognition

Learning General Descriptors for Image Matching with Regression Feedback

Learning Object-to-Class Kernels for Scene Classification.

Digging Into Self-Supervised Learning of Feature Descriptors

Kernelized Pyramid Nearest-Neighbor Search for Object Categorization