Abstract:Recent innovations in training deep convolutional neural network (ConvNet) models have motivated the design of new methods to automatically learn local image descriptors. The latest deep ConvNets proposed for this task consist of a siamese network that is trained by penalising misclassification of pairs of local image patches. Current results from machine learning show that replacing this siamese by a triplet network can improve the classification accuracy in several problems, but this has yet to be demonstrated for local image descriptor learning. Moreover, current siamese and triplet networks have been trained with stochastic gradient descent that computes the gradient from individual pairs or triplets of local image patches, which can make them prone to overfitting. In this paper, we first propose the use of triplet networks for the problem of local image descriptor learning. Furthermore, we also propose the use of a global loss that minimises the overall classification error in the training set, which can improve the generalisation capability of the model. Using the UBC benchmark dataset for comparing local image descriptors, we show that the triplet network produces a more accurate embedding than the siamese network in terms of the UBC dataset errors. Moreover, we also demonstrate that a combination of the triplet and global losses produces the best embedding in the field, using this triplet network. Finally, we also show that the use of the central-surround siamese network trained with the global loss produces the best result of the field on the UBC dataset. Pre-trained models are available online at <a class="link-external link-https" href="https://github.com/vijaykbg/deep-patchmatch" rel="external noopener nofollow">this https URL</a>

Local Image Descriptors with Statistical Losses

Learning Local Feature Descriptors Through Ranking Losses Improved by Variance Shrinkage

Learning Local Feature Descriptors with Quadruplet Ranking Loss

Discriminatively Learning for Representing Local Image Features with Quadruplet Model

Robust Angular Local Descriptor Learning

Working hard to know your neighbor's margins: Local descriptor learning loss

A Deep Quadruplet Network for Local Descriptor Learning

Discriminative Learning of Local Image Descriptors.

Learning Local Image Descriptors with Deep Siamese and Triplet Convolutional Networks by Minimising Global Loss Functions

TCDesc: Learning Topology Consistent Descriptors for Image Matching

Kernelized Subspace Pooling for Deep Local Descriptors.

A Deformable Local Image Descriptor

STCDesc: Learning Deep Local Descriptor Using Similar Triangle Constraint

RDLNet: A Regularized Descriptor Learning Network.

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

DHNet: Working Double Hard to Learn a Convolutional Neural Network-Based Local Descriptor

Local Feature Descriptor for Image Matching: A Survey

VEDesc: Vertex-Edge Constraint on Local Learned Descriptors.

Learning Transformation-Invariant Local Descriptors with Low-Coupling Binary Codes

Learning General Descriptors for Image Matching with Regression Feedback