Abstract:Recent advances on fine-grained image retrieval prefer learning convolutional neural network (CNN) with specific fully-connect layer designed loss function for discriminative feature representation. Essentially, such loss should establish a robust metric to efficiently distinguish high-dimensional features within and outside fine-grained categories. To this end, the existing loss functions are defected in two aspects: (a) The feature relationship is encoded inside the training batch. Such a local scope leads to low accuracy. (b) The error is established by the mean square, which needs pairwise distance computation in training set and results in low efficiency. In this paper, we propose a novel metric learning scheme, termed Normalize-Scale Layer and Decorrelated Global Centralized Ranking Loss, which achieves extremely efficient and discriminative learning, i.e., 5× speedup over triplet loss and 12% recall boost on CARS196 . Our method originates from the classic softmax loss, which has a global structure but does not directly optimize the distance metric as well as the inter/intra class distance. We tackle this issue through a hypersphere layer and a global centralized ranking loss with a pairwise decorrelated learning. In particular, we first propose a Normalize-Scale Layer to eliminate the gap between metric distance (for measuring distance in retrieval) and dot product (for dimension reduction in classification). Second, the relationship between features is encoded under a global centralized ranking loss, which targets at optimizing metric distance globally and accelerating learning procedure. Finally, the centers are further decorrelated by Gram-Schmidt process, leading to extreme efficiency (with 20 epochs in training procedure) and discriminability in feature learning. We have conducted quantitative evaluations on two fine-grained retrieval benchmark. The superior performance demonstrates the merits of the proposed approach over the state-of-the-arts.

Learning Representation of Multi-Scale Object for Fine-Grained Image Retrieval.

Learning Feature Embedding with Strong Neural Activations for Fine-Grained Retrieval

Learning Discriminative Features for Fine-grained Image Retrieval

Coarse-to-Fine: Learning Compact Discriminative Representation for Single-Stage Image Retrieval

Learning Enhanced Features and Inferring Twice for Fine-Grained Image Classification

Searching and Learning Discriminative Regions for Fine-Grained Image Retrieval and Classification

Learning Discriminative Features for Image Retrieval.

Fine-Grained Visual Classification Via Simultaneously Learning of Multi-regional Multi-grained Features

Learning Regions and Descriptors for Fine-grained Recognition

Towards Optimal Fine Grained Retrieval Via Decorrelated Centralized Loss with Normalize-Scale Layer.

Learning Two-level Features for Fine-grained Image Classification

Fine-grained Image Analysis Via Progressive Feature Learning

Improved fine-grained object retrieval with Hard Global Softmin Loss objective

Embedding Label Structures for Fine-Grained Feature Representation

A Scale-aware and Discriminative Feature Learning Network for Fine-grained Rigid Object Recognition

Dual attention guided multi-scale CNN for fine-grained image classification

Centralized Ranking Loss with Weakly Supervised Localization for Fine-Grained Object Retrieval

A Two-Stage Approach for Fine-Grained Visual Recognition Via Confidence Ranking and Fusion.

Multi-scale Gem Pooling with N-Pair Center Loss for Fine-Grained Image Search

Multi-Grained Selection and Fusion for Fine-Grained Image Representation

Learning Deep Local Features with Multiple Dynamic Attentions for Large-Scale Image Retrieval.