Abstract:Recent advances on fine-grained image retrieval prefer learning convolutional neural network (CNN) with specific fully-connect layer designed loss function for discriminative feature representation. Essentially, such loss should establish a robust metric to efficiently distinguish high-dimensional features within and outside fine-grained categories. To this end, the existing loss functions are defected in two aspects: (a) The feature relationship is encoded inside the training batch. Such a local scope leads to low accuracy. (b) The error is established by the mean square, which needs pairwise distance computation in training set and results in low efficiency. In this paper, we propose a novel metric learning scheme, termed Normalize-Scale Layer and Decorrelated Global Centralized Ranking Loss, which achieves extremely efficient and discriminative learning, i.e., 5× speedup over triplet loss and 12% recall boost on CARS196 . Our method originates from the classic softmax loss, which has a global structure but does not directly optimize the distance metric as well as the inter/intra class distance. We tackle this issue through a hypersphere layer and a global centralized ranking loss with a pairwise decorrelated learning. In particular, we first propose a Normalize-Scale Layer to eliminate the gap between metric distance (for measuring distance in retrieval) and dot product (for dimension reduction in classification). Second, the relationship between features is encoded under a global centralized ranking loss, which targets at optimizing metric distance globally and accelerating learning procedure. Finally, the centers are further decorrelated by Gram-Schmidt process, leading to extreme efficiency (with 20 epochs in training procedure) and discriminability in feature learning. We have conducted quantitative evaluations on two fine-grained retrieval benchmark. The superior performance demonstrates the merits of the proposed approach over the state-of-the-arts.

Contraction Mapping of Feature Norms for Data Quality Imbalance Learning

Contraction Mapping of Feature Norms for Classifier Learning on the Data with Different Quality

On the Learning Property of Logistic and Softmax Losses for Deep Neural Networks

Normalized Maximal Margin Loss for Open-Set Image Classification

Stop-Gradient Softmax Loss for Deep Metric Learning.

Class-Variant Margin Normalized Softmax Loss for Deep Face Recognition

Feature-Balanced Loss for Long-Tailed Visual Recognition

Imbalance Robust Softmax for Deep Embeeding Learning

Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessment

Ensemble Soft-Margin Softmax Loss for Image Classification

Subdomain contraction in deep networks for robust representation learning

ARConvL: Adaptive Region-Based Convolutional Learning for Multi-class Imbalance Classification

Learning Towards The Largest Margins.

CAM-loss: Towards Learning Spatially Discriminative Feature Representations

Regularization and Iterative Initialization of Softmax for Fast Training of Convolutional Neural Networks.

AdaFace: Quality Adaptive Margin for Face Recognition

Learning deep discriminative embeddings via joint rescaled features and log-probability centers

Towards Optimal Fine Grained Retrieval Via Decorrelated Centralized Loss with Normalize-Scale Layer.

Long-tailed image recognition through balancing discriminant quality

Improving Classification Performance of Softmax Loss Function Based on Scalable Batch-Normalization

A neural network learning algorithm for highly imbalanced data classification