Abstract:Fine-grained object retrieval, which aims at finding objects belonging to the same sub-category as the probe object from a large database, is becoming increasingly popular because of its research and application significance. Recently, convolutional neural network (CNN) based deep learning models have achieved promising retrieval performance, as they can learn both feature representations and discriminative distance metrics jointly. Specifically, a generic method is to extract activations of the fully-connected layer as feature descriptors and simultaneously optimize classification constraints (e.g., softmax loss) and similarity constraints (e.g., triplet loss) to improve the representative capability of the features. However, the typical fully-connected layer activations are more focused on representing global attributes of the corresponding image, thus relatively less sensitive to specific local characteristics. Therefore, the features learned through these approaches in general are not sufficiently capable for retrieving fine-grained objects. To attack this issue, we propose an effective feature embedding by simultaneously encoding original global features and discriminative local features, in which the local features are extracted by exploiting strong neural activations on the last convolutional layer. We present that the novel feature embedding can dramatically enlarge the gap between inter-class variance and intra-class variance, which is the key factor to improve retrieval precision. In addition, we show our architecture can also be applied in person re-identification. Experimental results on multiple challenging benchmarks demonstrate that our method outperforms the current state-of-the-art approaches by large margins.

From Dimensional to Cut-Off Regularization

Hierarchical Saliency Mapping for Weakly Supervised Object Localization Based on Class Activation Mapping

Long-Term Map-Based Visual Localization: Analysis of Individual Components of a Hierarchical Pipeline

Learning Feature Embedding with Strong Neural Activations for Fine-Grained Retrieval

An Image Local Feature Representation Method Using Hierarchical Vision Network Model

Local Image Descriptor Inspired by Visual Cortex

A Novel Biologically Inspired ELM-based Network for Image Recognition

A Novel Biologically-inspired Structural Model for Feature Correspondence

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Probabilistic Hierarchical Face Model for Feature Localization.

A Hierarchical Model Based on Visual Cortex

Matching Query Image Against Selected NeRF Feature for Efficient and Scalable Localization

A SOM Network Model for Feature Extraction by Hyper Columns Architecture of Primary Visual Cortex

Robust Feature Matching via Hierarchical Local Structure Visualization

A Bio-inspired Model for Image Representation and Image Analysis

Deep Graphical Feature Learning for the Feature Matching Problem

Local Feature Matching Using Deep Learning: A Survey

Enhanced Biologically Inspired Model for Object Recognition

A Novel Biologically Inspired Visual Cognition Model: Automatic Extraction of Semantics, Formation of Integrated Concepts, and Reselection Features for Ambiguity

Leveraging Deep Visual Descriptors for Hierarchical Efficient Localization

Image Retrieval with Hierarchical Matching Pursuit