Abstract:Fine-grained image categorization is a challenging task due to the difficulty of localizing the discriminative regions for different sub-categories. Previous works mainly focus on using the manual annotations or the attention algorithm to localize these regions, which is demanding and complex in practical applications. This paper proposes a method of using a multi-level attention model (MLA-CNN) which has been trained on the full-size image train set of current tasks to localize the most discriminative regions. Intuitively, three typical receptive field sizes are selected for the multi-level attention maps. Then, multi-level dictionary learning is introduced to extract discriminative features from these localized regions. Our method explores a new thought about how to use the neural activations to generate multi-scale regions which are helpful for the fine-grained categorization. The method can be achieved in two steps. The first step is to select the neurons that have the max activation in the selected three feature maps. These feature maps are the outputs of the pre-trained CNN model by feeding the full-size images into the model. Then, we generate the discriminative regions according to the receptive field size of the selected neurons. The second step is to train the subtle networks with these multi-scale regions. One scaled discriminative region can be regarded as one typical dictionary feature. Then these results are integrated for final prediction. We evaluate our method on three challenging fine-grained image datasets, CUB-200-2011, Stanford Dogs, and Stanford Cars. The experimental results demonstrate that our method outperforms many state-of-the-art methods, using extra object/parts annotations and attention-based methods.

A Multi-Descriptor, Multi-Nearest Neighbor Approach for Image Classification

Multi-View Analysis Dictionary Learning for Image Classification.

A Bayesian Network nearest k-labels method for Multi-label classification

In defense of Nearest-Neighbor based image classification

Local Naive Bayes Nearest Neighbor for Image Classification

Image Classification Method Rationally Utilizing Spatial Information of the Image

Multi-scale and Discriminative Part Detectors Based Features for Multi-label Image Classification.

DMN4: Few-shot Learning Via Discriminative Mutual Nearest Neighbor Neural Network

A Debiased Nearest Neighbors Framework for Multi-Label Text Classification

Midcn: A Multiple Instance Deep Convolutional Network For Image Classification

PCNN: Probable-Class Nearest-Neighbor Explanations Improve Fine-Grained Image Classification Accuracy for AIs and Humans

MNN: Mixed Nearest-Neighbors for Self-Supervised Learning

Multi-level Dictionary Learning for Fine-Grained Images Categorization with Attention Model

Multi-Attention Multi-Class Constraint for Fine-grained Image Recognition

Learning Multi-attention Convolutional Neural Network for Fine-Grained Image Recognition

Multi-dimensional classification via kNN feature augmentation

Spatial Context-Aware Object-Attentional Network for Multi-Label Image Classification

MSD: Multi-Self-Distillation Learning via Multi-classifiers within Deep Neural Networks

Local Visual Feature Fusion Via Maximum Margin Multimodal Deep Neural Network

Spatial-Context-Aware Deep Neural Network for Multi-Class Image Classification

Multi-class Image Classification Using Deep Learning Algorithm