Abstract:Fine-grained image classification is challenging due to the large intra-class variance and small inter-class variance, aiming at recognizing hundreds of sub-categories belonging to the same basic-level category. Since two different sub-categories is distinguished only by the subtle differences in some specific parts, semantic part localization is crucial for fine-grained image classification. Most previous works improve the accuracy by looking for the semantic parts, but rely heavily upon the use of the object or part annotations of images whose labeling are costly. Recently, some researchers begin to focus on recognizing sub-categories via weakly supervised part detection instead of using the expensive annotations. However, these works ignore the spatial relationship between the object and its parts as well as the interaction of the parts, both of them are helpful to promote part selection. Therefore, this paper proposes a weakly supervised part selection method with spatial constraints for fine-grained image classification, which is free of using any bounding box or part annotations. We first learn a whole-object detector automatically to localize the object through jointly using saliency extraction and co-segmentation. Then two spatial constraints are proposed to select the distinguished parts. The first spatial constraint, called box constraint, defines the relationship between the object and its parts, and aims to ensure that the selected parts are definitely located in the object region, and have the largest overlap with the object region. The second spatial constraint, called parts constraint, defines the relationship of the object's parts, is to reduce the parts' overlap with each other to avoid the information redundancy and ensure the selected parts are the most distinguishing parts from other categories. Combining two spatial constraints promotes parts selection significantly as well as achieves a notable improvement on fine-grained image classification. Experimental results on CUB-200-2011 dataset demonstrate the superiority of our method even compared with those methods using expensive annotations.

Object-Part Attention Driven Discriminative Localization for Fine-grained Image Classification.

Object-Part Attention Model for Fine-Grained Image Classification.

Fine-Grained Image Classification with Object-Part Model

Weakly Supervised Learning of Part Selection Model with Spatial Constraints for Fine-Grained Image Classification

Weakly Supervised Learning Of Object-Part Attention Model For Fine-Grained Image Classification

Weakly Supervised Fine-Grained Image Recognition Based on Multi-Channel Attention and Object Localization

Fast Fine-grained Image Classification via Weakly Supervised Discriminative Localization

Large Variance ( Intra-Subcategory ) Small Variance ( Inter-Subcategory ) Maine Coon RagdollBirmanPersian ( c ) Cats Winter WrenRock WrenMarsh Wren ( a ) Birds Black Footed Albatross Sword lily LotusRoseWater lily ( d ) Flowers Dodge Caliber Wagon 2012

Fine-Grained Image Classification Via Spatial Saliency Extraction.

Fine-grained Discriminative Localization via Saliency-guided Faster R-CNN

Adversarial Erasing Attention for Fine-Grained Image Classification.

Weakly Supervised Fine-Grained Categorization With Part-Based Image Representation

Multi-level Dictionary Learning for Fine-Grained Images Categorization with Attention Model

From the whole to detail: Progressively sampling discriminative parts for fine-grained recognition

Object-aware Long-short-range Spatial Alignment for Few-Shot Fine-Grained Image Classification

The Application of Two-Level Attention Models in Deep Convolutional Neural Network for Fine-Grained Image Classification

Weakly supervised fine-grained image classification via two-level attention activation model

Learning Two-level Features for Fine-grained Image Classification

Selective Parts For Fine-Grained Recognition

Feature Boosting, Suppression, and Diversification for Fine-Grained Visual Classification.

Learning Fixation Point Strategy for Object Detection and Classification