Abstract:Fine-grained image classification is to recognize hundreds of subcategories belonging to the same basic-level category, such as 200 subcategories belonging to the bird, which is highly challenging due to large variance in the same subcategory and small variance among different subcategories. Existing methods generally first locate the objects or parts and then discriminate which subcategory the image belongs to. However, they mainly have two limitations: (1) Relying on object or part annotations which are heavily labor consuming. (2) Ignoring the spatial relationships between the object and its parts as well as among these parts, both of which are significantly helpful for finding discriminative parts. Therefore, this paper proposes the objectpart attention model (OPAM) for weakly supervised fine-grained image classification, and the main novelties are: (1) Objectpart attention model integrates two level attentions: object-level attention localizes objects of images, and part-level attention selects discriminative parts of object. Both are jointly employed to learn multi-view and multi-scale features to enhance their mutual promotions. (2) Object-part spatial constraint model combines two spatial constraints: object spatial constraint ensures selected parts highly representative, and part spatial constraint eliminates redundancy and enhances discrimination of selected parts. Both are jointly employed to exploit the subtle and local differences for distinguishing the subcategories. Importantly, neither object nor part annotations are used in our proposed approach, which avoids the heavy labor consumption of labeling. Comparing with more than 10 state-of-the-art methods on 4 widely-used datasets, our OPAM approach achieves the best performance.

Subcategory-Aware Object Classification.

Looking Inside Category: Subcategory-Aware Object Recognition

Subcategory-Aware Object Detection

S-CNN: Subcategory-Aware Convolutional Networks for Object Detection

Object Recognition via Adaptive Multi-level Feature Integration

Mining Sub-Categories for Object Detection

Object Categorization in Sub-Semantic Space

Object Category Recognition Using Boosting Tree With Heterogeneous Features

A DPM Based Approach to Joint Object Detection and Sub-category Recognition

From Bag Of Categories To Tree Of Object Recognition

Object Category Recognition Using Generative Template Boosting.

A Simple Approach and Benchmark for 21, 000-Category Object Detection.

Adaptive Object Detection by Implicit Sub-Class Sharing Features

Large Variance ( Intra-Subcategory ) Small Variance ( Inter-Subcategory ) Maine Coon RagdollBirmanPersian ( c ) Cats Winter WrenRock WrenMarsh Wren ( a ) Birds Black Footed Albatross Sword lily LotusRoseWater lily ( d ) Flowers Dodge Caliber Wagon 2012

Object categorization with sketch representation and generalized samples

Subcategory Clustering with Latent Feature Alignment and Filtering for Object Detection

Object categorization based on a supervised mean shift algorithm

Incorporating Structural Alternatives and Sharing into Hierarchy for Multiclass Object Recognition and Detection

Categorization of Multiple Objects in a Scene Without Semantic Segmentation

Dilated-Scale-Aware Category-Attention ConvNet for Multi-Class Object Counting

Adaptive Object Classification in Surveillance System by Exploiting Scene Context