Abstract:The core of fine-grained recognition is to distinguish different subcategories within a same broad category through subtle differences in images. Yet two important factors are less explored: Firstly, the degree of similarity between categories, with the more similar categories being more likely to be confused. Secondly, different fine-grained definitions under divergent levels of expertise, with one coarse label corresponding to multiple similar fine categories (e.g., a brand of car has multiple models). In this paper, we discover that multi-granularity label can function as an intermediary for turning inter-category similarity relations into fine-grained recognition performance. Specifically, we first explore the association between label hierarchies in multi-granularity prediction: both coarse and fine label predictions require coarse information, but fine label prediction additionally requires subtle information. Then, a multi-granularity classification framework is proposed, where the extracted feature is decoupled and re-coupled into groups for predicting labels at different granularities, respectively. The key is to involve coarse-grained features in the prediction of finer-level labels. The realization way is to train these features with a joint probability-based loss that we design to reduce inter-task interference through inter-granularity probability relations. Lastly, for tasks without coarse labels, a category similarity matrix is suggested for measuring inter-class similarity and a further non-parametric aggregation method is devised for clustering fine labels into coarse labels. The evaluation is carried out on several fine-grained classification benchmark datasets. Results show that the proposed approach achieves state-of-the-art in multi-granularity classification and exhibits the potential to enhance existing fine-grained recognition models.

Fine-grained Image Classification Combined with Label Description

Fine-Grained Visual Categorization With Fine-Tuned Segmentation

Research on the Fine-Grained Plant Image Classification

Fine-Grained Image Classification Via Combining Vision And Language

Leveraging Fine-Grained Labels to Regularize Fine-Grained Visual Classification.

Coarse-to-Fine Description for Fine-Grained Visual Categorization

Fine-Grained Image Classification Network Based on Reinforcement and Complementary Learning

Multiple Granularity Descriptors for Fine-Grained Categorization.

A Survey on Fine-grained Image Categorization Using Deep Convolutional Features

Weakly Supervised Complementary Parts Models for Fine-Grained Image Classification from the Bottom Up

Learning Enhanced Features and Inferring Twice for Fine-Grained Image Classification

Fine-grained Recognition: Multi-granularity Labels and Category Similarity Matrix

Fine-Grained Image Classification with Object-Part Model

Learning Two-level Features for Fine-grained Image Classification

Fine-Grained Image Classification Based on Multi-Scale Feature Fusion

Fine-Grained Image Classification with Gaussian Mixture Layer

Embedding Label Structures for Fine-Grained Feature Representation

Fine-Grained Visual Classification Via Simultaneously Learning of Multi-regional Multi-grained Features

Multitask Fine-Grained Feature Mining for Multilabel Remote Sensing Image Classification.

Combining Spatial Attention and Cross-Layer Bilinear Pooling for Fine-Grained Image Classification

A Survey of Fine-Grained Image Categorization