Abstract:Current fine-grained visual classification (FGVC) models are isolated. In practice, we first need to identify the coarse-grained label of an object, then select the corresponding FGVC model for recognition. This hinders the application of FGVC algorithms in real-life scenarios. In this paper, we propose an erudite FGVC model jointly trained by several different datasets11In this paper, different datasets mean different fine-grained visual classification datasets., which can efficiently and accurately predict an object's fine-grained label across the combined label space. We found through a pilot study that positive and negative transfers co-occur when different datasets are mixed for training, i.e., the knowledge from other datasets is not always useful. Therefore, we first propose a feature disentanglement module and a feature re-fusion module to reduce negative transfer and boost positive transfer between different datasets. In detail, we reduce negative transfer by decoupling the deep features through many dataset-specific feature extractors. Subsequently, these are channel-wise re-fused to facilitate positive transfer. Finally, we propose a meta-learning based dataset-agnostic spatial attention layer to take full advantage of the multi-dataset training data, given that localisation is dataset-agnostic between different datasets. Experimental results across 11 different mixed-datasets built on four different FGVC datasets demonstrate the effectiveness of the proposed method. Furthermore, the proposed method can be easily combined with existing FGVC methods to obtain state-of-the-art results. Our code is available at https://github.com/PRIS-CV/An-Erudite-FGVC-Model.

Fine-grained Recognition Datasets for Biodiversity Analysis

Fine-Grained Visual Categorization With Fine-Tuned Segmentation

Research on the Fine-Grained Plant Image Classification

Performance of computer vision algorithms for fine-grained classification using crowdsourced insect images

Fine-Grained Image Recognition Methods and Their Applications in Remote Sensing Images: A Review

Multi-scale Discriminative Patches for Fined-Grained Visual Categorization.

Fine-grained Image Classification by Visual-Semantic Embedding

An Erudite Fine-Grained Visual Classification Model

Fine-Grained Image Analysis With Deep Learning: A Survey

A survey of deep fine-grained visual categorization

Visualizing and Describing Fine-grained Categories as Textures

Deep Learning for Fine-Grained Image Recognition: A Comprehensive Study

Evolving Convolutional Neural Network And Its Application In Fine-Grained Visual Categorization

Concept Drift and Long-Tailed Distribution in Fine-Grained Visual Categorization: Benchmark and Method

A Survey of Fine-Grained Image Categorization

The Devil is in the Tails: Fine-grained Classification in the Wild

Attention-based Multi-scale ViT Fine-grained Visual Classification

Knowledge Transfer Based Fine-Grained Visual Classification

Fine-grained visual recognition with salient feature detection

ELoPE: Fine-Grained Visual Classification with Efficient Localization, Pooling and Embedding

Species196: A One-Million Semi-supervised Dataset for Fine-grained Species Recognition