Abstract:Fine-grained visual classification (FGVC) involves classifying closely related sub-classes. This task is difficult due to the subtle differences between classes and the high intra-class variance. Moreover, FGVC datasets are typically small and challenging to gather, thus highlighting a significant need for effective data augmentation. Recent advancements in text-to-image diffusion models offer new possibilities for augmenting classification datasets. While these models have been used to generate training data for classification tasks, their effectiveness in full-dataset training of FGVC models remains under-explored. Recent techniques that rely on Text2Image generation or Img2Img methods, often struggle to generate images that accurately represent the class while modifying them to a degree that significantly increases the dataset's diversity. To address these challenges, we present SaSPA: Structure and Subject Preserving Augmentation. Contrary to recent methods, our method does not use real images as guidance, thereby increasing generation flexibility and promoting greater diversity. To ensure accurate class representation, we employ conditioning mechanisms, specifically by conditioning on image edges and subject representation. We conduct extensive experiments and benchmark SaSPA against both traditional and recent generative data augmentation methods. SaSPA consistently outperforms all established baselines across multiple settings, including full dataset training, contextual bias, and few-shot classification. Additionally, our results reveal interesting patterns in using synthetic data for FGVC models; for instance, we find a relationship between the amount of real data used and the optimal proportion of synthetic data. Code is available at <a class="link-external link-https" href="https://github.com/EyalMichaeli/SaSPA-Aug" rel="external noopener nofollow">this https URL</a>.

Image Generation Based Intra-class Variance Smoothing for Fine-Grained Visual Classification.

Fine-Grained Visual Categorization With Fine-Tuned Segmentation

Learning Enhanced Features and Inferring Twice for Fine-Grained Image Classification

SGIA: Enhancing Fine-Grained Visual Classification with Sequence Generative Image Augmentation

A Data Augmentation Based ViT for Fine-Grained Visual Classification

Progressive Self-Guided Hardness Distillation for Fine-Grained Visual Classification

Leveraging Fine-Grained Labels to Regularize Fine-Grained Visual Classification.

Advancing Fine-Grained Classification by Structure and Subject Preserving Augmentation

CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training

Granularity-aware Distillation and Structure Modeling Region Proposal Network for Fine-Grained Image Classification.

An Erudite Fine-Grained Visual Classification Model

Graph-in-graph Discriminative Feature Enhancement Network for Fine-Grained Visual Classification

Interpretable Attention Guided Network for Fine-Grained Visual Classification

Knowledge Transfer Based Fine-Grained Visual Classification

Data-free Knowledge Distillation for Fine-grained Visual Categorization

Fine-Graine Visual Classification with Aggregated Object Localization and Salient Feature Suppression

FET-FGVC: Feature-enhanced transformer for fine-grained visual classification

The Image Data and Backbone in Weakly Supervised Fine-Grained Visual Categorization: A Revisit and Further Thinking

Integrating Foreground–background Feature Distillation and Contrastive Feature Learning for Ultra-Fine-grained Visual Classification

Improving the Performance of Fine-Grain Image Classifiers via Generative Data Augmentation

Multi-Granularity Feature Distillation Learning Network for Fine-Grained Visual Classification