Abstract:Fine-grained image classification aims to distinguish subcategories belonging to the same basic-level category, such as 200 subcategories belonging to bird. It is a challenging problem in computer vision and multimedia field due to: attribute similarity (e.g. color and texture) among different subcategories and attribute variance (e.g. pose and viewpoint) in the same subcategory. Attribute similarity causes the difficulty to classify different subcategories even for human, while attribute variance causes the learned feature representations chaotic and confused. Naturally, classification can benefit from a hierarchy of subcategories: since going to a coarser granularity leverages high-level semantic features, while going to a finer granularity leverages discriminative and subtle features. Therefore, we propose an attribute hierarchy based multi-task learning (AHMTL) approach, and its main novelties are: (1) Attribute hierarchy: We reassign all images to multi-granularity subcategories automatically, namely coarse-grained, fine-grained and ultra-fine-grained subcategories. Similar fine-grained subcategories are reassigned to the same coarse-grained subcategory according to their attribute similarity, which pays more attention to the high-level semantic feature representations. Simultaneously, the same fine-grained subcategory but with different attributes are divided into different ultra-fine-grained subcategories, which can obtain more discriminative and subtle feature representations for attribute variance. (2) Multi-task learning: A multi-task learning framework is designed to effectively learn robust feature representations by jointly optimizing coarse-grained, fine-grained and ultra-fine-grained image classification tasks. These three level tasks learn coarse to fine feature representations, meaning high-level semantic to subtle features, which can regularize and boost each other to prevent overfitting, and the mutual promotion of them ensures feature representations more discriminative. Compared with more than 10 state-of-the-art methods on two widely-used CUB-200-2011 and Cars-196 datasets, our AHMTL approach achieves the best classification performance.

Multitask Fine-Grained Feature Mining for Multilabel Remote Sensing Image Classification.

Cross-Attention-Driven Adaptive Graph Relational Network for Multilabel Remote Sensing Scene Classification

Cross-Modal Feature Representation Learning and Label Graph Mining in a Residual Multi-Attentional CNN-LSTM Network for Multi-Label Aerial Scene Classification

Multi‐View Self‐Supervised Auxiliary Task for Few‐Shot Remote Sensing Classification

A Hybrid Multitask Learning Network for Hyperspectral Image Classification With Few Labels

When Self-Supervised Learning Meets Scene Classification: Remote Sensing Scene Classification Based on a Multitask Learning Framework

MULTI-LABEL IMAGE RECOGNITION WITH JOINT CLASS-AWARE MAP DISENTANGLING AND LABEL CORRELATION EMBEDDING

Large-Scale Multi-Task Image Labeling with Adaptive Relevance Discovery and Feature Hashing

Using Multi-Label Classification to Improve Object Detection.

Multi-scale fusion for few-shot remote sensing image classification

Joint Multi-Label Classification and Label Correlations with Missing Labels and Feature Selection

Multi-Label Hyperspectral Classification with Discriminative Features.

Heterogeneous feature learning network for multimodal remote sensing image collaborative classification

Hyperspectral Remote Sensing Image Classification Based on Multi-scale Cross Graphic Convolution

Multifrequency Graph Convolutional Network With Cross-Modality Mutual Enhancement for Multisource Remote Sensing Data Classification

MMI-ML: Maximize Mutual Information Between Different Views for Few-Shot Remote Sensing Image Classification

Label-Guided Cross-Modal Attention Network for Multi-Label Aerial Image Classification

Embedding Label Structures for Fine-Grained Feature Representation

Semisupervised Feature Analysis by Mining Correlations among Multiple Tasks.

Attribute Hierarchy Based Multi-Task Learning for Fine-Grained Image Classification

Crops Fine Classification in Airborne Hyperspectral Imagery Based on Multi-Feature Fusion and Deep Learning