Abstract:Coarse-grained classification and classification at different hierarchy levels are important in many engineering applications. Conventional approaches include post-inference aggregation of fine-grained predictions or multi-task learning with its disadvantages: necessity to incorporate post-prediction mechanisms, possible mistakes between unrelated categories when generic fine-grained models are used, and the need of training multi-task models with joint procedures. To overcome them, this paper proposes a novel method for extracting coarse-grained classifiers from large Convolutional Neural Networks (CNNs) trained on fine-grained tasks with no additional training. Leveraging the knowledge transfer capabilities of CNNs and acknowledging that a model proficient in a challenging task should inherently address easier, hierarchically related problems, the approach finds and aggregates available representatives of coarse-grained classes within existing fine-grained models. Unlike conventional approaches, the proposed technique aggregates the fine-grained model's weights and not its predictions. As a result, a new coarse-grained model is obtained with the same feature extractor as the original model. The original and new models can be used to create a multi-output model without the multi-task learning. The method eliminates additional post-prediction mechanisms and limits the mistakes between unrelated categories. It can be used with three strategies to find the sets of fine-grained classes for weight aggregation. They are based on external WordNet knowledge or internal network knowledge. Two of the methods leverage the concepts of semantic and visual similarity. Experimental results with MobileNetV2, InceptionV3, ResNet50V2, EfficientNetV2B0 and ConvNeXt-Small trained on ImageNet demonstrate up to 98% accuracy in the coarse-grained classification, which is superior to the post-prediction aggregation.

CNN with Coarse-to-fine Layer for Hierarchical Classification.

Hierarchical classification based on coarse- to fine-grained knowledge transfer

CNN-RNN: a large-scale hierarchical image classification framework

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

Hierarchical Bilinear Convolutional Neural Network for Image Classification.

Hierarchical Gate Network for Fine-Grained Visual Recognition.

HD-CNN: Hierarchical Deep Convolutional Neural Networks for Large Scale Visual Recognition

Hierarchical Fine-Grained Visual Classification Leveraging Consistent Hierarchical Knowledge

Fine-grained Category Discovery under Coarse-grained Supervision with Hierarchical Weighted Self-contrastive Learning

Convolutional Network Model using Hierarchical Prediction and its Application in Clothing Image Classification

Extracting coarse-grained classifiers from large Convolutional Neural Networks

Do Convolutional Neural Networks Learn Class Hierarchy?

Hierarchical Transfer Convolutional Neural Networks for Image Classification

Label Hierarchy Constraint Network for Fine-grained Classification

Deep Multi-task Learning for Hierarchical Classification

Two-level Hierarchical Feature Learning for Image Classification

Hierarchical Convolutional Neural Network Via Hierarchical Cluster Validity Based Visual Tree Learning

Hierarchical Self-Distilled Feature Learning for Fine-Grained Visual Categorization

Feature Extraction and Classification of Hyperspectral Images Using Hierarchical Network

Learning Multi-Layer Coarse-to-fine Representations for Large-Scale Image Classification

Scene Classification Using Hierarchical Wasserstein CNN