Abstract:In this paper, a hierarchical deep multi-task learning (HD-MTL) algorithm is developed to support large-scale visual recognition (e.g., recognizing thousands or even tens of thousands of atomic object classes automatically). To achieve more effective accomplishment of the coarse-to-fine tasks for hierarchical visual recognition, multiple sets of deep features are first extracted from the different layers of deep convolutional neural networks (deep CNNs). A visual tree is then learned by assigning the visually-similar atomic object classes with similar learning complexities into the same group, and it can provide a good environment for identifying the inter-related learning tasks automatically. By leveraging the inter-task relatedness (inter-class similarities) to learn more discriminative group-specific deep representations, our deep multi-task learning algorithm can achieve the global optimum easily and obtain more discriminative node classifiers for distinguishing the visually-similar atomic object classes (in the same group) effectively. Our HD-MTL algorithm can control the inter-level error propagation effectively by using an end-to-end approach for jointly learning more representative deep CNNs (for image representation) and more discriminative tree classifier (for large-scale visual recognition) and updating them simultaneously. Our incremental deep learning algorithms can effectively adapt both the deep CNNs and the tree classifier to the new training images and the new object classes. Our experimental results have demonstrated that our HD-MTL algorithm can achieve very competitive results on both the accuracy rates and the computational efficiency for large-scale visual recognition.

Deep collaborative multi-task network: A human decision process inspired model for hierarchical image classification

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

Deep Multi-task Learning for Hierarchical Classification

Feature Selection-Based Hierarchical Deep Network for Image Classification

MMF: Multi-Task Multi-Structure Fusion for Hierarchical Image Classification

Hierarchical Gate Network for Fine-Grained Visual Recognition.

Semantic Guided Level-Category Hybrid Prediction Network for Hierarchical Image Classification.

Hierarchical Inter-Attention Network for Document Classification with Multi-Task Learning.

Deep Multi-task Learning for Large-Scale Image Classification

Hierarchical Task-aware Multi-Head Attention Network

HD-MTL: Hierarchical Deep Multi-Task Learning for Large-Scale Visual Recognition

Exploring and Exploiting Hierarchical Structures for Large-Scale Classification

Embedding Visual Hierarchy with Deep Networks for Large-Scale Visual Recognition

Exploiting Related and Unrelated Tasks for Hierarchical Metric Learning and Image Classification

Multi-branch Graph Network for Learning Human-Object Interaction.

Hierarchical classification based on coarse- to fine-grained knowledge transfer

HCAM-CL: A Novel Method Integrating a Hierarchical Cross-Attention Mechanism with CNN-LSTM for Hierarchical Image Classification

Hierarchical Multi-Task Network For Race, Gender And Facial Attractiveness Recognition

Hierarchical Bilinear Convolutional Neural Network for Image Classification.

Towards Hierarchical Categorical Named Entity Recognition Via Injective Multi-task Learning Strategy

An Interactive Fusion Model for Hierarchical Multi-label Text Classification