Abstract:Class hierarchical structures play a significant role in large and complex tasks of machine learning. Existing studies on the construction of such structures follow a two-stage strategy. The category similarities are first computed with a certain assumption, and the group partition algorithm is then performed with some hyper-parameters to control the shape of class hierarchy. Despite their effectiveness in many cases, these methods suffer from two problems: (1) optimizing the two-stage objective to obtain the structure is sub-optimal; (2) hyper-parameters make the search space too large to find the optimal structure efficiently. In this paper, we propose a unified and dynamic framework to address these problems, which can: (1) jointly optimize the category similarity and group partition; (2) obtain the class hierarchical structure dynamically without any hyper-parameters. The framework replaces the traditional category similarity with the sample similarity, and constrains samples from the same atomic category partitioned to the same super-category. We theoretically prove that, within our framework, the sample similarity is equivalent to the category similarity and can balance the partitions in terms of the number of samples. Further, we design a modularity-based partition optimization algorithm that can automatically determine the number of partitions on each level. Extensive experimental results on multiple image classification datasets show that the hierarchical structure constructed by the proposed method achieves better accuracy and efficiency compared to existing methods. Additionally, the hierarchy obtained by the proposed method can benefit long-tail learning scenarios due to the balanced partition on samples.

Exploring and Exploiting Hierarchical Structures for Large-Scale Classification

Review on Hierarchical Learning Methods for Large-Scale Classification Task

Building Hierarchical Class Structures for Extreme Multi-Class Learning

Deep Fuzzy Tree for Large-Scale Hierarchical Visual Classification

Joint Hierarchical Category Structure Learning and Large-Scale Image Classification

Hierarchical Fine-Grained Visual Classification Leveraging Consistent Hierarchical Knowledge

Hierarchical Gate Network for Fine-Grained Visual Recognition.

MMF: Multi-Task Multi-Structure Fusion for Hierarchical Image Classification

Constructing Hierarchical Visual Tree for Discriminative Image Representation and Classification.

Large Scale Hierarchical Classification Framework for Network Big Data

Feature Selection-Based Hierarchical Deep Network for Image Classification

Deep Multi-task Learning for Hierarchical Classification

Ontology-driven Hierarchical Sparse Coding for Large-Scale Image Classification

Deep Classification in Large-Scale Text Hierarchies

Deep classifier for large scale hierarchical text classification

Enhance Top-down Method with Meta-Classification for Very Large-scale Hierarchical Classification.

Label Hierarchy Transition: Modeling Class Hierarchies to Enhance Deep Classifiers

Hierarchical classification based on coarse- to fine-grained knowledge transfer

Embedding Visual Hierarchy with Deep Networks for Large-Scale Visual Recognition

Research and Development of Large Scale Hierarchical Classification Problem

Deep collaborative multi-task network: A human decision process inspired model for hierarchical image classification