Abstract:Current hierarchical text categorization (HTC) methods mainly fall into three directions: (1) Flat one-vs.-all approach, which flattens the hierarchy into independent nodes and trains a binary one-vs.-all classifier for each node. (2) Top-down method, which uses the hierarchical structure to decompose the entire problem into a set of smaller sub-problems, and deals with such sub-problems in top-down fashion along the hierarchy. (3) Big-bang approach, which learns a single (but generally complex) global model for the class hierarchy as a whole with a single run of the learning algorithm. These methods were shown to provide relatively high performance in previous evaluations. However, they still suffer from two main drawbacks: (1) relatively low accuracy as they disregard category dependencies, or (2) low computational efficiency when considering such dependencies. In order to build an accurate and efficient model we adopted the following strategy: first, we design advanced global reranking models (GR) that exploit structural dependencies in hierarchical multi-label text classification (TC). They are based on two algorithms: (1) to generate the k-best classification of hypotheses based on decision probabilities of the flat one-vs.-all and top-down methods; and (2) to encode dependencies in the reranker by: (i) modeling hypotheses as trees derived by the hierarchy itself and (ii) applying tree kernels (TK) to them. Such TK-based reranker selects the best hierarchical test hypothesis, which is naturally represented as a labeled tree. Additionally, to better investigate the role of category relationships, we consider two interesting cases: (i) traditional schemes in which node-fathers include all the documents of their child-categories; and (ii) more general schemes, in which children can include documents not belonging to their fathers. Second, we propose an efficient local incremental reranking model (LIR), which combines a top-down method with a local reranking model for each sub-problem. These local rerankers improve the accuracy by absorbing the local category dependencies of sub-problems, which alleviate the errors of top-down method in the higher levels of the hierarchy. The application of LIR recursively deals with the sub-problems by applying the corresponding local rerankers in top-down fashion, resulting in high efficiency. In addition, we further optimize LIR by (i) improving the top-down method by creating local dictionaries for each sub-problem; (ii) using LIBLINEAR instead of LIBSVM; and (iii) adopting the compact representation of hypotheses for learning the local reranking model. This makes LIR applicable for large-scale hierarchical text categorization. The experimentation on different hierarchical datasets has shown promising enhancements by exploiting the structural dependencies in large-scale hierarchical text categorization.

Flatten hierarchies for large-scale hierarchical text categorization

Inconsistent Node Flattening for Improving Top-down Hierarchical Classification

Large-Scale Hierarchical Text Classification Based On Path Semantic Information

Deep Classification in Large-Scale Text Hierarchies

A Meta-Top-Down Method for Large-Scale Hierarchical Classification

Large-Scale Hierarchical Text Classification Based on Path Semantic Vector and Prior Information

Enhance Top-down Method with Meta-Classification for Very Large-scale Hierarchical Classification.

Effective Top-Down Active Learning for Hierarchical Text Classification.

Large-scale Structural Reranking for Hierarchical Text Categorization

Exploiting Global and Local Hierarchies for Hierarchical Text Classification

Hierarchical Text Categorization Based on Multiple Feature Selection and Fusion of Multiple Classifiers Approaches.

Research on Large Scale Hierarchical Classification Based on Candidate Search

Review on Hierarchical Learning Methods for Large-Scale Classification Task

Hierarchical Taxonomy Preparation for Text Categorization Using Consistent Bipartite Spectral Graph Copartitioning

Hybrid embedding-based text representation for hierarchical multi-label text classification

Exploring and Exploiting Hierarchical Structures for Large-Scale Classification

Deep Fuzzy Tree for Large-Scale Hierarchical Visual Classification

Class Hierarchical Structure-Based Text Classification

Research and Development of Large Scale Hierarchical Classification Problem

Research on Building Methods of Hierarchical Structure in Text Classification

Hierarchical rough decision theoretic framework for text classification