Abstract:Structured text with plentiful hierarchical structure information is an important part in real-world complex texts. Structured text classification is attracting more attention in natural language processing due to the increasing complexity of application scenarios. Most existing methods treat structured text from a local hierarchy perspective, focusing on the semantics dependency and the graph structure of the structured text independently. However, structured text has global hierarchical structures with sophisticated dependency when compared to unstructured text. According to the variety of structured texts, it is not appropriate to use the existing methods directly. The function of distinction information within semantics dependency and graph structure for structured text, referred to as meta-information, should be stated more precisely. In this article, we propose HGMETA, a novel meta-information embedding frame network for structured text classification, to obtain the fusion embedding of hierarchical semantics dependency and graph structure in a structured text, and to distill the meta-information from fusion characteristics. To integrate the global hierarchical features with fused structured text information, we design a hierarchical LDA module and a structured text embedding module. Specially, we employ a multi-hop message passing mechanism to explicitly incorporate complex dependency into a meta-graph. The meta-information is constructed from meta-graph via neighborhood-based propagation to distill redundant information. Furthermore, using an attention-based network, we investigate the complementarity of semantics dependency and graph structure based on global hierarchical characteristics and meta-information. Finally, the fusion embedding and the meta-information can be straightforwardly incorporated for structured text classification. Experiments conducted on three real-world datasets show the effectiveness of meta-information and demonstrate the superiority of our method.

Meta-Information Fusion of Hierarchical Semantics Dependency and Graph Structure for Structured Text Classification

Hierarchical Multi-label Text Classification: Self-adaption Semantic Awareness Network Integrating Text Topic and Label Level Information

Hybrid embedding-based text representation for hierarchical multi-label text classification

Heterogeneous Graph Transformer for Meta-structure Learning with Application in Text Classification

MATCH: Metadata-Aware Text Classification in A Large Hierarchy

Deeply Integrating Unsupervised Semantics and Syntax into Heterogeneous Graphs for Inductive Text Classification

Hierarchical Multi-Granularity Attention- Based Hybrid Neural Network for Text Classification.

Large-Scale Hierarchical Text Classification Based On Path Semantic Information

A multi granularity information fusion text classification model based on attention mechanism

Graph-tree Fusion Model with Bidirectional Information Propagation for Long Document Classification

Hierarchy-Aware Global Model For Hierarchical Text Classification

HE-HMTC: A hybrid embedding-based text representation for Hierarchical multi-label text classification

A multi-semantic passing framework for semi-supervised long text classification

An effective multi-modal adaptive contextual feature information fusion method for Chinese long text classification

Text classification method based on dependency parsing and hybrid neural network

Text Classification With Heterogeneous Information Network Kernels

Exploiting Global and Local Hierarchies for Hierarchical Text Classification

Hierarchical Multi-granularity Interaction Graph Convolutional Network for Long Document Classification

Large-Scale Hierarchical Text Classification Based on Path Semantic Vector and Prior Information

Text Classification Via Learning Semantic Dependency and Association

Hierarchical Metadata-Aware Document Categorization under Weak Supervision