Abstract:A taxonomy represents a hierarchically structured knowledge graph that forms the infrastructure for various downstream applications, including recommender systems, web search, and question answering. The exploration of automated induction from text corpora has yielded notable taxonomies such as CN-probase, CN-DBpedia, and Zhishi.schema. Despite these efforts, existing taxonomies still face two critical issues that result in sub-optimal hierarchical structures. On the one hand, commonly observed taxonomies exhibit a coarse-grained and "flat" structure, stemming from a noticeable lack of diversity in both nodes and edges. This limitation primarily originates from the biased and homogeneous data distribution. On the other hand, the semantic granularity among "siblings" within these taxonomies remains inconsistent, presenting a challenge in accurately and comprehensively identifying hierarchical relations. To address these issues, this study introduces a novel taxonomy induction framework composed of three meticulously designed components. Initially, we established a seed schema by leveraging statistical information from external data sources as distant supervision to append nodes and edges containing "generic semantics", thereby rectifying biased data distributions. Subsequently, a clustering algorithm is employed to group the nodes based on their similarities, followed by a refinement operation of the hierarchical relations among these nodes. Building on this seed schema, we propose a fine-grained contrastive learning method in the expansion module to strengthen the utilization of taxonomic structures, consequently boosting the precision of query-anchor matching. Finally, we meticulously scrutinized the hierarchical relations between each query and its siblings to ensure the integrity of the constructed taxonomy. Extensive experiments on real-world datasets validated the efficacy of our proposed framework for constructing well-structured taxonomies.

Exploring Sequence-to-sequence Taxonomy Expansion Via Language Model Probing

CodeTaxo: Enhancing Taxonomy Expansion with Limited Examples via Code Language Prompts

Towards Visual Taxonomy Expansion

Capturing Long-distance Dependencies in Sequence Models: A Case Study of Chinese Part-of-speech Tagging.

Enhancing Taxonomy Completion with Concept Generation via Fusing Relational Representations

Tree Sequence Kernel for Natural Language

Taxonomy Induction Using Hypernym Subsequences

STEAM: Self-Supervised Taxonomy Expansion with Mini-Paths

Unleashing the True Potential of Sequence-to-Sequence Models for Sequence Tagging and Structure Parsing

Learning What You Need from What You Did: Product Taxonomy Expansion with User Behaviors Supervision

Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing.

Which is better? Taxonomy induction with learning the optimal structure via contrastive learning

UU-Tax at SemEval-2022 Task 3: Improving the generalizability of language models for taxonomy classification through data augmentation

Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model

T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing

Transforming Sequence Tagging Into A Seq2Seq Task

Topic Taxonomy Expansion via Hierarchy-Aware Topic Phrase Generation

Are Large Language Models a Good Replacement of Taxonomies?

SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understanding

Understanding Survey Paper Taxonomy about Large Language Models via Graph Representation Learning