Abstract:Extracting entities and relations for types of interest from text is important for understanding massive text corpora. Traditionally, systems of entity relation extraction have relied on human-annotated corpora for training and adopted an incremental pipeline. Such systems require additional human expertise to be ported to a new domain, and are vulnerable to errors cascading down the pipeline. In this paper, we investigate joint extraction of typed entities and relations with labeled data heuristically obtained from knowledge bases (i.e., distant supervision). As our algorithm for type labeling via distant supervision is context-agnostic, noisy training data poses unique challenges for the task. We propose a novel domain-independent framework, called CoType, that runs a data-driven text segmentation algorithm to extract entity mentions, and jointly embeds entity mentions, relation mentions, text features and type labels into two low-dimensional spaces (for entity and relation mentions respectively), where, in each space, objects whose types are close will also have similar representations. CoType, then using these learned embeddings, estimates the types of test (unlinkable) mentions. We formulate a joint optimization problem to learn embeddings from text corpora and knowledge bases, adopting a novel partial-label loss function for noisy labeled data and introducing an object "translation" function to capture the cross-constraints of entities and relations on each other. Experiments on three public datasets demonstrate the effectiveness of CoType across different domains (e.g., news, biomedical), with an average of 25% improvement in F1 score compared to the next best method.

How Can Cross-lingual Knowledge Contribute Better to Fine-Grained Entity Typing?

Boosting Collective Entity Linking via Type-Guided Semantic Embedding.

Cross-Lingual Contrastive Learning for Fine-Grained Entity Typing for Low-Resource Languages

Cross-Lingual Type Inference.

Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs

Type-enriched Hierarchical Contrastive Strategy for Fine-Grained Entity Typing

COTET: Cross-view Optimal Transport for Knowledge Graph Entity Typing

Iterative Cross-Lingual Entity Alignment Based on TransC

Label Noise Reduction in Entity Typing by Heterogeneous Partial-Label Embedding

Put It Back: Entity Typing with Language Model Enhancement

Generative Entity Typing with Curriculum Learning

Improving Distantly-supervised Entity Typing with Compact Latent Space Clustering

CoType: Joint Extraction of Typed Entities and Relations with Knowledge Bases

Alleviate Dataset Shift Problem in Fine-Grained Entity Typing with Virtual Adversarial Training

Knowledge-Enhanced Bilingual Textual Representations for Cross-Lingual Semantic Textual Similarity

Transformer-based Entity Typing in Knowledge Graphs

A syntax-enhanced parameter generation network for multi-source cross-lingual event extraction

All Entities are Not Created Equal: Examining the Long Tail for Fine-Grained Entity Typing

Liberal Entity Extraction: Rapid Construction of Fine-Grained Entity Typing Systems

A Chinese Corpus for Fine-grained Entity Typing

Attributed and Predictive Entity Embedding for Fine-Grained Entity Typing in Knowledge Bases.