Abstract:Ultra-fine entity typing plays a crucial role in information extraction by predicting fine-grained semantic types for entity mentions in text. However, this task poses significant challenges due to the massive number of entity types in the output space. The current state-of-the-art approaches, based on standard multi-label classifiers or cross-encoder models, suffer from poor generalization performance or inefficient inference. In this paper, we present CASENT, a seq2seq model designed for ultra-fine entity typing that predicts ultra-fine types with calibrated confidence scores. Our model takes an entity mention as input and employs constrained beam search to generate multiple types autoregressively. The raw sequence probabilities associated with the predicted types are then transformed into confidence scores using a novel calibration method. We conduct extensive experiments on the UFET dataset which contains over 10k types. Our method outperforms the previous state-of-the-art in terms of F1 score and calibration error, while achieving an inference speedup of over 50 times. Additionally, we demonstrate the generalization capabilities of our model by evaluating it in zero-shot and few-shot settings on five specialized domain entity typing datasets that are unseen during training. Remarkably, our model outperforms large language models with 10 times more parameters in the zero-shot setting, and when fine-tuned on 50 examples, it significantly outperforms ChatGPT on all datasets. Our code, models and demo are available at <a class="link-external link-https" href="https://github.com/yanlinf/CASENT" rel="external noopener nofollow">this https URL</a>.

Ultra-Fine Entity Typing with Prior Knowledge about Labels: A Simple Clustering Based Strategy

From Ultra-Fine to Fine: Fine-tuning Ultra-Fine Entity Typing Models to Fine-grained

Improving Distantly-supervised Entity Typing with Compact Latent Space Clustering

Label Noise Reduction in Entity Typing by Heterogeneous Partial-Label Embedding

Divide and Denoise: Learning from Noisy Labels in Fine-Grained Entity Typing with Cluster-Wise Loss Correction.

Fine-Grained Classification of Named Entities by Fusing Multi-Features.

EnCore: Fine-Grained Entity Typing by Pre-Training Entity Encoders on Coreference Chains

Type-enriched Hierarchical Contrastive Strategy for Fine-Grained Entity Typing

Few-Shot Fine-Grained Entity Typing with Automatic Label Interpretation and Instance Generation

A Three-Stage Curriculum Learning Framework with Hierarchical Label Smoothing for Fine-Grained Entity Typing.

Learning with Noise: Improving Distantly-Supervised Fine-grained Entity Typing Via Automatic Relabeling.

Calibrated Seq2seq Models for Efficient and Generalizable Ultra-fine Entity Typing

Alleviate Dataset Shift Problem in Fine-Grained Entity Typing with Virtual Adversarial Training

Hierarchical Modeling of Label Dependency and Label Noise in Fine-grained Entity Typing

Fine-Grained Entity Typing for Relation-Sparsity Entities

Imposing Label-Relational Inductive Bias for Extremely Fine-Grained Entity Typing

OntoType: Ontology-Guided and Pre-Trained Language Model Assisted Fine-Grained Entity Typing

Modeling Noisy Hierarchical Types in Fine-Grained Entity Typing: A Content-Based Weighting Approach

Fine-Grained Entity Typing for Domain Independent Entity Linking

Improving Zero-Shot Entity Linking Candidate Generation with Ultra-Fine Entity Type Information.

Liberal Entity Extraction: Rapid Construction of Fine-Grained Entity Typing Systems