REXEL: An End-to-end Model for Document-Level Relation Extraction and Entity Linking

Nacime Bouziani,Shubhi Tyagi,Joseph Fisher,Jens Lehmann,Andrea Pierleoni

2024-04-19

Abstract:Extracting structured information from unstructured text is critical for many downstream NLP applications and is traditionally achieved by closed information extraction (cIE). However, existing approaches for cIE suffer from two limitations: (i) they are often pipelines which makes them prone to error propagation, and/or (ii) they are restricted to sentence level which prevents them from capturing long-range dependencies and results in expensive inference time. We address these limitations by proposing REXEL, a highly efficient and accurate model for the joint task of document level cIE (DocIE). REXEL performs mention detection, entity typing, entity disambiguation, coreference resolution and document-level relation classification in a single forward pass to yield facts fully linked to a reference knowledge graph. It is on average 11 times faster than competitive existing approaches in a similar setting and performs competitively both when optimised for any of the individual subtasks and a variety of combinations of different joint tasks, surpassing the baselines by an average of more than 6 F1 points. The combination of speed and accuracy makes REXEL an accurate cost-efficient system for extracting structured information at web-scale. We also release an extension of the DocRED dataset to enable benchmarking of future work on DocIE, which is available at

Computation and Language

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

The paper aims to address two main issues that exist when extracting structured information from unstructured text:

1. **Error Propagation**: Traditional information extraction (cIE) methods typically adopt a pipeline architecture, where multiple subtasks (such as mention detection, entity type recognition, entity disambiguation, relation classification, etc.) are executed sequentially. This architecture tends to accumulate errors across different components, significantly reducing overall performance.

2. **Sentence-Level Limitation**: Most existing cIE methods operate mainly at the sentence level, processing entity relationships within a single sentence at a time. This prevents them from capturing long-distance dependencies across sentences, thereby limiting the amount of extractable information. Additionally, it results in longer inference times and inefficiency in large-scale applications.

To address these issues, the paper proposes REXEL, an efficient end-to-end model capable of jointly performing information extraction tasks at the document level, including mention detection, entity type recognition, entity disambiguation, coreference resolution, and document-level relation classification. REXEL generates fully linked facts to a reference knowledge graph in a single forward pass, thereby improving speed and accuracy.