Abstract:Abstract Background Most biomedical information extraction focuses on binary relations within single sentences. However, extracting n-ary relations that span multiple sentences is in huge demand. At present, in the cross-sentence n-ary relation extraction task, the mainstream method not only relies heavily on syntactic parsing but also ignores prior knowledge. Results In this paper, we propose a novel cross-sentence n-ary relation extraction method that utilizes the multihead attention and knowledge representation that is learned from the knowledge graph. Our model is built on self-attention, which can directly capture the relations between two words regardless of their syntactic relation. In addition, our method makes use of entity and relation information from the knowledge base to impose assistance while predicting the relation. Experiments on n-ary relation extraction show that combining context and knowledge representations can significantly improve the n-ary relation extraction performance. Meanwhile, we achieve comparable results with state-of-the-art methods. Conclusions We explored a novel method for cross-sentence n-ary relation extraction. Unlike previous approaches, our methods operate directly on the sequence and learn how to model the internal structures of sentences. In addition, we introduce the knowledge representations learned from the knowledge graph into the cross-sentence n-ary relation extraction. Experiments based on knowledge representation learning show that entities and relations can be extracted in the knowledge graph, and coding this knowledge can provide consistent benefits.

Word Embedding Representation with Synthetic Position and Context Information for Relation Extraction

A Two-channel Model for Relation Extraction Using Multiple Trained Word Embeddings.

An Exploration Of Semantic Relations In Neural Word Embeddings Using Extrinsic Knowledge

Leveraging Knowledge Graph Embeddings to Enhance Contextual Representations for Relation Extraction

Attention-Based Convolutional Neural Network for Semantic Relation Extraction.

A relation aware embedding mechanism for relation extraction

WRTRe: Weighted Relative Position Transformer for Joint Entity and Relation Extraction.

Embedding Semantic Relations into Word Representations

Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networks.

Towards Bridged Vision and Language: Learning Cross-modal Knowledge Representation for Relation Extraction

SEE: Syntax-Aware Entity Embedding for Neural Relation Extraction

Syntax-aware entity representations for neural relation extraction.

Relation of the Relations: A New Paradigm of the Relation Extraction Problem

A Semantic Relation Preserved Word Embedding Reuse Method

Exploiting Entity BIO Tag Embeddings and Multi-task Learning for Relation Extraction with Imbalanced Data

On the Form of Parsed Sentences for Relation Extraction

A Multi-view Approach for Relation Extraction

A Two Dimensional Feature Engineering Method for Relation Extraction

Incorporating representation learning and multihead attention to improve biomedical cross-sentence n-ary relation extraction

BED: Bi-Encoder-Decoder Model for Canonical Relation Extraction

Improving Neural Relation Extraction with Implicit Mutual Relations