Abstract:To address the issue of efficiently reusing the massive amount of unstructured knowledge generated during the handling of track circuit equipment faults and to automate the construction of knowledge graphs in the railway maintenance domain, it is crucial to leverage knowledge extraction techniques to efficiently extract relational triplets from fault maintenance text data. Given the current lag in joint extraction technology within the railway domain and the inefficiency in resource utilization, this paper proposes a joint extraction model for track circuit entities and relations, integrating Global Pointer and tensor learning. Taking into account the associative characteristics of semantic relations, the nesting of domain-specific terms in the railway sector, and semantic diversity, this research views the relation extraction task as a tensor learning process and the entity recognition task as a span-based Global Pointer search process. First, a multi-layer dilate gated convolutional neural network with residual connections is used to extract key features and fuse the weighted information from the 12 different semantic layers of the RoBERTa-wwm-ext model, fully exploiting the performance of each encoding layer. Next, the Tucker decomposition method is utilized to capture the semantic correlations between relations, and an Efficient Global Pointer is employed to globally predict the start and end positions of subject and object entities, incorporating relative position information through rotary position embedding (RoPE). Finally, comparative experiments with existing mainstream joint extraction models were conducted, and the proposed model's excellent performance was validated on the English public datasets NYT and WebNLG, the Chinese public dataset DuIE, and a private track circuit dataset. The F1 scores on the NYT, WebNLG, and DuIE public datasets reached 92.1%, 92.7%, and 78.2%, respectively.

A joint extraction method for fault text entity relationships in smart grid considering nested entities and complex semantics

An Entity Alignment Method Integrating Dual Entity Classification and Graph Attention Networks in Power Domain

Semantic Framework-Based Defect Text Mining Technique and Application in Power Grid

A Multi-Entity Knowledge Joint Extraction Method of Communication Equipment Faults for Industrial IoT

Deep Analysis of Power Equipment Defects Based on Semantic Framework Text Mining Technology

Joint extraction of entities and relations based on character graph convolutional network and Multi-Head Self-Attention Mechanism

MHlinker: Research on a Joint Extraction Method of Fault Entity Relationship for Mine Hoist

An Entity-Relation Joint Extraction Method Based on Two Independent Sub-Modules From Unstructured Text

Transformer Fault-based Named Entity Recognition Method

A Novel Chinese Entity Relationship Extraction Method Based on the Bidirectional Maximum Entropy Markov Model

Entity relation joint extraction model combining pointer network and attention mechanism based on relative position embedding

Entity Relationship Extraction Based on Bi-LSTM and Attention Mechanism

A Coarse-to-Fine Framework for Entity-Relation Joint Extraction.

Joint Extraction of Long-Distance Entity Relation by Aggregating Local- and Semantic-Dependent Features

Integrating deep learning and multi-attention for joint extraction of entities and relationships in engineering consulting texts

Research on a Joint Extraction Method of Track Circuit Entities and Relations Integrating Global Pointer and Tensor Learning

A joint entity Relation Extraction method for document level Traditional Chinese Medicine texts

A relationship extraction method and system

Research on joint model relation extraction method based on entity mapping

Construction and Application of Text Entity Relation Joint Extraction Model Based on Multi-Head Attention Neural Network

WRTRe: Weighted Relative Position Transformer for Joint Entity and Relation Extraction.