The Application of Fine-Tuning on Pretrained Language Model in Information Extraction for Fault Knowledge Graphs

Kaiwen Zhang,Feiyu Su,Yixiang Huang,Yanming Li,Fengqi Wu,Yuhan Mao
DOI: https://doi.org/10.1109/icsp62122.2024.10743881
2024-01-01
Abstract:Constructing fault knowledge graphs holds significant importance for achieving intelligent maintenance and diagnosis in high-end equipment manufacturing. Effective information extraction and knowledge graph construction have proven challenging due to the lack of standardized representation of semantically complex unstructured text in the industrial domain. Therefore, in this study, we performed fine-tuning on the pre-trained language model (ChatGLM2-6B) with specific prompts to achieve information extraction from fault-related texts, ultimately leading to the construction of a fault knowledge graph. Experimental results demonstrate that the proposed method not only supports fine-tuning with limited data but also exhibits enhanced capability in understanding complex semantics related to fault symptoms and causes.
What problem does this paper attempt to address?