Feature-Enhanced Document-Level Relation Extraction in Threat Intelligence with Knowledge Distillation
Yongfei Li,Yuanbo Guo,Chen Fang,Yongjin Hu,Yingze Liu,Qingli Chen
DOI: https://doi.org/10.3390/electronics11223715
IF: 2.9
2022-11-14
Electronics
Abstract:Relation extraction in the threat intelligence domain plays an important role in mining the internal association between crucial threat elements and constructing a knowledge graph (KG). This study designed a novel document-level relation extraction model, FEDRE-KD, integrating additional features to take full advantage of the information in documents. The study also introduced a teacher–student model, realizing knowledge distillation, to further improve performance. Additionally, a threat intelligence ontology was constructed to standardize the entities and their relationships. To solve the problem of lack of publicly available datasets for threat intelligence, manual annotation was carried out on the documents collected from social blogs, vendor bulletins, and hacking forums. After training the model, we constructed a threat intelligence knowledge graph in Neo4j. Experimental results indicate the effectiveness of additional features and knowledge distillation. Compared to mainstream models SSAN, GAIN, and ATLOP, FEDRE-KD improved the F1score by 22.07, 20.06, and 22.38, respectively.
engineering, electrical & electronic,computer science, information systems,physics, applied