Abstract:In recent years, as cybersecurity threats have become increasingly severe and cyberattacks have occurred frequently, higher requirements have been put forward for cybersecurity protection. Therefore, the Named Entity Recognition (NER) technique, which is the cornerstone of Cyber Threat Intelligence (CTI) analysis, is particularly important. However, most existing NER studies are limited to recognizing single-layer flat entities, ignoring the possible nested entities in CTI. On the other hand, most of the existing studies focus on English CTIs, and the existing models performed poorly in a limited number of Chinese CTI studies. Given the above challenges, we propose in this paper a novel unified model, RBTG, which aims to identify flat and nested entities in Chinese CTI effectively. To overcome the difficult boundary recognition problem and the direction-dependent and distance-dependent properties in Chinese CTI NER, we use Global Pointer as the decoder and TENER as the encoder layer, respectively. Specifically, the Global Pointer layer solves the problem of the insensitivity of general NER methods to entity boundaries by utilizing the relative position information and the multiplicative attention mechanism. The TENER layer adapts to the Chinese CTI NER task by introducing an attention mechanism with direction awareness and distance awareness. Meanwhile, to cope with the complex feature capture of hierarchical structure and dependencies among Chinese CTI nested entities, the TENER layer solves the problem by following the structure of multiple self-attention layers and feed-forward network layers superimposed on each other in the Transformer. In addition, to fill the gap in the Chinese CTI nested entity dataset, we further apply the Large Language Modeling (LLM) technique and domain knowledge to construct a high-quality Chinese CTI nested entity dataset, CDTinee, which consists of six entity types selected from STIX, including nearly 4000 entity types extracted from more than 3000 threatening sentences. In the experimental session, we conduct extensive experiments on multiple datasets, and the results show that the proposed model RBTG outperforms the baseline model in both flat NER and nested NER.

EIBC: a deep learning framework for Chinese toponym recognition with multiple layers

A Toponym Entity Recognition Model for Chinese Social Media

TopoBERT: Plug and Play Toponym Recognition Module Harnessing Fine-tuned BERT

A deep neural network model for Chinese toponym matching with geographic pre-training model

CHTopoNER model-based method for recognizing Chinese place names from social media information

ChineseTR: A weakly supervised toponym recognition architecture based on automatic training data generator and deep neural network

A Chinese Toponym Recognition Method Based on Conditional Random Field

LB-BMBC: MHBiaffine-CNN to Capture Span Scores with BERT Injected with Lexical Information for Chinese NER

A Study on Toponymic Entity Recognition Based on Pre-Trained Models Fused with Local Features for Genglubu in the South China Sea

A BERT based Chinese Named Entity Recognition method on ASEAN News

A Model for Geographical Named Entity Recognition and Correction Based on Deep Neural Networks and the BERT Model

Recognizing Large‐Scale AIGC on Search Engine Websites Based on Knowledge Integration and Feature Pyramid Network

Chinese Named Entity Recognition Method in History and Culture Field Based on BERT

A Unified Model for Chinese Cyber Threat Intelligence Flat Entity and Nested Entity Recognition

An ERNIE-Based Joint Model for Chinese Named Entity Recognition

Multilayer ToI Detection Approach for Nested NER

ATBBC: Named entity recognition in emergency domains based on joint BERT-BILSTM-CRF adversarial training

DePNR: A DeBERTa‐based deep learning model with complete position embedding for place name recognition from geographical literature

A Chinese named entity recognition model incorporating recurrent cell and information state recursion

A Chinese named entity recognition model: integrating label knowledge and lexicon information