Abstract:Nowadays, ensuring the quality of network services has become increasingly vital. Experts are turning to knowledge graph technology, with a significant emphasis on entity extraction in the identification of device configurations. This research paper presents a novel entity extraction method that leverages a combination of active learning and attention mechanisms. Initially, an improved active learning approach is employed to select the most valuable unlabeled samples, which are subsequently submitted for expert labeling. This approach successfully addresses the problems of isolated points and sample redundancy within the network configuration sample set. Then the labeled samples are utilized to train the model for network configuration entity extraction. Furthermore, the multi-head self-attention of the transformer model is enhanced by introducing the Adaptive Weighting method based on the Laplace mixture distribution. This enhancement enables the transformer model to dynamically adapt its focus to words in various positions, displaying exceptional adaptability to abnormal data and further elevating the accuracy of the proposed model. Through comparisons with Random Sampling (RANDOM), Maximum Normalized Log-Probability (MNLP), Least Confidence (LC), Token Entrop (TE), and Entropy Query by Bagging (EQB), the proposed method, Entropy Query by Bagging and Maximum Influence Active Learning (EQBMIAL), achieves comparable performance with only 40% of the samples on both datasets, while other algorithms require 50% of the samples. Furthermore, the entity extraction algorithm with the Adaptive Weighted Multi-head Attention mechanism (AW-MHA) is compared with BILSTM-CRF, Mutil_Attention-Bilstm-Crf, Deep_Neural_Model_NER and BERT_Transformer, achieving precision rates of 75.98% and 98.32% on the two datasets, respectively. Statistical tests demonstrate the statistical significance and effectiveness of the proposed algorithms in this paper.

A multimodal dual-fusion entity extraction model for large and complex devices

Towards Better Entity Linking with Multi-View Enhanced Distillation

Multi-Modal Entity Alignment Method Based on Feature Enhancement

Modeling Dense Cross-Modal Interactions for Joint Entity-Relation Extraction

Network Configuration Entity Extraction Method Based on Transformer with Multi-Head Attention Mechanism

TSVFN: Two-Stage Visual Fusion Network for multimodal relation extraction

MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignment

MLNet: a multi-level multimodal named entity recognition architecture

Multi-Modal Fusion-Based Multi-Task Semantic Communication System

Multi-Grained Multimodal Interaction Network for Entity Linking

Deep Multimodal Fusion Network for Semantic Segmentation Using Remote Sensing Image and LiDAR Data

A Multi-Entity Knowledge Joint Extraction Method of Communication Equipment Faults for Industrial IoT

Multi-modal Siamese Network for Entity Alignment

Generalizable Entity Grounding via Assistance of Large Language Model

Entity Linking Supported Multimodal Data: Fusing Text and Image features for Higher Accuracy

Dual-Gated Fusion with Prefix-Tuning for Multi-Modal Relation Extraction

Deep Multimodal Data Fusion

Universal Multi-modal Entity Alignment Via Iteratively Fusing Modality Similarity Paths.

LMFNet: An Efficient Multimodal Fusion Approach for Semantic Segmentation in High-Resolution Remote Sensing

A Crossmodal Multiscale Fusion Network for Semantic Segmentation of Remote Sensing Data

Multi-modal fusion for robust hand gesture recognition based on heterogeneous networks