Abstract:Objective: External knowledge, such as lexicon of words in Chinese and domain knowledge graph (KG) of concepts, has been recently adopted to improve the performance of machine learning methods for named entity recognition (NER) as it can provide additional information beyond context. However, most existing studies only consider knowledge from one source (i.e., either lexicon or knowledge graph) in different ways and consider lexicon words or KG concepts independently with their boundaries. In this paper, we focus on leveraging multi source knowledge in a unified manner where lexicon words or KG concepts are well combined with their boundaries for Chinese Clinical NER (CNER). Material and Methods: We propose a novel method based on relational graph convolutional network (RGCN), called MKRGCN, to utilize multi-source knowledge in a unified manner for CNER. For any sentence, a relational graph based on words or concepts in each knowledge source is constructed, where lexicon words or KG concepts appearing in the sentence are linked to the containing tokens with the boundary information of the lexicon words or KG concepts. RGCN is used to model all relational graphs constructed from multi-source knowledge, and the representations of tokens from multi-source knowledge are integrated into the context representations of tokens via an attention mechanism. Based on the knowledge-enhanced representations of tokens, we deploy a conditional random field (CRF) layer for named entity label prediction. In this study, a lexicon of words and a medical knowledge graph are used as knowledge sources for Chinese CNER. Results: Our proposed method achieves the best performance on CCKS2017 and CCKS2018 in Chinese with F1 scores of 91.88% and 89.91%, respectively, significantly outperforming existing methods. The extended experiments on NCBI-Disease and BC2GM in English also prove the effectiveness of our method when only considering one knowledge source via RGCN. Conclusion: The MKRGCN model can integrate knowledge from the external lexicon and knowledge graph effectively for Chinese CNER and has the potential to be applied to English NER.

DCRL-KG: Distributed Multi-Modal Knowledge Graph Retrieval Platform Based on Collaborative Representation Learning

Knowledge Representation Learning with Entity Descriptions, Hierarchical Types, and Textual Relations

Dual graph-structured semantics multi-subspace learning for cross-modal retrieval

Effective Deep Learning-Based Multi-Modal Retrieval

Multi-modal Recommendation Based on Knowledge Graph

Multi-modal knowledge graphs representation learning via multi-headed self-attention

Bridging Multimedia Heterogeneity Gap Via Graph Representation Learning for Cross-Modal Retrieval.

Deep Multi-Graph Hierarchical Enhanced Semantic Representation for Cross-Modal Retrieval

Multi-Modal Relational Graph for Cross-Modal Video Moment Retrieval

Generative Multi-Modal Knowledge Retrieval with Large Language Models

Weighted Graph-structured Semantics Constraint Network for Cross-Modal Retrieval

FashionKLIP: Enhancing E-Commerce Image-Text Retrieval with Fashion Multi-Modal Conceptual Knowledge Graph

A Web Knowledge-Driven Multimodal Retrieval Method in Computational Social Systems: Unsupervised and Robust Graph Convolutional Hashing

Classification of multi-modal remote sensing images based on knowledge graph

Multimodal Knowledge Triple Extraction Based on Representation Learning

Distributed Representation Learning for Knowledge Graphs with Entity Descriptions

Category-Oriented Representation Learning for Image to Multi-Modal Retrieval

Leveraging Multi-source knowledge for Chinese clinical named entity recognition via relational graph convolutional network

MEduKG: A Deep-Learning-Based Approach for Multi-Modal Educational Knowledge Graph Construction

Heterogeneous memory enhanced graph reasoning network for cross-modal retrieval

A Novel Graph-Theoretic Deep Representation Learning Method for Multi-Label Remote Sensing Image Retrieval