Abstract:Objective: This study aims at realizing unsupervised term discovery in Chinese electronic health records (EHRs) by using the word segmentation technique. The existing supervised algorithms do not perform satisfactorily in the case of EHRs, as annotated medical data are scarce. We propose an unsupervised segmentation method (GTS) based on the graph partition principle, whose multi-granular segmentation capability can help realize efficient term discovery. Methods: A sentence is converted to an undirected graph, with the edge weights based on n-gram statistics, and ratio cut is used to split the sentence into words. The graph partition is solved efficiently via dynamic programming, and multi-granularity is realized by setting different partition numbers. A BERT-based discriminator is trained using generated samples to verify the correctness of the word boundaries. The words that are not recorded in existing dictionaries are retained as potential medical terms. Results: We compared the GTS approach with mature segmentation systems for both word segmentation and term discovery. MD students manually segmented Chinese EHRs at fine and coarse granularity levels and reviewed the term discovery results. The proposed unsupervised method outperformed all the competing algorithms in the word segmentation task. In term discovery, GTS outperformed the best baseline by 17 percentage points (a 47% relative percentage of increment) on F1-score. Conclusion: In the absence of annotated training data, the graph partition technique can effectively use the corpus statistics and even expert knowledge to realize unsupervised word segmentation of EHRs. Multi-granular segmentation can be used to provide potential medical terms of various lengths with high accuracy.

Unsupervised multi-granular Chinese word segmentation and term discovery via graph partition

Word Segmentation as Graph Partition.

GRAPH: A domain ontology-driven semantic graph auto extraction system

Leveraging Multi-granularity Heterogeneous Graph for Chinese Electronic Medical Records Summarization

Graph-BAS3Net: Boundary-Aware Semi-Supervised Segmentation Network with Bilateral Graph Convolution

Hybrid Granularity-Based Medical Event Extraction in Chinese Electronic Medical Records

How to Enhance Chinese Word Segmentation Using Knowledge Graphs

NE–LP: Normalized entropy- and loss prediction-based sampling for active learning in Chinese word segmentation on EHRs

Chinese Word Segmentation with Heterogeneous Graph Neural Network

Chinese medical named entity recognition based on multi-granularity semantic dictionary and multimodal tree

Method of Chinese Word Segmentation Based on Directed Graph

Unsupervised segmentation of chinese corpus using accessor variety

From Text to Topics in Healthcare Records: An Unsupervised Graph Partitioning Methodology

Lexicon-based Semi-Crf for Chinese Clinical Text Word Segmentation

Entity Recognition of Chinese Electronic Medical Record Based on Gated Graph Neural Network

A Fine-Grained Chinese Word Segmentation and Part-of-speech Tagging Corpus for Clinical Text

Unsupervised Chinese Word Segmentation with BERT Oriented Probing and Transformation

Adaptive Multi-Task Transfer Learning for Chinese Word Segmentation in Medical Text.

Binary Tree based Chinese Word Segmentation

Research on Chinese Word Segmentation Algorithm based on Dictionary and Statistical Method and Its Application in the field of Power Grid Control

Multi-task Heterogeneous Graph Learning on Electronic Health Records