Abstract:Background: With the popularization of electronic health records in China, the utilization of digitalized data has great potential for the development of real-world medical research. However, the data usually contains a great deal of protected health information and the direct usage of this data may cause privacy issues. The task of deidentifying protected health information in electronic health records can be regarded as a named entity recognition problem. Existing rule-based, machine learning–based, or deep learning–based methods have been proposed to solve this problem. However, these methods still face the difficulties of insufficient Chinese electronic health record data and the complex features of the Chinese language. Objective: This paper proposes a method to overcome the difficulties of overfitting and a lack of training data for deep neural networks to enable Chinese protected health information deidentification. Methods: We propose a new model that merges TinyBERT (bidirectional encoder representations from transformers) as a text feature extraction module and the conditional random field method as a prediction module for deidentifying protected health information in Chinese medical electronic health records. In addition, a hybrid data augmentation method that integrates a sentence generation strategy and a mention-replacement strategy is proposed for overcoming insufficient Chinese electronic health records. Results: We compare our method with 5 baseline methods that utilize different BERT models as their feature extraction modules. Experimental results on the Chinese electronic health records that we collected demonstrate that our method had better performance (microprecision: 98.7%, microrecall: 99.13%, and micro-F1 score: 98.91%) and higher efficiency (40% faster) than all the BERT-based baseline methods. Conclusions: Compared to baseline methods, the efficiency advantage of TinyBERT on our proposed augmented data set was kept while the performance improved for the task of Chinese protected health information deidentification.

Application of Chinese medical document anonymization in EMR system

De-identification of Free-Text Medical Records in Health Information Exchange

Term Extraction and Negation Detection Method in Chinese Clinical Document

A Machine Learning Based Approach to Identify Protected Health Information in Chinese Clinical Text

Increasing The Meaningful Use Of Electronic Medical Records: A Localized Health Level 7 Clinical Document Architecture System

Privacy Preservation for Outsourced Medical Data with Flexible Access Control

A Hybrid Machine Learning Method for the De-identification of Un-Structured Narrative Clinical Text in Multi-center Chinese Electronic Medical Records Data

A Cascaded Approach for Chinese Clinical Text De-Identification with Less Annotation Effort

Privacy-Preserving Data Publishing for Free Text Chinese Electronic Medical Records

Improving Chinese Electronic Medical Record Retrieval by Field Weight Assignment, Negation Detection, and Re-ranking

Novel Algorithm on Electronic Medical Record Privacy Protection Against Background Knowledge Attack

Privacy Protection of Sexually Transmitted Infections Information from Chinese Electronic Medical Records

Framework Design and Case Study for Privacy-Preserving Medical Data Publishing

Automatic De-Identification of Electronic Medical Records Using Token-Level and Character-Level Conditional Random Fields

Development and Validation of Method for Defining Conditions Using Chinese Electronic Medical Record

Anonymization of DICOM electronic medical records for radiation therapy

An Easy-to-use and Robust Approach for the Differentially Private De-Identification of Clinical Textual Documents

An Efficient Method for Deidentifying Protected Health Information in Chinese Electronic Health Records: Algorithm Development and Validation

A Deep Learning-Based System for the MEDDOCAN Task

Development and validation of a natural language processing algorithm to pseudonymize documents in the context of a clinical data warehouse

Anonymizing facial images to improve patient privacy