DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4

Zhengliang Liu,Yue Huang,Xiaowei Yu,Lu Zhang,Zihao Wu,Chao Cao,Haixing Dai,Lin Zhao,Yiwei Li,Peng Shu,Fang Zeng,Lichao Sun,Wei Liu,Dinggang Shen,Quanzheng Li,Tianming Liu,Dajiang Zhu,Xiang Li

2023-12-22

Abstract:The digitization of healthcare has facilitated the sharing and re-using of medical data but has also raised concerns about confidentiality and privacy. HIPAA (Health Insurance Portability and Accountability Act) mandates removing re-identifying information before the dissemination of medical records. Thus, effective and efficient solutions for de-identifying medical data, especially those in free-text forms, are highly needed. While various computer-assisted de-identification methods, including both rule-based and learning-based, have been developed and used in prior practice, such solutions still lack generalizability or need to be fine-tuned according to different scenarios, significantly imposing restrictions in wider use. The advancement of large language models (LLM), such as ChatGPT and GPT-4, have shown great potential in processing text data in the medical domain with zero-shot in-context learning, especially in the task of privacy protection, as these models can identify confidential information by their powerful named entity recognition (NER) capability. In this work, we developed a novel GPT4-enabled de-identification framework (``DeID-GPT") to automatically identify and remove the identifying information. Compared to existing commonly used medical text data de-identification methods, our developed DeID-GPT showed the highest accuracy and remarkable reliability in masking private information from the unstructured medical text while preserving the original structure and meaning of the text. This study is one of the earliest to utilize ChatGPT and GPT-4 for medical text data processing and de-identification, which provides insights for further research and solution development on the use of LLMs such as ChatGPT/GPT-4 in healthcare. Codes and benchmarking data information are available at <a class="link-external link-https" href="https://github.com/yhydhx/ChatGPT-API" rel="external noopener nofollow">this https URL</a>.

Computation and Language,Computers and Society

What problem does this paper attempt to address?

The paper primarily focuses on addressing the issue of privacy protection in medical text data, specifically the removal or masking of identifiable personal information in Electronic Health Records (EHR) to comply with the requirements of the Health Insurance Portability and Accountability Act (HIPAA) in the United States. With the increasing digitization of medical data, while it has facilitated the sharing and reuse of medical information, it has also raised concerns about patient privacy and information security. HIPAA mandates the removal of 18 types of re-identifiable information before releasing medical records to protect patient privacy.

To tackle this challenge, the research team developed a GPT-4-based de-identification framework called DeID-GPT. This framework leverages the powerful capabilities of large language models, particularly the zero-shot learning ability, to handle de-identification tasks without prior training. By integrating the HIPAA-specified identifiable information into prompts and inputting these prompts along with the original clinical reports into large language models like ChatGPT or GPT-4, DeID-GPT can automatically identify and remove sensitive information while preserving the original structure and meaning of the text.

The paper compares existing manual, rule-based, and learning-based de-identification methods, highlighting issues such as poor generalizability and the need for fine-tuning for different scenarios. In contrast, the large language model-based approach offers better accuracy, processing speed, and generalization ability, efficiently completing de-identification tasks without compromising the integrity of the text content.

Additionally, the paper explores how to design high-quality prompts to enhance the model's efficiency and effectiveness in privacy protection and provides specific implementation details of the DeID-GPT framework along with performance comparisons with other de-identification methods. This work aims to provide a new solution for data de-identification in the medical field and lay the foundation for subsequent research and applications.