SYNFAC-EDIT: Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarization

Prakamya Mishra,Zonghai Yao,Parth Vashisht,Feiyun Ouyang,Beining Wang,Vidhi Dhaval Mody,Hong Yu

2024-10-03

Abstract:Large Language Models (LLMs) such as GPT & Llama have demonstrated significant achievements in summarization tasks but struggle with factual inaccuracies, a critical issue in clinical NLP applications where errors could lead to serious consequences. To counter the high costs and limited availability of expert-annotated data for factual alignment, this study introduces an innovative pipeline that utilizes >100B parameter GPT variants like GPT-3.5 & GPT-4 to act as synthetic experts to generate high-quality synthetics feedback aimed at enhancing factual consistency in clinical note summarization. Our research primarily focuses on edit feedback generated by these synthetic feedback experts without additional human annotations, mirroring and optimizing the practical scenario in which medical professionals refine AI system outputs. Although such 100B+ parameter GPT variants have proven to demonstrate expertise in various clinical NLP tasks, such as the Medical Licensing Examination, there is scant research on their capacity to act as synthetic feedback experts and deliver expert-level edit feedback for improving the generation quality of weaker (<10B parameter) LLMs like GPT-2 (1.5B) & Llama 2 (7B) in clinical domain. So in this work, we leverage 100B+ GPT variants to act as synthetic feedback experts offering expert-level edit feedback, that is used to reduce hallucinations and align weaker (<10B parameter) LLMs with medical facts using two distinct alignment algorithms (DPO & SALT), endeavoring to narrow the divide between AI-generated content and factual accuracy. This highlights the substantial potential of LLM-based synthetic edits in enhancing the alignment of clinical factuality.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the fact - inconsistency problem faced by large - language models (LLMs) in the task of clinical note summarization. Although LLMs such as GPT - 3.5 and GPT - 4 perform well on summarization tasks, they are prone to hallucination (i.e., fictional information) and factual errors when generating summaries, which is a serious problem in clinical natural - language processing (NLP) applications because these errors may lead to serious misdiagnoses. To address the high cost and difficulty of obtaining expert - annotated data, this paper proposes an innovative pipeline that utilizes GPT variants with over 10 billion parameters as synthetic experts to generate high - quality synthetic editorial feedback to improve the fact - consistency of clinical note summaries. Specifically, the paper proposes the following solutions: 1. **Synthetic Editorial Feedback Generation**: Use large - scale GPT variants (such as GPT - 3.5 and GPT - 4) as synthetic experts to generate high - quality synthetic editorial feedback to enhance the fact - consistency of clinical note summaries. These synthetic experts can generate two types of editorial feedback: - **High→Low**: Given a factually correct summary, generate a summary that contains hallucinations. - **Low→High**: Given a factually incorrect summary, generate a factually correct summary. 2. **Alignment Training**: Utilize the generated synthetic editorial feedback data to train weaker LLMs (such as GPT - 2 and Llama - 2) through two alignment algorithms (DPO and SALT) to reduce hallucinations and align these models with medical facts. 3. **Experimental Verification**: Verify the effectiveness of using synthetic editorial feedback data through experiments. The results show that after alignment training, the summaries generated by the models have significantly improved in terms of factual accuracy. The core objective of the paper is to improve the fact - consistency in the task of clinical note summarization through synthetic editorial feedback techniques, thereby enhancing the reliability and practicality of LLMs in the medical field.

SYNFAC-EDIT: Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarization

Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarization

Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models

TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization

Minimizing Factual Inconsistency and Hallucination in Large Language Models

Adapted large language models can outperform medical experts in clinical text summarization

Retrieval-Augmented and Knowledge-Grounded Language Models for Faithful Clinical Medicine

A Framework to Assess Clinical Safety and Hallucination Rates of LLMs for Medical Text Summarisation

Large Language Models, scientific knowledge and factuality: A framework to streamline human expert evaluation

Factual Consistency Evaluation of Summarisation in the Era of Large Language Models

Generating medically-accurate summaries of patient-provider dialogue: A multi-stage approach using large language models

Evaluating Large Language Models for Drafting Emergency Department Discharge Summaries

Faithful AI in Medicine: A Systematic Review with Large Language Models and Beyond

A Data-Centric Approach To Generate Faithful and High Quality Patient Summaries with Large Language Models

Analyzing LLM Behavior in Dialogue Summarization: Unveiling Circumstantial Hallucination Trends

Automatic Summarization of Doctor-Patient Encounter Dialogues Using Large Language Model through Prompt Tuning

Clinical Text Summarization: Adapting Large Language Models Can Outperform Human Experts

Improving Summarization with Human Edits

Accuracy, Consistency, and Hallucination of Large Language Models When Analyzing Unstructured Clinical Notes in Electronic Medical Records.

Med42 -- Evaluating Fine-Tuning Strategies for Medical LLMs: Full-Parameter vs. Parameter-Efficient Approaches