Abstract:Radiologists face high burnout rates, partially due to the increasing volume of Chest X-rays (CXRs) requiring interpretation and reporting. Automated CXR report generation holds promise for reducing this burden and improving patient care. While current models show potential, their diagnostic accuracy is limited. Our proposed CXR report generator integrates elements of the radiologist workflow and introduces a novel reward for reinforcement learning. Our approach leverages longitudinal data from a patient's prior CXR study and effectively handles cases where no prior study exist, thus mirroring the radiologist's workflow. In contrast, existing models typically lack this flexibility, often requiring prior studies for the model to function optimally. Our approach also incorporates all CXRs from a patient's study and distinguishes between report sections through section embeddings. Our reward for reinforcement learning leverages CXR-BERT, which forces our model to learn the clinical semantics of radiology reporting. We conduct experiments on publicly available datasets -- MIMIC-CXR and Open-i IU X-ray -- with metrics shown to more closely correlate with radiologists' assessment of reporting. Results from our study demonstrate that the proposed model generates reports that are more aligned with radiologists' reports than state-of-the-art models, such as those utilising large language models, reinforcement learning, and multi-task learning. The proposed model improves the diagnostic accuracy of CXR report generation, which could one day reduce radiologists' workload and enhance patient care. Our Hugging Face checkpoint (<a class="link-external link-https" href="https://huggingface.co/aehrc/cxrmate" rel="external noopener nofollow">this https URL</a>) and code (<a class="link-external link-https" href="https://github.com/aehrc/cxrmate" rel="external noopener nofollow">this https URL</a>) are publicly available.

FactCheXcker: Mitigating Measurement Hallucinations in Chest X-ray Report Generation Models

A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretation

ReXTrust: A Model for Fine-Grained Hallucination Detection in AI-Generated Radiology Reports

Anatomically-Grounded Fact Checking of Automated Chest X-ray Reports

CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reporting

Preference Fine-Tuning for Factuality in Chest X-Ray Interpretation Models Without Human Feedback

Semantic Consistency-Based Uncertainty Quantification for Factuality in Radiology Report Generation

MedHallBench: A New Benchmark for Assessing Hallucination in Medical Large Language Models

CoMT: Chain-of-Medical-Thought Reduces Hallucination in Medical Report Generation

Cascaded Latent Diffusion Models for High-Resolution Chest X-ray Synthesis

Factual Serialization Enhancement: A Key Innovation for Chest X-ray Report Generation

Clinically Accurate Chest X-Ray Report Generation

Direct Preference Optimization for Suppressing Hallucinated Prior Exams in Radiology Report Generation

Fact-Aware Multimodal Retrieval Augmentation for Accurate Medical Radiology Report Generation

A Unified Hallucination Mitigation Framework for Large Vision-Language Models

CXPMRG-Bench: Pre-training and Benchmarking for X-ray Medical Report Generation on CheXpert Plus Dataset

FactCHD: Benchmarking Fact-Conflicting Hallucination Detection

On the notion of Hallucinations from the lens of Bias and Validity in Synthetic CXR Images

X-TRA: Improving Chest X-ray Tasks with Cross-Modal Retrieval Augmentation

Clinically Coherent Radiology Report Generation with Imbalanced Chest X-rays.

Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generation