Abstract:Radiologists face high burnout rates, partially due to the increasing volume of Chest X-rays (CXRs) requiring interpretation and reporting. Automated CXR report generation holds promise for reducing this burden and improving patient care. While current models show potential, their diagnostic accuracy is limited. Our proposed CXR report generator integrates elements of the radiologist workflow and introduces a novel reward for reinforcement learning. Our approach leverages longitudinal data from a patient's prior CXR study and effectively handles cases where no prior study exist, thus mirroring the radiologist's workflow. In contrast, existing models typically lack this flexibility, often requiring prior studies for the model to function optimally. Our approach also incorporates all CXRs from a patient's study and distinguishes between report sections through section embeddings. Our reward for reinforcement learning leverages CXR-BERT, which forces our model to learn the clinical semantics of radiology reporting. We conduct experiments on publicly available datasets -- MIMIC-CXR and Open-i IU X-ray -- with metrics shown to more closely correlate with radiologists' assessment of reporting. Results from our study demonstrate that the proposed model generates reports that are more aligned with radiologists' reports than state-of-the-art models, such as those utilising large language models, reinforcement learning, and multi-task learning. The proposed model improves the diagnostic accuracy of CXR report generation, which could one day reduce radiologists' workload and enhance patient care. Our Hugging Face checkpoint (<a class="link-external link-https" href="https://huggingface.co/aehrc/cxrmate" rel="external noopener nofollow">this https URL</a>) and code (<a class="link-external link-https" href="https://github.com/aehrc/cxrmate" rel="external noopener nofollow">this https URL</a>) are publicly available.

e-Health CSIRO at RRG24: Entropy-Augmented Self-Critical Sequence Training for Radiology Report Generation

An Inclusive Task-Aware Framework for Radiology Report Generation

Improving Radiology Report Generation Quality and Diversity through Reinforcement Learning and Text Augmentation

Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generation

Act Like a Radiologist: Radiology Report Generation across Anatomical Regions

Medical Report Generation Via Multimodal Spatio-Temporal Fusion

An efficient but effective writer: Diffusion-based semi-autoregressive transformer for automated radiology report generation

LLM-RG4: Flexible and Factual Radiology Report Generation across Diverse Input Contexts

X-ray Made Simple: Radiology Report Generation and Evaluation with Layman's Terms

A Systematic Review of Deep Learning-based Research on Radiology Report Generation

Large Model Driven Radiology Report Generation with Clinical Quality Reinforcement Learning

Scene Graph Aided Radiology Report Generation

CSAMDT: Conditional Self Attention Memory-Driven Transformers for Radiology Report Generation from Chest X-Ray

Improving Radiology Report Generation with Multi-Grained Abnormality Prediction

An X-Ray Is Worth 15 Features: Sparse Autoencoders for Interpretable Radiology Report Generation

Clinically Coherent Radiology Report Generation with Imbalanced Chest X-rays.

Radiology Report Generation via Structured Knowledge-Enhanced Multi-modal Attention and Contrastive Learning.

Learning Visual-Semantic Embeddings for Reporting Abnormal Findings on Chest X-rays

Radiology Report Generation via Visual Recalibration and Context Gating-Aware.

Designing a Robust Radiology Report Generation System

Improving Radiology Report Generation with D2-Net: when Diffusion Meets Discriminator