Synthetic chest X-ray images from text prompts

Daniel Truhn,Jakob Nikolas Kather

DOI: https://doi.org/10.1038/s41551-024-01261-z

IF: 28.1

2024-10-08

Nature Biomedical Engineering

Abstract:A latent diffusion model pre-trained on pairs of natural images and text descriptors can be adapted to generate realistic chest radiographs that are controlled by free-form medical text prompts.

engineering, biomedical

What problem does this paper attempt to address?

RoentGen: Vision-Language Foundation Model for Chest X-ray Generation

Akshay Chaudhari,M. Polacin,Jean-Benoit Delbrouck,T. Abraham,Shivanshu Purohit,Rogier van der Sluijs,Christian Blüthgen,P. Chambon,C. Langlotz,Juan Manuel Zambrano Chaves

DOI: https://doi.org/10.48550/arXiv.2211.12737

2022-11-23

Abstract:Multimodal models trained on large natural image-text pair datasets have exhibited astounding abilities in generating high-quality images. Medical imaging data is fundamentally different to natural images, and the language used to succinctly capture relevant details in medical data uses a different, narrow but semantically rich, domain-specific vocabulary. Not surprisingly, multi-modal models trained on natural image-text pairs do not tend to generalize well to the medical domain. Developing generative imaging models faithfully representing medical concepts while providing compositional diversity could mitigate the existing paucity of high-quality, annotated medical imaging datasets. In this work, we develop a strategy to overcome the large natural-medical distributional shift by adapting a pre-trained latent diffusion model on a corpus of publicly available chest x-rays (CXR) and their corresponding radiology (text) reports. We investigate the model's ability to generate high-fidelity, diverse synthetic CXR conditioned on text prompts. We assess the model outputs quantitatively using image quality metrics, and evaluate image quality and text-image alignment by human domain experts. We present evidence that the resulting model (RoentGen) is able to create visually convincing, diverse synthetic CXR images, and that the output can be controlled to a new extent by using free-form text prompts including radiology-specific language. Fine-tuning this model on a fixed training set and using it as a data augmentation method, we measure a 5% improvement of a classifier trained jointly on synthetic and real images, and a 3% improvement when trained on a larger but purely synthetic training set. Finally, we observe that this fine-tuning distills in-domain knowledge in the text-encoder and can improve its representation capabilities of certain diseases like pneumothorax by 25%.

Medicine,Computer Science
A vision–language foundation model for the generation of realistic chest X-ray images

Christian Bluethgen,Pierre Chambon,Jean-Benoit Delbrouck,Rogier van der Sluijs,Małgorzata Połacin,Juan Manuel Zambrano Chaves,Tanishq Mathew Abraham,Shivanshu Purohit,Curtis P. Langlotz,Akshay S. Chaudhari

DOI: https://doi.org/10.1038/s41551-024-01246-y

IF: 28.1

2024-08-28

Nature Biomedical Engineering

Abstract:The paucity of high-quality medical imaging datasets could be mitigated by machine learning models that generate compositionally diverse images that faithfully represent medical concepts and pathologies. However, large vision–language models are trained on natural images, and the diversity distribution of the generated images substantially differs from that of medical images. Moreover, medical language involves specific and semantically rich vocabulary. Here we describe a domain-adaptation strategy for large vision–language models that overcomes distributional shifts. Specifically, by leveraging publicly available datasets of chest X-ray images and the corresponding radiology reports, we adapted a latent diffusion model pre-trained on pairs of natural images and text descriptors to generate diverse and visually plausible synthetic chest X-ray images (as confirmed by board-certified radiologists) whose appearance can be controlled with free-form medical text prompts. The domain-adaptation strategy for the text-conditioned synthesis of medical images can be used to augment training datasets and is a viable alternative to the sharing of real medical images for model training and fine-tuning.

engineering, biomedical
Chest-Diffusion: A Light-Weight Text-to-Image Model for Report-to-CXR Generation

Peng Huang,Xue Gao,Lihong Huang,Jing Jiao,Xiaokang Li,Yuanyuan Wang,Yi Guo

2024-07-01

Abstract:Text-to-image generation has important implications for generation of diverse and controllable images. Several attempts have been made to adapt Stable Diffusion (SD) to the medical domain. However, the large distribution difference between medical reports and natural texts, as well as high computational complexity in common stable diffusion limit the authenticity and feasibility of the generated medical images. To solve above problems, we propose a novel light-weight transformer-based diffusion model learning framework, Chest-Diffusion, for report-to-CXR generation. Chest-Diffusion employs a domain-specific text encoder to obtain accurate and expressive text features to guide image generation, improving the authenticity of the generated images. Meanwhile, we introduce a light-weight transformer architecture as the denoising model, reducing the computational complexity of the diffusion model. Experiments demonstrate that our Chest-Diffusion achieves the lowest FID score 24.456, under the computation budget of 118.918 GFLOPs, which is nearly one-third of the computational complexity of SD.

Computer Vision and Pattern Recognition,Artificial Intelligence
Cascaded Latent Diffusion Models for High-Resolution Chest X-ray Synthesis

Tobias Weber,Michael Ingrisch,Bernd Bischl,David Rügamer

2023-03-21

Abstract:While recent advances in large-scale foundational models show promising results, their application to the medical domain has not yet been explored in detail. In this paper, we progress into the realms of large-scale modeling in medical synthesis by proposing Cheff - a foundational cascaded latent diffusion model, which generates highly-realistic chest radiographs providing state-of-the-art quality on a 1-megapixel scale. We further propose MaCheX, which is a unified interface for public chest datasets and forms the largest open collection of chest X-rays up to date. With Cheff conditioned on radiological reports, we further guide the synthesis process over text prompts and unveil the research area of report-to-chest-X-ray generation.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Generation of Anonymous Chest Radiographs Using Latent Diffusion Models for Training Thoracic Abnormality Classification Systems

Kai Packhäuser,Lukas Folle,Florian Thamm,Andreas Maier

DOI: https://doi.org/10.48550/arXiv.2211.01323

2022-11-02

Image and Video Processing

Abstract:The availability of large-scale chest X-ray datasets is a requirement for developing well-performing deep learning-based algorithms in thoracic abnormality detection and classification. However, biometric identifiers in chest radiographs hinder the public sharing of such data for research purposes due to the risk of patient re-identification. To counteract this issue, synthetic data generation offers a solution for anonymizing medical images. This work employs a latent diffusion model to synthesize an anonymous chest X-ray dataset of high-quality class-conditional images. We propose a privacy-enhancing sampling strategy to ensure the non-transference of biometric information during the image generation process. The quality of the generated images and the feasibility of serving as exclusive training data are evaluated on a thoracic abnormality classification task. Compared to a real classifier, we achieve competitive results with a performance gap of only 3.5% in the area under the receiver operating characteristic curve.
Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Models

Hazrat Ali,Shafaq Murad,Zubair Shah

DOI: https://doi.org/10.48550/arXiv.2211.00902

2022-11-02

Image and Video Processing

Abstract:Generative models are becoming popular for the synthesis of medical images. Recently, neural diffusion models have demonstrated the potential to generate photo-realistic images of objects. However, their potential to generate medical images is not explored yet. In this work, we explore the possibilities of synthesis of medical images using neural diffusion models. First, we use a pre-trained DALLE2 model to generate lungs X-Ray and CT images from an input text prompt. Second, we train a stable diffusion model with 3165 X-Ray images and generate synthetic images. We evaluate the synthetic image data through a qualitative analysis where two independent radiologists label randomly chosen samples from the generated data as real, fake, or unsure. Results demonstrate that images generated with the diffusion model can translate characteristics that are otherwise very specific to certain medical conditions in chest X-Ray or CT images. Careful tuning of the model can be very promising. To the best of our knowledge, this is the first attempt to generate lungs X-Ray and CT images using neural diffusion models. This work aims to introduce a new dimension in artificial intelligence for medical imaging. Given that this is a new topic, the paper will serve as an introduction and motivation for the research community to explore the potential of diffusion models for medical image synthesis. We have released the synthetic images on https://www.kaggle.com/datasets/hazrat/awesomelungs.
XReal: Realistic Anatomy and Pathology-Aware X-ray Generation via Controllable Diffusion Model

Anees Ur Rehman Hashmi,Ibrahim Almakky,Mohammad Areeb Qazi,Santosh Sanjeev,Vijay Ram Papineni,Dwarikanath Mahapatra,Mohammad Yaqub

2024-03-14

Abstract:Large-scale generative models have demonstrated impressive capacity in producing visually compelling images, with increasing applications in medical imaging. However, they continue to grapple with the challenge of image hallucination and the generation of anatomically inaccurate outputs. These limitations are mainly due to the sole reliance on textual inputs and lack of spatial control over the generated images, hindering the potential usefulness of such models in real-life settings. We present XReal, a novel controllable diffusion model for generating realistic chest X-ray images through precise anatomy and pathology location control. Our lightweight method can seamlessly integrate spatial control in a pre-trained text-to-image diffusion model without fine-tuning, retaining its existing knowledge while enhancing its generation capabilities. XReal outperforms state-of-the-art x-ray diffusion models in quantitative and qualitative metrics while showing 13% and 10% anatomy and pathology realism gain, respectively, based on the expert radiologist evaluation. Our model holds promise for advancing generative models in medical imaging, offering greater precision and adaptability while inviting further exploration in this evolving field. A large synthetically generated data with annotations and code is publicly available at

Image and Video Processing,Computer Vision and Pattern Recognition
CXR-CLIP: Toward Large Scale Chest X-ray Language-Image Pre-training

Kihyun You,Jawook Gu,Jiyeon Ham,Beomhee Park,Jiho Kim,Eun Kyoung Hong,Woonhyunk Baek,Byungseok Roh

DOI: https://doi.org/10.48550/arXiv.2310.13292

2023-10-20

Computer Vision and Pattern Recognition

Abstract:A large-scale image-text pair dataset has greatly contributed to the development of vision-language pre-training (VLP) models, which enable zero-shot or few-shot classification without costly annotation. However, in the medical domain, the scarcity of data remains a significant challenge for developing a powerful VLP model. In this paper, we tackle the lack of image-text data in chest X-ray by expanding image-label pair as image-text pair via general prompt and utilizing multiple images and multiple sections in a radiologic report. We also design two contrastive losses, named ICL and TCL, for learning study-level characteristics of medical images and reports, respectively. Our model outperforms the state-of-the-art models trained under the same conditions. Also, enlarged dataset improve the discriminative power of our pre-trained model for classification, while sacrificing marginal retrieval performance. Code is available at https://github.com/kakaobrain/cxr-clip.
Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models

Weiwei Cao,Jianpeng Zhang,Yingda Xia,Tony C. W. Mok,Zi Li,Xianghua Ye,Le Lu,Jian Zheng,Yuxing Tang,Ling Zhang

2024-04-07

Abstract:Radiologists highly desire fully automated versatile AI for medical imaging interpretation. However, the lack of extensively annotated large-scale multi-disease datasets has hindered the achievement of this goal. In this paper, we explore the feasibility of leveraging language as a naturally high-quality supervision for chest CT imaging. In light of the limited availability of image-report pairs, we bootstrap the understanding of 3D chest CT images by distilling chest-related diagnostic knowledge from an extensively pre-trained 2D X-ray expert model. Specifically, we propose a language-guided retrieval method to match each 3D CT image with its semantically closest 2D X-ray image, and perform pair-wise and semantic relation knowledge distillation. Subsequently, we use contrastive learning to align images and reports within the same patient while distinguishing them from the other patients. However, the challenge arises when patients have similar semantic diagnoses, such as healthy patients, potentially confusing if treated as negatives. We introduce a robust contrastive learning that identifies and corrects these false negatives. We train our model with over 12,000 pairs of chest CT images and radiology reports. Extensive experiments across multiple scenarios, including zero-shot learning, report generation, and fine-tuning processes, demonstrate the model's feasibility in interpreting chest CT images.

Computer Vision and Pattern Recognition
MediSyn: Text-Guided Diffusion Models for Broad Medical 2D and 3D Image Synthesis

Joseph Cho,Cyril Zakka,Dhamanpreet Kaur,Rohan Shad,Ross Wightman,Akshay Chaudhari,William Hiesinger

2024-07-10

Abstract:Diffusion models have recently gained significant traction due to their ability to generate high-fidelity and diverse images and videos conditioned on text prompts. In medicine, this application promises to address the critical challenge of data scarcity, a consequence of barriers in data sharing, stringent patient privacy regulations, and disparities in patient population and demographics. By generating realistic and varying medical 2D and 3D images, these models offer a rich, privacy-respecting resource for algorithmic training and research. To this end, we introduce MediSyn, a pair of instruction-tuned text-guided latent diffusion models with the ability to generate high-fidelity and diverse medical 2D and 3D images across specialties and modalities. Through established metrics, we show significant improvement in broad medical image and video synthesis guided by text prompts.

Computer Vision and Pattern Recognition,Artificial Intelligence,Computation and Language,Machine Learning
Supervised and unsupervised language modelling in Chest X-Ray radiological reports

Ignat Drozdov,Daniel Forbes,Benjamin Szubert,Mark Hall,Chris Carlin,David J Lowe

DOI: https://doi.org/10.1371/journal.pone.0229963

IF: 3.7

2020-03-10

PLoS ONE

Abstract:Chest radiography (CXR) is the most commonly used imaging modality and deep neural network (DNN) algorithms have shown promise in effective triage of normal and abnormal radiograms. Typically, DNNs require large quantities of expertly labelled training exemplars, which in clinical contexts is a major bottleneck to effective modelling, as both considerable clinical skill and time is required to produce high-quality ground truths. In this work we evaluate thirteen supervised classifiers using two large free-text corpora and demonstrate that bi-directional long short-term memory (BiLSTM) networks with attention mechanism effectively identify Normal, Abnormal, and Unclear CXR reports in internal (n = 965 manually-labelled reports, f1-score = 0.94) and external (n = 465 manually-labelled reports, f1-score = 0.90) testing sets using a relatively small number of expert-labelled training observations (n = 3,856 annotated reports). Furthermore, we introduce a general unsupervised approach that accurately distinguishes Normal and Abnormal CXR reports in a large unlabelled corpus. We anticipate that the results presented in this work can be used to automatically extract standardized clinical information from free-text CXR radiological reports, facilitating the training of clinical decision support systems for CXR triage.
Chest X-Ray Quality Assessment Method With Medical Domain Knowledge Fusion

Shanshan Du,Yingwen Wang,Xinyu Huang,Rui-Wei Zhao,Xiaobo Zhang,Rui Feng,Quanli Shen,Jian Qiu Zhang

DOI: https://doi.org/10.1109/access.2023.3252893

IF: 3.9

2023-01-01

IEEE Access

Abstract:Digital X-ray radiography is widely used in clinical diagnosis. High quality chest X-ray is conducive to the accurate diagnosis of diseases by clinicians. However, the quality assessment of the chest X-ray images mainly depends on the subjective evaluation of doctors, and the results are influenced by the skill level and experience of the evaluators, involving many issues such as heavy workload and various uncertain factors in such subjective judgment. In this paper, we propose a chest X-ray quality assessment method that combines image-text contrastive learning with medical domain knowledge fusion. Based on pretraining the model from contrastive text-image pairs, large-scale real clinical chest X-ray and diagnostic report text information are fused, and the model is fine-tuned to achieve cross domain transfer learning. While improving the prediction accuracy of the algorithm, the cost of massive sample data annotation is avoided. The local visual patch features of the X-ray images are aligned with multiple text features to ensure that the visual features contain more fine-grained image information. Theoretical analysis and experimental results show that the contrastive learning algorithm based on the fusion of triplet information in medical knowledge graph and chest X-ray multi-modal data has achieved good performance in terms of accuracy. In addition, the method proposed in this paper can be easily extended to complete other tasks such as medical image multi-lesion segmentation and disease progression prediction.

computer science, information systems,telecommunications,engineering, electrical & electronic
Diff-CXR: Report-to-CXR generation through a disease-knowledge enhanced diffusion model

Peng Huang,Bowen Guo,Shuyu Liang,Junhu Fu,Yuanyuan Wang,Yi Guo

2024-10-26

Abstract:Text-To-Image (TTI) generation is significant for controlled and diverse image generation with broad potential applications. Although current medical TTI methods have made some progress in report-to-Chest-Xray (CXR) generation, their generation performance may be limited due to the intrinsic characteristics of medical data. In this paper, we propose a novel disease-knowledge enhanced Diffusion-based TTI learning framework, named Diff-CXR, for medical report-to-CXR generation. First, to minimize the negative impacts of noisy data on generation, we devise a Latent Noise Filtering Strategy that gradually learns the general patterns of anomalies and removes them in the latent space. Then, an Adaptive Vision-Aware Textual Learning Strategy is designed to learn concise and important report embeddings in a domain-specific Vision-Language Model, providing textual guidance for Chest-Xray generation. Finally, by incorporating the general disease knowledge into the pretrained TTI model via a delicate control adapter, a disease-knowledge enhanced diffusion model is introduced to achieve realistic and precise report-to-CXR generation. Experimentally, our Diff-CXR outperforms previous SOTA medical TTI methods by 33.4\% / 8.0\% and 23.8\% / 56.4\% in the FID and mAUC score on MIMIC-CXR and IU-Xray, with the lowest computational complexity at 29.641 GFLOPs. Downstream experiments on three thorax disease classification benchmarks and one CXR-report generation benchmark demonstrate that Diff-CXR is effective in improving classical CXR analysis methods. Notably, models trained on the combination of 1\% real data and synthetic data can achieve a competitive mAUC score compared to models trained on all data, presenting promising clinical applications.

Computer Vision and Pattern Recognition,Artificial Intelligence
Chest X-ray Inpainting with Deep Generative Models

Ecem Sogancioglu,Shi Hu,Davide Belli,Bram van Ginneken

DOI: https://doi.org/10.48550/arXiv.1809.01471

2018-08-29

Abstract:Generative adversarial networks have been successfully applied to inpainting in natural images. However, the current state-of-the-art models have not yet been widely adopted in the medical imaging domain. In this paper, we investigate the performance of three recently published deep learning based inpainting models: context encoders, semantic image inpainting, and the contextual attention model, applied to chest x-rays, as the chest exam is the most commonly performed radiological procedure. We train these generative models on 1.2M 128 $\times$ 128 patches from 60K healthy x-rays, and learn to predict the center 64 $\times$ 64 region in each patch. We test the models on both the healthy and abnormal radiographs. We evaluate the results by visual inspection and comparing the PSNR scores. The outputs of the models are in most cases highly realistic. We show that the methods have potential to enhance and detect abnormalities. In addition, we perform a 2AFC observer study and show that an experienced human observer performs poorly in detecting inpainted regions, particularly those generated by the contextual attention model.

Graphics,Machine Learning
Reconstruction of patient-specific confounders in AI-based radiologic image interpretation using generative pretraining

Tianyu Han,Laura Žigutytė,Luisa Huck,Marc Sebastian Huppertz,Robert Siepmann,Yossi Gandelsman,Christian Blüthgen,Firas Khader,Christiane Kuhl,Sven Nebelung,Jakob Nikolas Kather,Daniel Truhn

DOI: https://doi.org/10.1016/j.xcrm.2024.101713

2024-08-29

Abstract:Reliably detecting potentially misleading patterns in automated diagnostic assistance systems, such as those powered by artificial intelligence (AI), is crucial for instilling user trust and ensuring reliability. Current techniques fall short in visualizing such confounding factors. We propose DiffChest, a self-conditioned diffusion model trained on 515,704 chest radiographs from 194,956 patients across the US and Europe. DiffChest provides patient-specific explanations and visualizes confounding factors that might mislead the model. The high inter-reader agreement, with Fleiss' kappa values of 0.8 or higher, validates its capability to identify treatment-related confounders. Confounders are accurately detected with 10%-100% prevalence rates. The pretraining process optimizes the model for relevant imaging information, resulting in excellent diagnostic accuracy for 11 chest conditions, including pleural effusion and heart insufficiency. Our findings highlight the potential of diffusion models in medical image classification, providing insights into confounding factors and enhancing model robustness and reliability.
Learning to Read Chest X-Ray Images from 16000+ Examples Using CNN

Yuxi Dong,Yuchao Pan,Jun Zhang,Wei Xu

DOI: https://doi.org/10.1109/CHASE.2017.59

2017-01-01

Abstract:Chest radiography (chest X-ray) is a low-cost yet effective and widely used medical imaging procedures. The lacking of qualified radiologist seriously limits the applicability of the technique. We explore the possibility of designing a computer-aided diagnosis for chest X-rays using deep convolutional neural networks. Using a real-world dataset of 16,000 chest X-rays with natural language diagnosis reports, we can train a multi-class classification model from images and preform accurate diagnosis, without any prior domain knowledge.
RadTex: Learning Efficient Radiograph Representations from Text Reports

Keegan Quigley,Miriam Cha,Ruizhi Liao,Geeticka Chauhan,Steven Horng,Seth Berkowitz,Polina Golland

DOI: https://doi.org/10.48550/arXiv.2208.03218

2022-08-05

Computer Vision and Pattern Recognition

Abstract:Automated analysis of chest radiography using deep learning has tremendous potential to enhance the clinical diagnosis of diseases in patients. However, deep learning models typically require large amounts of annotated data to achieve high performance -- often an obstacle to medical domain adaptation. In this paper, we build a data-efficient learning framework that utilizes radiology reports to improve medical image classification performance with limited labeled data (fewer than 1000 examples). Specifically, we examine image-captioning pretraining to learn high-quality medical image representations that train on fewer examples. Following joint pretraining of a convolutional encoder and transformer decoder, we transfer the learned encoder to various classification tasks. Averaged over 9 pathologies, we find that our model achieves higher classification performance than ImageNet-supervised and in-domain supervised pretraining when labeled training data is limited.
Towards Predicting Temporal Changes in a Patient's Chest X-ray Images based on Electronic Health Records

Daeun Kyung,Junu Kim,Tackeun Kim,Edward Choi

2024-09-11

Abstract:Chest X-ray imaging (CXR) is an important diagnostic tool used in hospitals to assess patient conditions and monitor changes over time. Generative models, specifically diffusion-based models, have shown promise in generating realistic synthetic X-rays. However, these models mainly focus on conditional generation using single-time-point data, i.e., typically CXRs taken at a specific time with their corresponding reports, limiting their clinical utility, particularly for capturing temporal changes. To address this limitation, we propose a novel framework, EHRXDiff, which predicts future CXR images by integrating previous CXRs with subsequent medical events, e.g., prescriptions, lab measures, etc. Our framework dynamically tracks and predicts disease progression based on a latent diffusion model, conditioned on the previous CXR image and a history of medical events. We comprehensively evaluate the performance of our framework across three key aspects, including clinical consistency, demographic consistency, and visual realism. We demonstrate that our framework generates high-quality, realistic future images that capture potential temporal changes, suggesting its potential for further development as a clinical simulation tool. This could offer valuable insights for patient monitoring and treatment planning in the medical field.

Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition
RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reporting

Benjamin Hou,Georgios Kaissis,Ronald Summers,Bernhard Kainz

DOI: https://doi.org/10.48550/arXiv.2107.02104

2021-09-15

Abstract:Chest radiographs are one of the most common diagnostic modalities in clinical routine. It can be done cheaply, requires minimal equipment, and the image can be diagnosed by every radiologists. However, the number of chest radiographs obtained on a daily basis can easily overwhelm the available clinical capacities. We propose RATCHET: RAdiological Text Captioning for Human Examined Thoraces. RATCHET is a CNN-RNN-based medical transformer that is trained end-to-end. It is capable of extracting image features from chest radiographs, and generates medically accurate text reports that fit seamlessly into clinical work flows. The model is evaluated for its natural language generation ability using common metrics from NLP literature, as well as its medically accuracy through a surrogate report classification task. The model is available for download at: <a class="link-external link-http" href="http://www.github.com/farrell236/RATCHET" rel="external noopener nofollow">this http URL</a>.

Computer Vision and Pattern Recognition

Synthetic chest X-ray images from text prompts

RoentGen: Vision-Language Foundation Model for Chest X-ray Generation

A vision–language foundation model for the generation of realistic chest X-ray images

Chest-Diffusion: A Light-Weight Text-to-Image Model for Report-to-CXR Generation

Cascaded Latent Diffusion Models for High-Resolution Chest X-ray Synthesis

Generation of Anonymous Chest Radiographs Using Latent Diffusion Models for Training Thoracic Abnormality Classification Systems

Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Models

XReal: Realistic Anatomy and Pathology-Aware X-ray Generation via Controllable Diffusion Model

CXR-CLIP: Toward Large Scale Chest X-ray Language-Image Pre-training

Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models

MediSyn: Text-Guided Diffusion Models for Broad Medical 2D and 3D Image Synthesis

Supervised and unsupervised language modelling in Chest X-Ray radiological reports

Chest X-Ray Quality Assessment Method With Medical Domain Knowledge Fusion

Diff-CXR: Report-to-CXR generation through a disease-knowledge enhanced diffusion model

Chest X-ray Inpainting with Deep Generative Models

Reconstruction of patient-specific confounders in AI-based radiologic image interpretation using generative pretraining

Learning to Read Chest X-Ray Images from 16000+ Examples Using CNN

RadTex: Learning Efficient Radiograph Representations from Text Reports

Towards Predicting Temporal Changes in a Patient's Chest X-ray Images based on Electronic Health Records

RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reporting