Prediction of air pollutants by using an artificial neural network

S. H. Sohn,S. Oh,Y. Yeo

DOI: https://doi.org/10.1007/BF02707129

1999-05-01

Abstract:

What problem does this paper attempt to address?

An Inclusive Task-Aware Framework for Radiology Report Generation

Lin Wang,Munan Ning,Donghuan Lu,Dong Wei,Yefeng Zheng,Jie Chen

DOI: https://doi.org/10.1007/978-3-031-16452-1_54

2022-01-01

Abstract:To avoid the tedious and laborious radiology report writing, the automatic generation of radiology reports has drawn great attention recently. Previous studies attempted to directly transfer the image captioning method to radiology report generation given the apparent similarity between these two tasks. Although these methods can generate fluent descriptions, their accuracy for abnormal structure identification is limited due to the neglecting of the highly structured property and extreme data imbalance of the radiology report generation task. Therefore, we propose a novel task-aware framework to address the above two issues, composed of a task distillation module turning the image-level report to structure-level description, a task-aware report generation module for the generation of structure-specific descriptions, along with a classification token to identify and emphasize the abnormality of each structure, and an auto-balance mask loss to alleviate the serious data imbalance between normal/abnormal descriptions as well as the imbalance among different structures. Comprehensive experiments conducted on two public datasets demonstrate that the proposed method outperforms the state-of-the-art methods by a large margin (3.5% BLEU-1 improvement on MIMIC-CXR dataset) and can effectively improve the accuracy regarding the abnormal structures. The code is available at https://github.com/Reremee/ITA.
Primed Self-Construal, Culture, and Stages of impression Formation

S. A. Saribay,SoYon Rim,J. Uleman

DOI: https://doi.org/10.1027/1864-9335/A000120

2012-11-05

Abstract:The effects of culture on impression formation are widely documented but poorly understood. Priming independent and interdependent self-construals, and focusing on particular stages of impression formation, could help remedy this because such self-con- struals differ across cultures. In three experiments, participants' were primed with independent or interdependent self-construals before they formed spontaneous or intentional impressions of others. In Experiment 1, lexical decision reaction times showed that both traits and situational properties were activated spontaneously, but were unaffected by self-construal priming. In Experiment 2, a false-recog- nition paradigm showed that spontaneous trait inferences were bound to relevant actors' faces, again regardless of self-construal priming. In Experiment 3, explicit ratings did show priming effects. Those primed with independent (but not interdependent) self-construal inferred traits more strongly than situational properties. Primed self-construals appear to affect intentional but not spontaneous stages of impression formation. The differences between effects of primed and chronic self-construals are discussed.
Radiology Report Generation via Structured Knowledge-Enhanced Multi-modal Attention and Contrastive Learning.

Dexuan Xu,Yanyuan Chen,Jiayu Zhang,Yiwei Lou,Hanpin Wang,Jing He,Yu Huang

DOI: https://doi.org/10.1109/BIBM58861.2023.10386013

2023-01-01

Abstract:The automated generation of radiology reports has attracted significant attention in the field of bioinformatics. Currently, the main limitations of this task include insufficient utilization of prior medical knowledge, lack of efficient knowledge fusion algorithms, and less distinctiveness between different generated reports. To address these issues, we propose a novel algorithm for radiology report generation, which includes Structured Knowledge-Enhanced Multi-modal Attention (SKEMA) and Dual-Branch Contrastive Learning (DBCL) for the first time. SKEMA aims to effectively bridge the gap between visual and prior knowledge by leveraging the high-order adjacency matrix of the knowledge graph to weightedly fuse image features and knowledge features. We enhance both features through masking, and use the original features and augmented features as positive and negative samples in the dual-branch contrastive learning (DBCL). DBCL increases the differences between positive and negative samples to avoid generating templated results, and enhances the robustness of the model. Finally, we conducted experiments to demonstrate the effectiveness of our model on two public radiology datasets, IU-Xray and MIMIC-CXR. Our model outperformed previous baseline methods on both datasets and achieved excellent evaluation scores.
Multi-modal Fusion with Semantic Supervision for Radiology Report Generation

Xing Jia,Yun Xiong,Yao Zhang,Li Luo

2023-01-01

Abstract:Radiology report generation, as one way of analyzing radiology images, is to generate a textual report automatically for the given image, and it is of great significance to assist diagnosis and alleviate the workload of radiologists. Some report generation methods have been therefore proposed. However, these methods suffer from the problem of low-quality generation, because of the visual and textual bias and training with text similarity oriented objective. To solve this problem, we propose a novel radiology report generation model with multi-modal fusion and semantic supervision, namely MS-Gen. MS-Gen consists of two main components, i.e., the semantic-visual fusion module and the semantic weighted contrastive loss. Specifically, the main idea of the semantic-visual fusion module is to make use of the domain-specific prior knowledge contained in a large pre-trained visual-language model and also the complementary nature between the image and text modalities. Moreover, a novel optimization term, i.e., the semantic weighted contrastive loss, is proposed to guide the optimization process with semantic similarity objective, and further enforce the generated reports with higher clinical accuracy. Extensive experiments conducted on two real datasets of IU X-Ray and MIMIC-CXR demonstrate the effectiveness of our proposed model.
Medical Report Generation based on Segment-Enhanced Contrastive Representation Learning

Ruoqing Zhao,Xi Wang,Hongliang Dai,Pan Gao,Piji Li

DOI: https://doi.org/10.48550/arXiv.2312.15869

2023-12-26

Abstract:Automated radiology report generation has the potential to improve radiology reporting and alleviate the workload of radiologists. However, the medical report generation task poses unique challenges due to the limited availability of medical data and the presence of data bias. To maximize the utility of available data and reduce data bias, we propose MSCL (Medical image Segmentation with Contrastive Learning), a framework that utilizes the Segment Anything Model (SAM) to segment organs, abnormalities, bones, etc., and can pay more attention to the meaningful ROIs in the image to get better visual representations. Then we introduce a supervised contrastive loss that assigns more weight to reports that are semantically similar to the target while training. The design of this loss function aims to mitigate the impact of data bias and encourage the model to capture the essential features of a medical image and generate high-quality reports. Experimental results demonstrate the effectiveness of our proposed model, where we achieve state-of-the-art performance on the IU X-Ray public dataset.

Computation and Language,Artificial Intelligence
A Comparison of Maternal Interview and Medical Record Ascertainment of Violence among Women who had Poor Pregnancy Outcomes

L. Fried,A. Aschengrau,H. Cabral,H. Amaro

DOI: https://doi.org/10.1007/s10995-006-0108-9

2006-06-27

Maternal and Child Health Journal

Abstract:
MCL: Multi-view Enhanced Contrastive Learning for Chest X-ray Report Generation

Kang Liu,Zhuoqi Ma,Kun Xie,Zhicheng Jiao,Qiguang Miao

2024-11-15

Abstract:Radiology reports are crucial for planning treatment strategies and enhancing doctor-patient communication, yet manually writing these reports is burdensome for radiologists. While automatic report generation offers a solution, existing methods often rely on single-view radiographs, limiting diagnostic accuracy. To address this problem, we propose MCL, a Multi-view enhanced Contrastive Learning method for chest X-ray report generation. Specifically, we first introduce multi-view enhanced contrastive learning for visual representation by maximizing agreements between multi-view radiographs and their corresponding report. Subsequently, to fully exploit patient-specific indications (e.g., patient's symptoms) for report generation, we add a transitional ``bridge" for missing indications to reduce embedding space discrepancies caused by their presence or absence. Additionally, we construct Multi-view CXR and Two-view CXR datasets from public sources to support research on multi-view report generation. Our proposed MCL surpasses recent state-of-the-art methods across multiple datasets, achieving a 5.0% F1 RadGraph improvement on MIMIC-CXR, a 7.3% BLEU-1 improvement on MIMIC-ABN, a 3.1% BLEU-4 improvement on Multi-view CXR, and an 8.2% F1 CheXbert improvement on Two-view CXR.

Computer Vision and Pattern Recognition,Artificial Intelligence
Radiology Report Generation with a Learned Knowledge Base and Multi-Modal Alignment

Shuxin Yang,Xian Wu,Shen Ge,Zhuozhao Zheng,S. Kevin Zhou,Li Xiao

DOI: https://doi.org/10.1016/j.media.2023.102798

IF: 10.9

2023-01-01

Medical Image Analysis

Abstract:In clinics, a radiology report is crucial for guiding a patient's treatment. However, writing radiology reports is a heavy burden for radiologists. To this end, we present an automatic, multi-modal approach for report generation from a chest x-ray. Our approach, motivated by the observation that the descriptions in radiology reports are highly correlated with specific information of the x-ray images, features two distinct modules: (i) Learned knowledge base: To absorb the knowledge embedded in the radiology reports, we build a knowledge base that can automatically distill and restore medical knowledge from textual embedding without manual labor; (ii) Multi-modal alignment: to promote the semantic alignment among reports, disease labels, and images, we explicitly utilize textual embedding to guide the learning of the visual feature space. We evaluate the performance of the proposed model using metrics from both natural language generation and clinic efficacy on the public IU-Xray and MIMIC-CXR datasets. Our ablation study shows that each module contributes to improving the quality of generated reports. Furthermore, the assistance of both modules, our approach outperforms state-of-the-art methods over almost all the metrics. Code is available at https://github.com/LX-doctorAI1/M2KT.
Topicwise Separable Sentence Retrieval for Medical Report Generation

Junting Zhao,Yang Zhou,Zhihao Chen,Huazhu Fu,Liang Wan

2024-05-07

Abstract:Automated radiology reporting holds immense clinical potential in alleviating the burdensome workload of radiologists and mitigating diagnostic bias. Recently, retrieval-based report generation methods have garnered increasing attention due to their inherent advantages in terms of the quality and consistency of generated reports. However, due to the long-tail distribution of the training data, these models tend to learn frequently occurring sentences and topics, overlooking the rare topics. Regrettably, in many cases, the descriptions of rare topics often indicate critical findings that should be mentioned in the report. To address this problem, we introduce a Topicwise Separable Sentence Retrieval (Teaser) for medical report generation. To ensure comprehensive learning of both common and rare topics, we categorize queries into common and rare types to learn differentiated topics, and then propose Topic Contrastive Loss to effectively align topics and queries in the latent space. Moreover, we integrate an Abstractor module following the extraction of visual features, which aids the topic decoder in gaining a deeper understanding of the visual observational intent. Experiments on the MIMIC-CXR and IU X-ray datasets demonstrate that Teaser surpasses state-of-the-art models, while also validating its capability to effectively represent rare topics and establish more dependable correspondences between queries and topics.

Computer Vision and Pattern Recognition
A Self-Guided Framework for Radiology Report Generation

Jun Li,Shibo Li,Ying Hu,Huiren Tao

DOI: https://doi.org/10.48550/arXiv.2206.09378

2022-06-19

Computation and Language

Abstract:Automatic radiology report generation is essential to computer-aided diagnosis. Through the success of image captioning, medical report generation has been achievable. However, the lack of annotated disease labels is still the bottleneck of this area. In addition, the image-text data bias problem and complex sentences make it more difficult to generate accurate reports. To address these gaps, we pre-sent a self-guided framework (SGF), a suite of unsupervised and supervised deep learning methods to mimic the process of human learning and writing. In detail, our framework obtains the domain knowledge from medical reports with-out extra disease labels and guides itself to extract fined-grain visual features as-sociated with the text. Moreover, SGF successfully improves the accuracy and length of medical report generation by incorporating a similarity comparison mechanism that imitates the process of human self-improvement through compar-ative practice. Extensive experiments demonstrate the utility of our SGF in the majority of cases, showing its superior performance over state-of-the-art meth-ods. Our results highlight the capacity of the proposed framework to distinguish fined-grained visual details between words and verify its advantage in generating medical reports.
MKCL: Medical Knowledge with Contrastive Learning model for radiology report generation

Xiaodi Hou,Zhi Liu,Xiaobo Li,Xingwang Li,Shengtian Sang,Yijia Zhang

DOI: https://doi.org/10.1016/j.jbi.2023.104496

IF: 8

2023-10-01

Journal of Biomedical Informatics

Abstract:Automatic radiology report generation has the potential to alert inexperienced radiologists to misdiagnoses or missed diagnoses and improve healthcare delivery efficiency by reducing the documentation workload of radiologists. Motivated by the continuous development of automatic image captioning, more and more deep learning methods have been proposed for automatic radiology report generation. However, the visual and textual data bias problem still face many challenges in the medical domain. Additionally, do not integrate medical knowledge, ignoring the mutual influences between medical findings, and abundant unlabeled medical images influence the accuracy of generating report. In this paper, we propose a Medical Knowledge with Contrastive Learning model (MKCL) to enhance radiology report generation. The proposed model MKCL uses IU Medical Knowledge Graph (IU-MKG) to mine the relationship among medical findings and improve the accuracy of identifying positive diseases findings from radiologic medical images. In particular, we design Knowledge Enhanced Attention (KEA), which integrates the IU-MKG and the extracted chest radiological visual features to alleviate textual data bias. Meanwhile, this paper leverages supervised contrastive learning to relieve radiographic medical images which have not been labeled, and identify abnormalities from images. Experimental results on the public dataset IU X-ray show that our proposed model MKCL outperforms other state-of-the-art report generation methods. Ablation studies also demonstrate that IU medical knowledge graph module and supervised contrastive learning module enhance the ability of the model to detect the abnormal parts and accurately describe the abnormal findings. The source code is available at: https://github.com/Eleanorhxd/MKCL.

medical informatics,computer science, interdisciplinary applications
Salad, house dressing, but hold the sulfites.

M. Sun

DOI: https://doi.org/10.1126/SCIENCE.226.4674.520-A

IF: 56.9

1984-11-02

Science

Abstract:
Unifying Relational Sentence Generation and Retrieval for Medical Image Report Composition

Fuyu Wang,Xiaodan Liang,Lin Xu,Liang Lin

DOI: https://doi.org/10.48550/arXiv.2101.03287

2021-01-09

Abstract:Beyond generating long and topic-coherent paragraphs in traditional captioning tasks, the medical image report composition task poses more task-oriented challenges by requiring both the highly-accurate medical term diagnosis and multiple heterogeneous forms of information including impression and findings. Current methods often generate the most common sentences due to dataset bias for individual case, regardless of whether the sentences properly capture key entities and relationships. Such limitations severely hinder their applicability and generalization capability in medical report composition where the most critical sentences lie in the descriptions of abnormal diseases that are relatively rare. Moreover, some medical terms appearing in one report are often entangled with each other and co-occurred, e.g. symptoms associated with a specific disease. To enforce the semantic consistency of medical terms to be incorporated into the final reports and encourage the sentence generation for rare abnormal descriptions, we propose a novel framework that unifies template retrieval and sentence generation to handle both common and rare abnormality while ensuring the semantic-coherency among the detected medical terms. Specifically, our approach exploits hybrid-knowledge co-reasoning: i) explicit relationships among all abnormal medical terms to induce the visual attention learning and topic representation encoding for better topic-oriented symptoms descriptions; ii) adaptive generation mode that changes between the template retrieval and sentence generation according to a contextual topic encoder. Experimental results on two medical report benchmarks demonstrate the superiority of the proposed framework in terms of both human and metrics evaluation.

Computation and Language,Computer Vision and Pattern Recognition
On the Automatic Generation of Medical Imaging Reports

Baoyu Jing,Pengtao Xie,Eric Xing

DOI: https://doi.org/10.18653/v1/P18-1240

2018-07-21

Abstract:Medical imaging is widely used in clinical practice for diagnosis and treatment. Report-writing can be error-prone for unexperienced physicians, and time- consuming and tedious for experienced physicians. To address these issues, we study the automatic generation of medical imaging reports. This task presents several challenges. First, a complete report contains multiple heterogeneous forms of information, including findings and tags. Second, abnormal regions in medical images are difficult to identify. Third, the re- ports are typically long, containing multiple sentences. To cope with these challenges, we (1) build a multi-task learning framework which jointly performs the pre- diction of tags and the generation of para- graphs, (2) propose a co-attention mechanism to localize regions containing abnormalities and generate narrations for them, (3) develop a hierarchical LSTM model to generate long paragraphs. We demonstrate the effectiveness of the proposed methods on two publicly available datasets.

Computation and Language,Computer Vision and Pattern Recognition
Chest radiology report generation based on cross-modal multi-scale feature fusion

Yu Pan,Li-Jun Liu,Xiao-Bing Yang,Wei Peng,Qing-Song Huang

DOI: https://doi.org/10.1016/j.jrras.2024.100823

IF: 1.77

2024-03-01

Journal of Radiation Research and Applied Sciences

Abstract:Chest radiology imaging plays a crucial role in the early screening, diagnosis, and treatment of chest diseases. The accurate interpretation of radiological images and the automatic generation of radiology reports not only save the doctor's time but also mitigate the risk of errors in diagnosis. The core objective of automatic radiology report generation is to achieve precise mapping of visual features and lesion descriptions at multi-scale and fine-grained levels. Existing methods typically combine global visual features and textual features to generate radiology reports. However, these approaches may ignore the key lesion areas and lack sensitivity to crucial lesion location information. Furthermore, achieving multi-scale characterization and fine-grained alignment of medical visual features and report text features proves challenging, leading to a reduction in the quality of radiology report generation. Addressing these issues, we propose a method for chest radiology report generation based on cross-modal multi-scale feature fusion. First, an auxiliary labeling module is designed to guide the model to focus on the lesion region of the radiological image. Second, a channel attention network is employed to enhance the characterization of location information and disease features. Finally, a cross-modal features fusion module is constructed by combining memory matrices, facilitating fine-grained alignment between multi-scale visual features and reporting text features on corresponding scales. The proposed method is experimentally evaluated on two publicly available radiological image datasets. The results demonstrate superior performance based on BLEU and ROUGE metrics compared to existing methods. Particularly, there are improvements of 4.8% in the ROUGE metric and 9.4% in the METEOR metric on the IU X-Ray dataset. Moreover, there is a 7.4% enhancement in BLEU-1 and a 7.6% improvement in the BLEU-2 on the MIMIC-CXR dataset.

multidisciplinary sciences
Learning to Generate Radiology Findings from Impressions Based on Large Language Model

Weilong Wu,Miao Li,Ji Wu,Ming Ni,Huishu Yuan

DOI: https://doi.org/10.1109/bigdata59044.2023.10386916

IF: 4.426

2023-01-01

Big Data

Abstract:Medical imaging plays a pivotal role in clinical diagnosis, and the textual reports associated with these images are of paramount importance in aiding image comprehension and supporting treatment decisions. Automated report generation serves to alleviate the burden on radiologists and has garnered significant attention in the field of medical artificial intelligence. Previous research in text-based report generation primarily focused on generating impressions statements from radiology findings. However, the benefits in terms of reducing the workload on radiologists were not particularly evident. In this article, we propose a novel task of generating findings from radiology impressions. Leveraging advanced large language models, we trained a set of report generation models using a real dataset of knee MRI reports. Additionally, we incorporated various strategies, including data augmentation and efficient parameter fine-tuning. Objective experiments affirm the effectiveness of the methods we introduced. Furthermore, we conducted subjective assessments by radiologists, and the results demonstrate that our trained large language models significantly outperform professional radiologists in terms of overall report quality and content consistency.
Graph Enhanced Contrastive Learning for Radiology Findings Summarization

Jinpeng Hu,Zhuo Li,Zhihong Chen,Zhen Li,Xiang Wan,Tsung-Hui Chang

DOI: https://doi.org/10.48550/arXiv.2204.00203

2022-06-08

Abstract:The impression section of a radiology report summarizes the most prominent observation from the findings section and is the most important section for radiologists to communicate to physicians. Summarizing findings is time-consuming and can be prone to error for inexperienced radiologists, and thus automatic impression generation has attracted substantial attention. With the encoder-decoder framework, most previous studies explore incorporating extra knowledge (e.g., static pre-defined clinical ontologies or extra background information). Yet, they encode such knowledge by a separate encoder to treat it as an extra input to their models, which is limited in leveraging their relations with the original findings. To address the limitation, we propose a unified framework for exploiting both extra knowledge and the original findings in an integrated way so that the critical information (i.e., key words and their relations) can be extracted in an appropriate way to facilitate impression generation. In detail, for each input findings, it is encoded by a text encoder, and a graph is constructed through its entities and dependency tree. Then, a graph encoder (e.g., graph neural networks (GNNs)) is adopted to model relation information in the constructed graph. Finally, to emphasize the key words in the findings, contrastive learning is introduced to map positive samples (constructed by masking non-key words) closer and push apart negative ones (constructed by masking key words). The experimental results on OpenI and MIMIC-CXR confirm the effectiveness of our proposed method.

Computation and Language,Artificial Intelligence
Effectively Fine-tune to Improve Large Multimodal Models for Radiology Report Generation

Yuzhe Lu,Sungmin Hong,Yash Shah,Panpan Xu

2023-12-04

Abstract:Writing radiology reports from medical images requires a high level of domain expertise. It is time-consuming even for trained radiologists and can be error-prone for inexperienced radiologists. It would be appealing to automate this task by leveraging generative AI, which has shown drastic progress in vision and language understanding. In particular, Large Language Models (LLM) have demonstrated impressive capabilities recently and continued to set new state-of-the-art performance on almost all natural language tasks. While many have proposed architectures to combine vision models with LLMs for multimodal tasks, few have explored practical fine-tuning strategies. In this work, we proposed a simple yet effective two-stage fine-tuning protocol to align visual features to LLM's text embedding space as soft visual prompts. Our framework with OpenLLaMA-7B achieved state-of-the-art level performance without domain-specific pretraining. Moreover, we provide detailed analyses of soft visual prompts and attention mechanisms, shedding light on future research directions.

Computer Vision and Pattern Recognition,Artificial Intelligence,Computation and Language,Machine Learning
TRRG: Towards Truthful Radiology Report Generation With Cross-modal Disease Clue Enhanced Large Language Model

Yuhao Wang,Chao Hao,Yawen Cui,Xinqi Su,Weicheng Xie,Tao Tan,Zitong Yu

2024-08-22

Abstract:The vision-language modeling capability of multi-modal large language models has attracted wide attention from the community. However, in medical domain, radiology report generation using vision-language models still faces significant challenges due to the imbalanced data distribution caused by numerous negated descriptions in radiology reports and issues such as rough alignment between radiology reports and radiography. In this paper, we propose a truthful radiology report generation framework, namely TRRG, based on stage-wise training for cross-modal disease clue injection into large language models. In pre-training stage, During the pre-training phase, contrastive learning is employed to enhance the ability of visual encoder to perceive fine-grained disease details. In fine-tuning stage, the clue injection module we proposed significantly enhances the disease-oriented perception capability of the large language model by effectively incorporating the robust zero-shot disease perception. Finally, through the cross-modal clue interaction module, our model effectively achieves the multi-granular interaction of visual embeddings and an arbitrary number of disease clue embeddings. This significantly enhances the report generation capability and clinical effectiveness of multi-modal large language models in the field of radiology reportgeneration. Experimental results demonstrate that our proposed pre-training and fine-tuning framework achieves state-of-the-art performance in radiology report generation on datasets such as IU-Xray and MIMIC-CXR. Further analysis indicates that our proposed method can effectively enhance the model to perceive diseases and improve its clinical effectiveness.

Computer Vision and Pattern Recognition
A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data

Xinyi Wang,Grazziela Figueredo,Ruizhe Li,Wei Emma Zhang,Weitong Chen,Xin Chen

2024-05-21

Abstract:Automatic radiology report generation can alleviate the workload for physicians and minimize regional disparities in medical resources, therefore becoming an important topic in the medical image analysis field. It is a challenging task, as the computational model needs to mimic physicians to obtain information from multi-modal input data (i.e., medical images, clinical information, medical knowledge, etc.), and produce comprehensive and accurate reports. Recently, numerous works emerged to address this issue using deep learning-based methods, such as transformers, contrastive learning, and knowledge-base construction. This survey summarizes the key techniques developed in the most recent works and proposes a general workflow for deep learning-based report generation with five main components, including multi-modality data acquisition, data preparation, feature learning, feature fusion/interaction, and report generation. The state-of-the-art methods for each of these components are highlighted. Additionally, training strategies, public datasets, evaluation methods, current challenges, and future directions in this field are summarized. We have also conducted a quantitative comparison between different methods under the same experimental setting. This is the most up-to-date survey that focuses on multi-modality inputs and data fusion for radiology report generation. The aim is to provide comprehensive and rich information for researchers interested in automatic clinical report generation and medical image analysis, especially when using multimodal inputs, and assist them in developing new algorithms to advance the field.

Computer Vision and Pattern Recognition

Prediction of air pollutants by using an artificial neural network

An Inclusive Task-Aware Framework for Radiology Report Generation

Primed Self-Construal, Culture, and Stages of impression Formation

Radiology Report Generation via Structured Knowledge-Enhanced Multi-modal Attention and Contrastive Learning.

Multi-modal Fusion with Semantic Supervision for Radiology Report Generation

Medical Report Generation based on Segment-Enhanced Contrastive Representation Learning

A Comparison of Maternal Interview and Medical Record Ascertainment of Violence among Women who had Poor Pregnancy Outcomes

MCL: Multi-view Enhanced Contrastive Learning for Chest X-ray Report Generation

Radiology Report Generation with a Learned Knowledge Base and Multi-Modal Alignment

Topicwise Separable Sentence Retrieval for Medical Report Generation

A Self-Guided Framework for Radiology Report Generation

MKCL: Medical Knowledge with Contrastive Learning model for radiology report generation

Salad, house dressing, but hold the sulfites.

Unifying Relational Sentence Generation and Retrieval for Medical Image Report Composition

On the Automatic Generation of Medical Imaging Reports

Chest radiology report generation based on cross-modal multi-scale feature fusion

Learning to Generate Radiology Findings from Impressions Based on Large Language Model

Graph Enhanced Contrastive Learning for Radiology Findings Summarization

Effectively Fine-tune to Improve Large Multimodal Models for Radiology Report Generation

TRRG: Towards Truthful Radiology Report Generation With Cross-modal Disease Clue Enhanced Large Language Model

A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data