CheXMed: a Multimodal Learning Algorithm for Pneumonia Detection in the Elderly

Hao Ren,Fengshi Jing,Zhurong Chen,Shan He,Jiandong Zhou,Le Liu,Ran Jing,Wanmin Lian,Junzhang Tian,Qingpeng Zhang,Zhongzhi Xu,Weibin Cheng
DOI: https://doi.org/10.1016/j.ins.2023.119854
IF: 8.1
2023-11-06
Information Sciences
Abstract:Pneumonia can be a deadly illness for particular populations, one of which is older adults. While studies have successfully trained artificial intelligent assisted diagnostic tools to detect pneumonia using chest X-ray images, they were targeted to the general population without stratification on age groups. This study (a) investigated the performance disparities between geriatric and younger patients when using chest X-ray images to detect pneumonia, and (b) developed and tested a multimodal model called CheXMed that incorporates clinical notes together with image data to improve pneumonia detection performance for older people. Accuracy, precision, recall, and F1-score were used for model performance evaluation. CheXMed outperforms baseline models on all evaluation metrics. The accuracy, precision, recall, and F1-score are 0.746, 0.746, 0.740, 0.743 for CheXMed, 0.645, 0.680, 0.535, 0.599 for CheXNet, 0.623, 0.655, 0.521, 0.580 for DenseNet121, and 0.610, 0.617, 0.543, 0.577 for ResNet18.
computer science, information systems
What problem does this paper attempt to address?