A deep-learning-based framework for identifying and localizing multiple abnormalities and assessing cardiomegaly in chest X-ray

Weijie Fan,Yi Yang,Jing Qi,Qichuan Zhang,Cuiwei Liao,Li Wen,Shuang Wang,Guangxian Wang,Yu Xia,Qihua Wu,Xiaotao Fan,Xingcai Chen,Mi He,JingJing Xiao,Liu Yang,Yun Liu,Jia Chen,Bing Wang,Lei Zhang,Liuqing Yang,Hui Gan,Shushu Zhang,Guofang Liu,Xiaodong Ge,Yuanqing Cai,Gang Zhao,Xi Zhang,Mingxun Xie,Huilin Xu,Yi Zhang,Jiao Chen,Jun Li,Shuang Han,Ke Mu,Shilin Xiao,Tingwei Xiong,Yongjian Nian,Dong Zhang
DOI: https://doi.org/10.1038/s41467-024-45599-z
IF: 16.6
2024-02-14
Nature Communications
Abstract:Abstract Accurate identification and localization of multiple abnormalities are crucial steps in the interpretation of chest X-rays (CXRs); however, the lack of a large CXR dataset with bounding boxes severely constrains accurate localization research based on deep learning. We created a large CXR dataset named CXR-AL14, containing 165,988 CXRs and 253,844 bounding boxes. On the basis of this dataset, a deep-learning-based framework was developed to identify and localize 14 common abnormalities and calculate the cardiothoracic ratio (CTR) simultaneously. The mean average precision values obtained by the model for 14 abnormalities reached 0.572-0.631 with an intersection-over-union threshold of 0.5, and the intraclass correlation coefficient of the CTR algorithm exceeded 0.95 on the held-out, multicentre and prospective test datasets. This framework shows an excellent performance, good generalization ability and strong clinical applicability, which is superior to senior radiologists and suitable for routine clinical settings.
multidisciplinary sciences
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to improve the ability to accurately identify and localize multiple abnormalities in chest X - rays (CXR). Specifically: 1. **Create a large - scale dataset**: Researchers created a large - scale dataset named CXR - AL14, which contains 165,988 chest X - rays and 253,844 bounding boxes. These bounding boxes label 14 common chest abnormalities. This is currently the chest X - ray dataset in the world with the most real - world bounding boxes. 2. **Develop a deep - learning framework**: Based on the CXR - AL14 dataset, researchers developed a deep - learning framework that can simultaneously identify and localize 14 chest abnormalities and calculate the cardiothoracic ratio (CTR) for evaluating the degree of cardiac enlargement. 3. **Improve diagnostic efficiency**: The performance of this framework on multiple test datasets is better than that of senior radiologists, showing excellent performance, good generalization ability and strong clinical applicability, which helps to reduce the workload of radiologists and improve diagnostic efficiency. ### Main contributions - **Dataset**: The creation of the CXR - AL14 dataset provides a large amount of data support with real - world bounding boxes for the application of deep learning in chest X - rays. - **Model performance**: The developed deep - learning framework performs well in identifying and localizing 14 chest abnormalities. The mean average precision (mAP) reaches 0.572 - 0.631 (IoU threshold is 0.5), and the intra - class correlation coefficient (ICC) of the CTR algorithm exceeds 0.95. - **Clinical application**: This framework shows good generalization performance and clinical applicability in multi - center and prospective validations, and is suitable for routine clinical use. ### Problems solved - **Lack of large - scale datasets with bounding boxes**: Most of the existing public chest X - ray datasets only have class labels and lack accurate localization information, which limits the performance of deep - learning models. - **Improve diagnostic accuracy**: By automatically identifying and localizing multiple abnormalities, the rates of missed diagnosis and misdiagnosis are reduced, and the diagnostic efficiency of radiologists is improved. - **Calculate the cardiothoracic ratio**: A fast and accurate CTR calculation method is provided to assist in evaluating the degree of cardiac enlargement. In conclusion, this research significantly improves the ability to identify and localize multiple abnormalities in chest X - rays by creating a large - scale chest X - ray dataset with bounding boxes and developing an efficient deep - learning framework, and has important clinical application value.