Abstract:Ru Wen, 1– 3, &ast Peng Xu, 3, &ast Yimin Cai, 1, &ast Fang Wang, 3 Mengfei Li, 3 Xianchun Zeng, 2 Chen Liu 3 1 Medical College, Guizhou University, Guizhou, 550000, People's Republic of China; 2 Department of Medical Imaging, Guizhou Provincial People Hospital, Guiyang City, Guizhou Province, 550000, People's Republic of China; 3 Department of Radiology, Southwest Hospital, Army Medical University (Third Military Medical University), Chongqing, 400038, People's Republic of China &astThese authors contributed equally to this work Correspondence: Chen Liu, Department of Radiology, Southwest Hospital, Army Medical University (Third Military Medical University), 30 Gao Tan Yan St, Chongqing, 400038, People's Republic of China, Tel +8613108968808, Email Xianchun Zeng, Department of Medical Imaging, Guizhou Provincial People Hospital, No. 83, East Zhongshan Road, Nanming District, Guiyang City, Guizhou Province, 550000, People's Republic of China, Tel +8615286061024, Email Purpose: This study aimed to develop a deep learning model based on chest radiography (CXR) images and clinical data to accurately classify gram-positive and gram-negative bacterial pneumonia in children to guide the use of antibiotics. Methods: We retrospectively collected CXR images along with clinical information for gram-positive (n=447) and gram-negative (n=395) bacterial pneumonia in children from January 1, 2016, to June 30, 2021. Four types of machine learning models based on clinical data and six types of deep learning algorithm models based on image data were constructed, and multi-modal decision fusion was performed. Results: In the machine learning models, CatBoost, which only used clinical data, had the best performance; its area under the receiver operating characteristic curve (AUC) was significantly higher than that of the other models (P< 0.05). The incorporation of clinical information improved the performance of deep learning models that relied solely on image-based classification. Consequently, AUC and F1 increased by 5.6% and 10.2% on average, respectively. The best quality was achieved with ResNet101 (model accuracy: 0.75, recall rate: 0.84, AUC: 0.803, F1: 0.782). Conclusion: Our study established a pediatric bacterial pneumonia model that utilizes CXR and clinical data to accurately classify cases of gram-negative and gram-positive bacterial pneumonia. The results confirmed that the addition of image data to the convolutional neural network model significantly improved its performance. While the CatBoost-based classifier had greater advantages owing to a smaller dataset, the quality of the Resnet101 model trained using multi-modal data was comparable to that of the CatBoost model, even with a limited number of samples. Keywords: pediatrics, antibiotics, clinical data, X-ray, multi-modal data Pneumonia is the most significant cause of death in children in developing countries. 1,2 The most common causes of pneumonia are viral and bacterial pathogens. Based on the Global Burden of Disease data, in 2016, approximately 64% of children under the age of five with pneumonia died of bacterial pneumonia. 3 Several types of bacteria can cause pneumonia, including Streptococcus pneumoniae, Klebsiella pneumoniae, Haemophilus influenzae , and Pseudomonas aeruginosa . 4,5 Rapid and accurate identification of pneumonia pathogens, such as gram-positive and gram-negative bacteria, is essential for antibiotic selection. Appropriate drug treatment and limiting the unreasonable use of antibiotics play an important role in improving the survival or cure rates of bacterial pneumonia. 6 This may improve outcomes and slow the development of antibiotic resistance. Early and accurate identification of bacterial pneumonia pathogens presents a significant challenge for successful treatment. 7 Symptoms of pneumonia caused by gram-positive and gram-negative bacteria usually overlap, and the etiological diagnosis is mainly based on clinical and diagnostic imaging findings. Accurate classification of pneumonia based on imaging tests alone can be challenging, especially when different types of pneumonia have similar imaging features. Chest radiography (CXR) is a standard diagnostic tool for pneumonia; however, the sensitivity and specificity are not high, 8 and the interpretation of chest X-ray characteristics varies among clinicians with different levels of experience and ultimately depends on the expertise of the radiologist or clinical physician. 9 The identification of pneumonia pathogens relies heavily on isolation and c -Abstract Truncated-

Image‐based Deep Learning in Diagnosing the Etiology of Pneumonia on Pediatric Chest X‐rays

Using deep-learning techniques for pulmonary-thoracic segmentations and improvement of pneumonia diagnosis in pediatric chest radiographs.

A Deep Learning Model for the Diagnosis and Discrimination of Gram-Positive and Gram-Negative Bacterial Pneumonia for Children Using Chest Radiography Images and Clinical Information

Image-based deep learning in diagnosing mycoplasma pneumonia on pediatric chest X-rays

Based on improved deep convolutional neural network model pneumonia image classification

Validation of a deep learning model for classification of pediatric pneumonia in Hong Kong

A transfer learning method with deep residual network for pediatric pneumonia diagnosis

CheXED Comparison of a Deep Learning Model to a Clinical Decision Support System for Pneumonia in the Emergency Department

Deep-Learning-Based Diagnosis of Bedside Chest X-ray in Intensive Care and Emergency Medicine

Diagnosis of common pulmonary diseases in children by X-ray images and deep learning

Validating the accuracy of deep learning for the diagnosis of pneumonia on chest x-ray against a robust multimodal reference diagnosis: a post hoc analysis of two prospective studies

Potential of digital chest radiography-based deep learning in screening and diagnosing pneumoconiosis: An observational study

The Use of Chest Radiographs and Machine Learning Model for the Rapid Detection of Pneumonitis in Pediatric

CXR-Net: A Multitask Deep Learning Network for Explainable and Accurate Diagnosis of COVID-19 Pneumonia From Chest X-Ray Images

A machine learning approach on chest X-rays for pediatric pneumonia detection

Deep Neural Network Augments Performance of Junior Residents in Diagnosing COVID-19 Pneumonia on Chest Radiographs

Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists

Hybrid Inception Architecture with Residual Connection: Fine-tuned Inception-ResNet Deep Learning Model for Lung Inflammation Diagnosis from Chest Radiographs

Ensembles of Convolutional Neural Networks models for pediatric pneumonia diagnosis

CXR-Net: An Encoder-Decoder-Encoder Multitask Deep Neural Network for Explainable and Accurate Diagnosis of COVID-19 pneumonia with Chest X-ray Images

A comprehensive segmentation of chest X-ray improves deep learning-based WHO radiologically confirmed pneumonia diagnosis in children