Abstract:Coronavirus disease 2019 (COVID-19), originating in China, has rapidly spread worldwide. Physicians must examine infected patients and make timely decisions to isolate them. However, completing these processes is difficult due to limited time and availability of expert radiologists, as well as limitations of the reverse-transcription polymerase chain reaction (RT-PCR) method. Deep learning, a sophisticated machine learning technique, leverages radiological imaging modalities for disease diagnosis and image classification tasks. Previous research on COVID-19 classification has encountered several limitations, including binary classification methods, single-feature modalities, small public datasets, and reliance on CT diagnostic processes. Additionally, studies have often utilized a flat structure, disregarding the hierarchical structure of pneumonia classification. This study aims to overcome these limitations by identifying pneumonia caused by COVID-19, distinguishing it from other types of pneumonia and healthy lungs using chest X-ray (CXR) images and related tabular medical data, and demonstrate the value of incorporating tabular medical data in achieving more accurate diagnoses. Resnet-based and VGG-based pre-trained convolutional neural network (CNN) models were employed to extract features, which were then combined using early fusion for the classification of eight distinct classes. We leveraged the hierarchal structure of pneumonia classification within our approach to achieve improved classification outcomes. Since an imbalanced dataset is common in this field, a variety of versions of generative adversarial networks (GANs) were used to generate synthetic data. The proposed approach tested in our private datasets of 4523 patients achieved a macro-avg F1-score of 95.9% and an F1-score of 87.5% for COVID-19 identification using a Resnet-based structure. In conclusion, in this study, we were able to create an accurate deep learning multi-modal to diagnose COVID-19 and differentiate it from other kinds of pneumonia and normal lungs, which will enhance the radiological diagnostic process.

Coronavirus Pneumonia Classification Using X-Ray and CT Scan Images With Deep Convolutional Neural Network Models

Deep Learning-based Multi-Class COVID-19 Classification with X-ray Images

On the Implementation of a Post-Pandemic Deep Learning Algorithm Based on a Hybrid CT-Scan/X-ray Images Classification Applied to Pneumonia Categories

Pneumonia Detection Using Enhanced Convolutional Neural Network Model on Chest X-Ray Images

Detection of Coronavirus (COVID-19) Associated Pneumonia based on Generative Adversarial Networks and a Fine-Tuned Deep Transfer Learning Model using Chest X-ray Dataset

COVID-19 and pneumonia diagnosis from chest X-ray images using convolutional neural networks

Pneumonia image classification using convolutional neural network

Convolutional Neural Network Based Chest X-Ray Image Classification for Pneumonia Diagnosis

Pneumonia Detection on chest X-ray images Using Ensemble of Deep Convolutional Neural Networks

Classification of COVID-19 from Chest X-ray Images Using Deep Convolutional Neural Network

Diagnosing COVID-19 Pneumonia from X-Ray and CT Images using Deep Learning and Transfer Learning Algorithms

Prediction of Pneumonia and COVID-19 Using Deep Neural Networks

An Overview of Deep Learning Techniques on Chest X-Ray and CT Scan Identification of COVID-19

Pneumonia Diagnosis through pixels -- A Deep Learning Model for detection and classification

An Enhanced Technique of COVID-19 Detection and Classification Using Deep Convolutional Neural Network from Chest X-Ray and CT Images

Deep Learning on Chest X-ray Images to Detect and Evaluate Pneumonia Cases at the Era of COVID-19

A Deep Convolutional Neural Network for Pneumonia Detection in X-ray Images with Attention Ensemble

Deep Convolutional Neural Networks to Diagnose COVID-19 and other Pneumonia Diseases from Posteroanterior Chest X-Rays

Diagnosis of COVID-19 Cases from Chest X-ray Images Using Deep Neural Network and LightGBM

Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks

COVID-19 Hierarchical Classification Using a Deep Learning Multi-Modal