Abstract:Coronavirus disease 2019 (COVID-19), originating in China, has rapidly spread worldwide. Physicians must examine infected patients and make timely decisions to isolate them. However, completing these processes is difficult due to limited time and availability of expert radiologists, as well as limitations of the reverse-transcription polymerase chain reaction (RT-PCR) method. Deep learning, a sophisticated machine learning technique, leverages radiological imaging modalities for disease diagnosis and image classification tasks. Previous research on COVID-19 classification has encountered several limitations, including binary classification methods, single-feature modalities, small public datasets, and reliance on CT diagnostic processes. Additionally, studies have often utilized a flat structure, disregarding the hierarchical structure of pneumonia classification. This study aims to overcome these limitations by identifying pneumonia caused by COVID-19, distinguishing it from other types of pneumonia and healthy lungs using chest X-ray (CXR) images and related tabular medical data, and demonstrate the value of incorporating tabular medical data in achieving more accurate diagnoses. Resnet-based and VGG-based pre-trained convolutional neural network (CNN) models were employed to extract features, which were then combined using early fusion for the classification of eight distinct classes. We leveraged the hierarchal structure of pneumonia classification within our approach to achieve improved classification outcomes. Since an imbalanced dataset is common in this field, a variety of versions of generative adversarial networks (GANs) were used to generate synthetic data. The proposed approach tested in our private datasets of 4523 patients achieved a macro-avg F1-score of 95.9% and an F1-score of 87.5% for COVID-19 identification using a Resnet-based structure. In conclusion, in this study, we were able to create an accurate deep learning multi-modal to diagnose COVID-19 and differentiate it from other kinds of pneumonia and normal lungs, which will enhance the radiological diagnostic process.

A Convolutional Neural Network Based on Transfer Learning for Medical Waste Classification During Pandemic Covid-19

A deep learning approach for medical waste classification

A Transfer Learning Based Approach for Classification of COVID-19 and Pneumonia in CT Scan Imaging

OPTIMASI IMAGE CLASSIFICATION PADA JENIS SAMPAH DENGAN DATA AUGMENTATION DAN CONVOLUTIONAL NEURAL NETWORK

Lightweight Deep Learning Algorithm for Sorting Medical Waste Embedded System

A deep convolutional neural network approach using medical image classification

A CNN-transformer fusion network for COVID-19 CXR image classification

Deep Transfer Learning Based Classification Model for COVID-19 Disease

MIC: Medical Image Classification Using Chest X-ray (COVID-19 and Pneumonia) Dataset with the Help of CNN and Customized CNN

A Two-Stage Federated Transfer Learning Framework in Medical Images Classification on Limited Data: A COVID-19 Case Study

Enhanced framework for COVID-19 prediction with computed tomography scan images using dense convolutional neural network and novel loss function

Efficient and Visualizable Convolutional Neural Networks for COVID-19 Classification Using Chest CT

Improvement of garbage classification using pretrained Convolutional Neural Network

Fused Deep Features Based Classification Framework for COVID-19 Classification with Optimized MLP

COVID-19 classification using chest X-ray images based on fusion-assisted deep Bayesian optimization and Grad-CAM visualization

An augmentation aided concise CNN based architecture for COVID-19 diagnosis in real time

Waste Classification using Convolutional Neural Network

Deep Transfer Learning Based Approaches for Classification of Chest CT Scans: Normal, COVID-19, and Pneumonia

COVID-19 Hierarchical Classification Using a Deep Learning Multi-Modal

An Improved CovidConvLSTM model for pneumonia-COVID-19 detection and classification

COVID-19 Detection using Transfer Learning with Convolutional Neural Network