Abstract:The contagious SARS-CoV-2 has had a tremendous impact on the life and health of many communities. It was first rampant in early 2019 and so far, 539 million cases of COVID-19 have been reported worldwide. This is reminiscent of the 1918 influenza pandemic. However, we can detect the infected cases of COVID-19 by analysing either X-rays or CT, which are presumably considered the least expensive methods. In the existence of state-of-the-art convolutional neural networks (CNNs), which integrate image pre-processing techniques with fully connected layers, we can develop a sophisticated AI system contingent on various pre-trained models. Each pre-trained model we involved in our study assumed its role in extracting some specific features from different chest image datasets in many verified sources, such as (Mendeley, Kaggle, and GitHub). First, for CXR datasets associated with the CNN trained model from the beginning, whereby is comprised of four layers beginning with the Conv2D layer, which comprises 32 filters, followed by the MaxPooling and afterwards, we reiterated similarly. We used two techniques to avoid overgeneralization, the early stopping and the Dropout techniques. After all, the output was one neuron to classify both cases of 0 or 1, followed by a sigmoid function; in addition, we used the Adam optimizer owing to the more improved outcomes than what other optimizers conducted; ultimately, we referred to our findings by using a confusion matrix, classification report (Recall & Precision), sensitivity and specificity; in this approach, we achieved a classification accuracy of 96%. Our three integrated pre-trained models (VGG16, DenseNet201, and DenseNet121) yielded a remarkable test accuracy of 98.81%. Besides, our merged models (VGG16, DenseNet201) trained on CT images with the utmost effort; this model held an accurate test of 99.73% for binary classification with the (Normal/Covid-19) scenario. Comparing our results with related studies shows that our proposed models were superior to the previous CNN machine learning models in terms of various performance metrics. Our pre-trained model associated with the CT dataset achieved 100% of the F1score and the loss value was approximately 0.00268.

On the differences between CNNs and vision transformers for COVID-19 diagnosis using CT and chest x-ray mono- and multimodality

A Comparative Evaluation between Convolutional Neural Networks and Vision Transformers for COVID-19 Detection

COVID-19 Detection and Diagnosis Model on CT Scans Based on AI Techniques

COVID-VIT: Classification of COVID-19 from CT chest images based on vision transformer models

COVID-19 Pneumonia Classification with Transformer from Incomplete Modalities

COVID-19 CT image recognition algorithm based on transformer and CNN

Study of Vision Transformers for Covid-19 Detection from Chest X-rays

Identification of Asymptomatic COVID-19 Patients on Chest CT Images Using Transformer-Based or Convolutional Neural Network–Based Deep Learning Models

Fine-Tuning Convolutional Neural Networks for COVID-19 Detection from Chest X-ray Images

Enhancing COVID-19 Diagnosis through Vision Transformer-Based Analysis of Chest X-ray Images

Quantitative and Qualitative Analysis of 18 Deep Convolutional Neural Network (CNN) Models with Transfer Learning to Diagnose COVID-19 on Chest X-Ray (CXR) Images

An automated diagnosis and classification of COVID-19 from chest CT images using a transfer learning-based convolutional neural network

Detecting COVID-19 in chest CT images based on several pre-trained models

Deep learning for COVID-19 detection based on CT images

Classification of COVID-19 in CT Scans using Multi-Source Transfer Learning

A Deep Ensemble Learning-Based Automated Detection of COVID-19 Using Lung CT Images and Vision Transformer and ConvNeXt

Comparing the Performance of ResNets on COVID-19 Diagnosis Using CT Scans

Visual Transformer with Statistical Test for COVID-19 Classification

Momentum contrast transformer for COVID-19 diagnosis with knowledge distillation

Development and integration of VGG and dense transfer-learning systems supported with diverse lung images for discovery of the Coronavirus identity

Multi-task contrastive learning for automatic CT and X-ray diagnosis of COVID-19