Abstract:The global health crisis due to the fast spread of coronavirus disease (Covid-19) has caused great danger to all aspects of healthcare, economy, and other aspects. The highly infectious and insidious nature of the new coronavirus greatly increases the difficulty of outbreak prevention and control. The early and rapid detection of Covid-19 is an effective way to reduce the spread of Covid-19. However, detecting Covid-19 accurately and quickly in large populations remains to be a major challenge worldwide. In this study, A CNN-transformer fusion framework is proposed for the automatic classification of pneumonia on chest X-ray. This framework includes two parts: data processing and image classification. The data processing stage is to eliminate the differences between data from different medical institutions so that they have the same storage format; in the image classification stage, we use a multi-branch network with a custom convolution module and a transformer module, including feature extraction, feature focus, and feature classification sub-networks. Feature extraction subnetworks extract the shallow features of the image and interact with the information through the convolution and transformer modules. Both the local and global features are extracted by the convolution module and transformer module of feature-focus subnetworks, and are classified by the feature classification subnetworks. The proposed network could decide whether or not a patient has pneumonia, and differentiate between Covid-19 and bacterial pneumonia. This network was implemented on the collected benchmark datasets and the result shows that accuracy, precision, recall, and F1 score are 97.09%, 97.16%, 96.93%, and 97.04%, respectively. Our network was compared with other researchers’ proposed methods and achieved better results in terms of accuracy, precision, and F1 score, proving that it is superior for Covid-19 detection. With further improvements to this network, we hope that it will provide doctors with an effective tool for diagnosing Covid-19.

Secured COVID-19 CT image classification based on human-centric IoT and vision transformer

COVID-VIT: Classification of Covid-19 from 3D CT Chest Images Based on Vision Transformer Model

COVID-VIT: Classification of COVID-19 from CT chest images based on vision transformer models

MMViT-Seg: A Lightweight Transformer and CNN Fusion Network for COVID-19 Segmentation.

A COVID-19 medical image classification algorithm based on Transformer

A Deep Ensemble Learning-Based Automated Detection of COVID-19 Using Lung CT Images and Vision Transformer and ConvNeXt

COVID-19 CT image recognition algorithm based on transformer and CNN

CECT: Controllable ensemble CNN and transformer for COVID-19 image classification

COVID-19 Pneumonia Classification with Transformer from Incomplete Modalities

HCTNet: A Hybrid ConvNet-Transformer Network for Retinal Optical Coherence Tomography Image Classification

FCF: Feature Complement Fusion Network for Detecting COVID-19 Through CT Scan Images.

Convolutional Neural Network–Vision Transformer Architecture with Gated Control Mechanism and Multi-Scale Fusion for Enhanced Pulmonary Disease Classification

A Novel Classification Model Using Optimal Long Short-Term Memory for Classification of COVID-19 from CT Images

Visual Transformer with Statistical Test for COVID-19 Classification

A CNN-transformer fusion network for COVID-19 CXR image classification

Classification of COVID-19 in CT Scans using Multi-Source Transfer Learning

Explainable Conformer Network for Detection of COVID-19 Pneumonia from Chest CT Scan: From Concepts toward Clinical Explainability

COVIDNet-CT: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest CT Images

KDViT: COVID-19 diagnosis on CT-scans with knowledge distillation of vision transformer

Research on the Practical Classification and Privacy Protection of CT Images of Parotid Tumors Based on ResNet50 Model