Abstract:Introduction: Early diagnosis of cervical cancer at the precancerous stage is critical for effective treatment and improved patient outcomes. Objective: This study aims to explore the use of SWIN Transformer and Convolutional Neural Network (CNN) hybrid models combined with transfer learning to classify precancerous colposcopy images. Methods: Out of 913 images from 200 cases obtained from the Colposcopy Image Bank of the International Agency for Research on Cancer, 898 met quality standards and were classified as normal, precancerous, or cancerous based on colposcopy and histopathological findings. The cases corresponding to the 360 precancerous images, along with an equal number of normal cases, were divided into a 70/30 train–test split. The SWIN Transformer and CNN hybrid model combines the advantages of local feature extraction by CNNs with the global context modeling by SWIN Transformers, resulting in superior classification performance and a more automated process. The hybrid model approach involves enhancing image quality through preprocessing, extracting local features with CNNs, capturing the global context with the SWIN Transformer, integrating these features for classification, and refining the training process by tuning hyperparameters. Results: The trained model achieved the following classification performances on fivefold cross-validation data: a 94% Area Under the Curve (AUC), an 88% F1 score, and 87% accuracy. On two completely independent test sets, which were never seen by the model during training, the model achieved an 80% AUC, a 75% F1 score, and 75% accuracy on the first test set (precancerous vs. normal) and an 82% AUC, a 78% F1 score, and 75% accuracy on the second test set (cancer vs. normal). Conclusion: These high-performance metrics demonstrate the models' effectiveness in distinguishing precancerous from normal colposcopy images, even with modest datasets, limited data augmentation, and the smaller effect size of precancerous images compared to malignant lesions. The findings suggest that these techniques can significantly aid in the early detection of cervical cancer at the precancerous stage.

SwinCNN: An Integrated Swin Transformer and CNN for Improved Breast Cancer Grade Classification

Multi-Level Swin Transformer Enabled Automatic Segmentation and Classification of Breast Metastases

Early Cervical Cancer Diagnosis with SWIN-Transformer and Convolutional Neural Networks

MV-Swin-T: Mammogram Classification with Multi-view Swin Transformer

Swin-Net: A Swin-Transformer-Based Network Combing with Multi-Scale Features for Segmentation of Breast Tumor Ultrasound Images

BTS-ST: Swin transformer network for segmentation and classification of multimodality breast cancer images

Breast Ultrasound Tumor Classification Using a Hybrid Multitask CNN-Transformer Network

Addressing Challenges in Skin Cancer Diagnosis: A Convolutional Swin Transformer Approach

Advancing brain tumor detection: harnessing the Swin Transformer’s power for accurate classification and performance analysis

BCCHI-HCNN: Breast Cancer Classification from Histopathological Images Using Hybrid Deep CNN Models

Enhancing Skin Cancer Diagnosis Using Swin Transformer with Hybrid Shifted Window-Based Multi-head Self-attention and SwiGLU-Based MLP

A novel deep learning framework based swin transformer for dermal cancer cell classification

Classification of Endoscopy and Video Capsule Images using CNN-Transformer Model

A novel Swin transformer approach utilizing residual multi-layer perceptron for diagnosing brain tumors in MRI images

Detection and Classification of Lung Cancer Cells Using Swin Transformer

SwinHR: Hemodynamic-powered hierarchical vision transformer for breast tumor segmentation

CSwin-PNet: A CNN-Swin Transformer combined pyramid network for breast lesion segmentation in ultrasound images

Swin-GA-RF: genetic algorithm-based Swin Transformer and random forest for enhancing cervical cancer classification

BiCFormer: Swin Transformer based model for classification of benign and malignant pulmonary nodules

Automated Grading of Breast Cancer Histopathology Using Cascaded Ensemble with Combination of Multi-Level Image Features

Comparative Analysis and Ensemble Enhancement of Leading CNN Architectures for Breast Cancer Classification