Abstract:Background and objectives: Cervical cancer affects around 0.5 million women per year, resulting in over 0.3 million fatalities. Therefore, repetitive screening for cervical cancer is of utmost importance. Computer-assisted diagnosis is key for scaling up cervical cancer screening. Current recognition algorithms, however, perform poorly on the whole-slide image (WSI) analysis, fail to generalize for different staining methods and on uneven distribution for subtype imaging, and provide sub-optimal clinical-level interpretations. Herein, we developed CervixFormer-an end-to-end, multi-scale swin transformer-based adversarial ensemble learning framework to assess pre-cancerous and cancer-specific cervical malignant lesions on WSIs. Methods: The proposed framework consists of (1) a self-attention generative adversarial network (SAGAN) for generating synthetic images during patch-level training to address the class imbalanced problems; (2) a multi-scale transformer-based ensemble learning method for cell identification at various stages, including atypical squamous cells (ASC) and atypical squamous cells of undetermined significance (ASCUS), which have not been demonstrated in previous studies; and (3) a fusion model for concatenating ensemble-based results and producing final outcomes. Results: In the evaluation, the proposed method is first evaluated on a private dataset of 717 annotated samples from six classes, obtaining a high recall and precision of 0.940 and 0.934, respectively, in roughly 1.2 minutes. To further examine the generalizability of CervixFormer, we evaluated it on four independent, publicly available datasets, namely, the CRIC cervix, Mendeley LBC, SIPaKMeD Pap Smear, and Cervix93 Extended Depth of Field image datasets. CervixFormer obtained a fairly better performance on two-, three-, four-, and six-class classification of smear- and cell-level datasets. For clinical interpretation, we used GradCAM to visualize a coarse localization map, highlighting important regions in the WSI. Notably, CervixFormer extracts feature mostly from the cell nucleus and partially from the cytoplasm. Conclusions: In comparison with the existing state-of-the-art benchmark methods, the CervixFormer outperforms them in terms of recall, accuracy, and computing time.

Cell comparative learning: A cervical cytopathology whole slide image classification method using normal and abnormal cells

Artificial Classification of Cervical Squamous Lesions in ThinPrep Cytologic Tests Using a Deep Convolutional Neural Network.

Whole Slide Cervical Cancer Classification Via Graph Attention Networks and Contrastive Learning

Robust whole slide image analysis for cervical cancer screening using deep learning

Dual-path network with synergistic grouping loss and evidence driven risk stratification for whole slide cervical image analysis

Parallel Classification of Cells in Thinprep Cytology Test Image for Cervical Cancer Screening

Hierarchical and Robust Pathology Image Reading for High-Throughput Cervical Abnormality Screening.

Computer-aided Detection of Squamous Carcinoma of the Cervix in Whole Slide Images

Classifying Cervical Histopathological Whole Slide Images Via Deep Multi-Instance Transfer Learning

Large-scale cervical precancerous screening via AI-assisted cytology whole slide image analysis

CervixFormer: A Multi-scale swin transformer-Based cervical pap-Smear WSI classification framework

Quantitative analysis of abnormalities in gynecologic cytopathology with deep learning

Cervical Cytology Classification with Coarse Labels Based on Two-Stage Weakly Supervised Contrastive Learning Framework.

Cervical Cell Classification with Deep-Learning Algorithms

Coupling Self-Supervised and Supervised Contrastive Learning for Multiple Classification of Cervical Cytological Whole Slide Images

An efficient framework based on large foundation model for cervical cytopathology whole slide image screening

Whole Slide Image Multi-Classification of Cervical Epithelial Lesions Based on Unsupervised Pre-training

An Efficient Cervical Whole Slide Image Analysis Framework Based on Multi-scale Semantic and Location Deep Features

Whole Slide Cervical Cancer Screening Using Graph Attention Network and Supervised Contrastive Learning

Holistic and Historical Instance Comparison for Cervical Cell Detection

A Deep Neural Network for Cervical Cell Classification Based on Cytology Images