Abstract:Background and objectives: Cervical cancer affects around 0.5 million women per year, resulting in over 0.3 million fatalities. Therefore, repetitive screening for cervical cancer is of utmost importance. Computer-assisted diagnosis is key for scaling up cervical cancer screening. Current recognition algorithms, however, perform poorly on the whole-slide image (WSI) analysis, fail to generalize for different staining methods and on uneven distribution for subtype imaging, and provide sub-optimal clinical-level interpretations. Herein, we developed CervixFormer-an end-to-end, multi-scale swin transformer-based adversarial ensemble learning framework to assess pre-cancerous and cancer-specific cervical malignant lesions on WSIs. Methods: The proposed framework consists of (1) a self-attention generative adversarial network (SAGAN) for generating synthetic images during patch-level training to address the class imbalanced problems; (2) a multi-scale transformer-based ensemble learning method for cell identification at various stages, including atypical squamous cells (ASC) and atypical squamous cells of undetermined significance (ASCUS), which have not been demonstrated in previous studies; and (3) a fusion model for concatenating ensemble-based results and producing final outcomes. Results: In the evaluation, the proposed method is first evaluated on a private dataset of 717 annotated samples from six classes, obtaining a high recall and precision of 0.940 and 0.934, respectively, in roughly 1.2 minutes. To further examine the generalizability of CervixFormer, we evaluated it on four independent, publicly available datasets, namely, the CRIC cervix, Mendeley LBC, SIPaKMeD Pap Smear, and Cervix93 Extended Depth of Field image datasets. CervixFormer obtained a fairly better performance on two-, three-, four-, and six-class classification of smear- and cell-level datasets. For clinical interpretation, we used GradCAM to visualize a coarse localization map, highlighting important regions in the WSI. Notably, CervixFormer extracts feature mostly from the cell nucleus and partially from the cytoplasm. Conclusions: In comparison with the existing state-of-the-art benchmark methods, the CervixFormer outperforms them in terms of recall, accuracy, and computing time.

Hierarchical and Robust Pathology Image Reading for High-Throughput Cervical Abnormality Screening.

Hierarchical pathology screening for cervical abnormality

Dual-path network with synergistic grouping loss and evidence driven risk stratification for whole slide cervical image analysis

Robust whole slide image analysis for cervical cancer screening using deep learning

Large-scale cervical precancerous screening via AI-assisted cytology whole slide image analysis

Artificial intelligence-assisted fast screening cervical high grade squamous intraepithelial lesion and squamous cell carcinoma diagnosis and treatment planning

Parallel Classification of Cells in Thinprep Cytology Test Image for Cervical Cancer Screening

Automatic cell nuclei segmentation and classification of cervical Pap smear images

Cell comparative learning: A cervical cytopathology whole slide image classification method using normal and abnormal cells

Quantitative analysis of abnormalities in gynecologic cytopathology with deep learning

An efficient framework based on large foundation model for cervical cytopathology whole slide image screening

A novel automation-assisted cervical cancer reading method based on convolutional neural network

Computer-aided Detection of Squamous Carcinoma of the Cervix in Whole Slide Images

Automatic Whole Slide Pathology Image Diagnosis Framework Via Unit Stochastic Selection and Attention Fusion

A Practical Segmentation Method for Automated Screening of Cervical Cytology

A novel attention-guided convolutional network for the detection of abnormal cervical cells in cervical cancer screening

Computer-Assisted Screening for Cervical Cancer Using Digital Image Processing of Pap Smear Images

Improving the Accuracy and Efficiency of Abnormal Cervical Squamous Cell Detection with Cytologist-in-the-Loop Artificial Intelligence

A systematic review of deep learning-based cervical cytology screening: from cell identification to whole slide image analysis

An Efficient Cervical Whole Slide Image Analysis Framework Based on Multi-scale Semantic and Location Deep Features

CervixFormer: A Multi-scale swin transformer-Based cervical pap-Smear WSI classification framework