Abstract:Background and objectives: Cervical cancer affects around 0.5 million women per year, resulting in over 0.3 million fatalities. Therefore, repetitive screening for cervical cancer is of utmost importance. Computer-assisted diagnosis is key for scaling up cervical cancer screening. Current recognition algorithms, however, perform poorly on the whole-slide image (WSI) analysis, fail to generalize for different staining methods and on uneven distribution for subtype imaging, and provide sub-optimal clinical-level interpretations. Herein, we developed CervixFormer-an end-to-end, multi-scale swin transformer-based adversarial ensemble learning framework to assess pre-cancerous and cancer-specific cervical malignant lesions on WSIs. Methods: The proposed framework consists of (1) a self-attention generative adversarial network (SAGAN) for generating synthetic images during patch-level training to address the class imbalanced problems; (2) a multi-scale transformer-based ensemble learning method for cell identification at various stages, including atypical squamous cells (ASC) and atypical squamous cells of undetermined significance (ASCUS), which have not been demonstrated in previous studies; and (3) a fusion model for concatenating ensemble-based results and producing final outcomes. Results: In the evaluation, the proposed method is first evaluated on a private dataset of 717 annotated samples from six classes, obtaining a high recall and precision of 0.940 and 0.934, respectively, in roughly 1.2 minutes. To further examine the generalizability of CervixFormer, we evaluated it on four independent, publicly available datasets, namely, the CRIC cervix, Mendeley LBC, SIPaKMeD Pap Smear, and Cervix93 Extended Depth of Field image datasets. CervixFormer obtained a fairly better performance on two-, three-, four-, and six-class classification of smear- and cell-level datasets. For clinical interpretation, we used GradCAM to visualize a coarse localization map, highlighting important regions in the WSI. Notably, CervixFormer extracts feature mostly from the cell nucleus and partially from the cytoplasm. Conclusions: In comparison with the existing state-of-the-art benchmark methods, the CervixFormer outperforms them in terms of recall, accuracy, and computing time.

Overlapping Cytoplasms Segmentation Via Constrained Multi-Shape Evolution for Cervical Cancer Screening

Constrained Multi-shape Evolution for Overlapping Cytoplasm Segmentation

Segmentation of Overlapping Cytoplasm in Cervical Smear Images Via Adaptive Shape Priors Extracted from Contour Fragments

Shape Mask Generator: Learning to Refine Shape Priors for Segmenting Overlapping Cervical Cytoplasms.

JOint Shape Matching for Overlapping Cytoplasm Segmentation in Cervical Smear Images

Segmenting Overlapping Cervical Cell In Pap Smear Images

Automated Segmentation of Overlapping Cytoplasm in Cervical Smear Images Via Contour Fragments

Segmentation of Overlapped Cervical Cells Using Asymmetric Mixture Model and Shape Constraint Level Set Method

Robust Segmentation Of Overlapping Cells In Cervical Cytology Using Light Convolution Neural Network

Segmentation of Overlapping Cells in Cervical Smears Based on Spatial Relationship and Overlapping Translucency Light Transmission Model

An Unsupervised Approach for Overlapping Cervical Cell Cytoplasm Segmentation

A Practical Segmentation Method for Automated Screening of Cervical Cytology

Automated Segmentation Of Cervical Nuclei In Pap Smear Images Using Deformable Multi-Path Ensemble Model

Nucleus Segmentation of Cervical Cytology Images Based on Depth Information

Segmentation of Overlapping Cells in Cervical Cytology Images: A Survey

Multi-layer Segmentation Framework for Cell Nuclei Using Improved GVF Snake Model, Watershed, and Ellipse Fitting.

Accurate Segmentation of Cervical Cytoplasm and Nuclei Based on Multi-scale Convolutional Network and Graph Partitioning.

Accurate segmentation of overlapping cells in cervical cytology with deep convolutional neural networks

A Novel Shape Prior Based Segmentation of Touching or Overlapping Ellipse-Like Nuclei

CervixFormer: A Multi-scale swin transformer-Based cervical pap-Smear WSI classification framework

Nucleus segmentation of cervical cytology images based on multi-scale fuzzy clustering algorithm