Abstract:Background and objective: Cervical cancer poses a major health threat to women globally. Optical coherence tomography (OCT) imaging has recently shown promise for non-invasive cervical lesion diagnosis. However, obtaining high-quality labeled cervical OCT images is challenging and time-consuming as they must correspond precisely with pathological results. The scarcity of such high-quality labeled data hinders the application of supervised deep-learning models in practical clinical settings. This study addresses the above challenge by proposing CMSwin, a novel self-supervised learning (SSL) framework combining masked image modeling (MIM) with contrastive learning based on the Swin-Transformer architecture to utilize abundant unlabeled cervical OCT images. Methods: In this contrastive-MIM framework, mixed image encoding is combined with a latent contextual regressor to solve the inconsistency problem between pre-training and fine-tuning and separate the encoder's feature extraction task from the decoder's reconstruction task, allowing the encoder to extract better image representations. Besides, contrastive losses at the patch and image levels are elaborately designed to leverage massive unlabeled data. Results: We validated the superiority of CMSwin over the state-of-the-art SSL approaches with five-fold cross-validation on an OCT image dataset containing 1,452 patients from a multi-center clinical study in China, plus two external validation sets from top-ranked Chinese hospitals: the Huaxi dataset from the West China Hospital of Sichuan University and the Xiangya dataset from the Xiangya Second Hospital of Central South University. A human-machine comparison experiment on the Huaxi and Xiangya datasets for volume-level binary classification also indicates that CMSwin can match or exceed the average level of four skilled medical experts, especially in identifying high-risk cervical lesions. Conclusion: Our work has great potential to assist gynecologists in intelligently interpreting cervical OCT images in clinical settings. Additionally, the integrated GradCAM module of CMSwin enables cervical lesion visualization and interpretation, providing good interpretability for gynecologists to diagnose cervical diseases efficiently.

Beyond Labels: A Self-Supervised Framework with Masked Autoencoders and Random Cropping for Breast Cancer Subtype Classification

Multi-modal Pathological Pre-training Via Masked Autoencoders for Breast Cancer Diagnosis

Multi-modal Masked Autoencoders Learn Compositional Histopathological Representations

Ensemble Deep Learning-Based Image Classification for Breast Cancer Subtype and Invasiveness Diagnosis from Whole Slide Image Histopathology

3D Masked Autoencoders with Application to Anomaly Detection in Non-Contrast Enhanced Breast MRI

Enhancing AI Diagnostics: Autonomous Lesion Masking via Semi-Supervised Deep Learning

Position-Aware Masked Autoencoder for Histopathology WSI Representation Learning

MaskMitosis: a Deep Learning Framework for Fully Supervised, Weakly Supervised, and Unsupervised Mitosis Detection in Histopathology Images

Discriminative Pattern Mining for Breast Cancer Histopathology Image Classification via Fully Convolutional Autoencoder

HC-MAE: Hierarchical Cross-attention Masked Autoencoder Integrating Histopathological Images and Multi-omics for Cancer Survival Prediction.

Masked Image Modelling for retinal OCT understanding

D-MASTER: Mask Annealed Transformer for Unsupervised Domain Adaptation in Breast Cancer Detection from Mammograms

Masked Autoencoders for Unsupervised Anomaly Detection in Medical Images

Tissue-Contrastive Semi-Masked Autoencoders for Segmentation Pretraining on Chest CT

Self-distillation Augmented Masked Autoencoders for Histopathological Image Understanding

Artificial intelligence for histological subtype classification of breast cancer: combining multi-scale feature maps and the recurrent attention model

Enhancing the Breast Histopathology Image Analysis for Cancer Detection Using Variational Autoencoder

Medical supervised masked autoencoders: Crafting a better masking strategy and efficient fine-tuning schedule for medical image classification

Pan-cancer Histopathology WSI Pre-training with Position-aware Masked Autoencoder

Cervical OCT image classification using contrastive masked autoencoders with Swin Transformer

Adaptive Channel and Multiscale Spatial Context Network for Breast Mass Segmentation in Full-Field Mammograms