Abstract:Serous cavity effusion is a prevalent pathological condition encountered in clinical settings. Fluid samples obtained from these effusions are vital for diagnostic and therapeutic purposes. Traditionally, cytological examination of smears is a common method for diagnosing serous cavity effusion, renowned for its convenience. However, this technique presents limitations that can compromise its efficiency and diagnostic accuracy. This study aims to overcome these challenges and introduce an improved method for the precise detection of malignant cells in serous cavity effusions. We have developed a transformer-based classification framework, specifically employing the vision transformer (ViT) model, to fulfill this objective. Our research involved collecting smear images and corresponding cytological reports from 161 patients who underwent serous cavity drainage. We meticulously annotated 4836 patches from these images, identifying regions with and without malignant cells, thus creating a unique dataset for smear image classification. The findings of our study reveal that deep learning models, particularly the ViT model, exhibit remarkable accuracy in classifying patches as malignant or non-malignant. The ViT model achieved an impressive area under the receiver operating characteristic curve (AUROC) of 0.99, surpassing the performance of the convolutional neural network (CNN) model, which recorded an AUROC of 0.86. Additionally, we validated our models using an external cohort of 127 patients. The ViT model sustained its high-level screening performance, achieving an AUROC of 0.98 at the patient level, compared to the CNN model's AUROC of 0.84. The visualization of our ViT models confirmed their capability to precisely identify regions containing malignant cells in multiple serous cavity effusion smear images. In summary, our study demonstrates the potential of deep learning models, particularly the ViT model, in automating the screening process for serous cavity effusions. These models offer significant assistance to cytologists in enhancing diagnostic accuracy and efficiency. The ViT model stands out for its advanced self-attention mechanism, making it exceptionally suitable for tasks that necessitate detailed analysis of small, sparsely distributed targets like cellular clusters in serous cavity effusions.

Pyramid multi-loss vision transformer for thyroid cancer classification using cytological smear

Pyramid Tokens-to-Token Vision Transformer for Thyroid Pathology Image Classification

MC-ViT: Multi-path cross-scale vision transformer for thymoma histopathology whole slide image typing

Attention Based Multi-Instance Thyroid Cytopathological Diagnosis with Multi-Scale Feature Fusion

SMiT: Symmetric Mask Transformer for Disease Severity Detection.

Machine Learning and Vision Transformers for Thyroid Carcinoma Diagnosis: A review

Exploiting Geometric Features Via Hierarchical Graph Pyramid Transformer for Cancer Diagnosis Using Histopathological Images

Vision Transformers for Computational Histopathology

Hybrid CNN-Transformer model for medical image segmentation with pyramid convolution and multi-layer perceptron

Multiple serous cavity effusion screening based on smear images using vision transformer

Multi-Scale Hybrid Vision Transformer for Learning Gastric Histology: AI-Based Decision Support System for Gastric Cancer Treatment

Asymmetric Vision Transformers for Multi-Label Classification

DCT-HistoTransformer: Efficient Lightweight Vision Transformer with DCT Integration for histopathological image analysis

Identifying Malignant Breast Ultrasound Images Using ViT-Patch

MIL-ViT: A Multiple Instance Vision Transformer for Fundus Image Classification

MG-Trans: Multi-Scale Graph Transformer with Information Bottleneck for Whole Slide Image Classification.

Vision Transformers for Small Histological Datasets Learned through Knowledge Distillation

SI-ViT: Shuffle instance-based Vision Transformer for pancreatic cancer ROSE image classification

Multi-scale Window Transformer for Cervical Cytopathology Image Recognition

MMMViT: Multiscale multimodal vision transformer for brain tumor segmentation with missing modalities

Multi-task Learning of Perceptive Feature for Thyroid Malignant Probability Prediction