Abstract:Objectives Accurate histological typing plays an important role in diagnosing thymoma or thymic carcinoma (TC) and predicting the corresponding prognosis. In this paper, we develop and validate a deep learning-based thymoma typing method for hematoxylin & eosin (H&E)-stained whole slide images (WSIs), which provides useful histopathology information from patients to assist doctors for better diagnosing thymoma or TC. Methods We propose a multi-path cross-scale vision transformer (MC-ViT), which first uses the cross attentive scale-aware transformer (CAST) to classify the pathological information related to thymoma, and then uses such pathological information priors to assist the WSIs transformer (WT) for thymoma typing. To make full use of the multi-scale (10×, 20×, and 40×) information inherent in a WSI, CAST not only employs parallel multi-path to capture different receptive field features from multi-scale WSI inputs, but also introduces the cross-correlation attention module (CAM) to aggregate multi-scale features to achieve cross-scale spatial information complementarity. After that, WT can effectively convert full-scale WSIs into 1D feature matrices with pathological information labels to improve the efficiency and accuracy of thymoma typing. Results We construct a large-scale thymoma histopathology WSI (THW) dataset and annotate corresponding pathological information and thymoma typing labels. The proposed MC-ViT achieves the Top-1 accuracy of 0.939 and 0.951 in pathological information classification and thymoma typing, respectively. Moreover, the quantitative and statistical experiments on the THW dataset also demonstrate that our pipeline performs favorably against the existing classical convolutional neural networks, vision transformers, and deep learning-based medical image classification methods. Conclusion This paper demonstrates that comprehensively utilizing the pathological information contained in multi-scale WSIs is feasible for thymoma typing and achieves clinically acceptable performance. Specifically, the proposed MC-ViT can well predict pathological information classes as well as thymoma types, which show the application potential to the diagnosis of thymoma and TC and may assist doctors in improving diagnosis efficiency and accuracy.

Unveiling Thymoma Typing Through Hyperspectral Imaging and Deep Learning

Thyroid carcinoma detection on whole histologic slides using hyperspectral imaging and deep learning

Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification

Identification and risk classification of thymic epithelial tumors using 3D computed tomography images and deep learning models

Combining hyperspectral imaging techniques with deep learning to aid in early pathological diagnosis of melanoma

Application of machine learning for the differentiation of thymomas and thymic cysts using deep transfer learning: A multi-center comparison of diagnostic performance based on different dimensional models

Predicting the risk category of thymoma with machine learning-based computed tomography radiomics signatures and their between-imaging phase differences

Detection and margin assessment of thyroid carcinoma with microscopic hyperspectral imaging using transformer networks

Classification of Benign–Malignant Thyroid Nodules Based on Hyperspectral Technology

Segmentation of Thyroid Nodules Based on Hyperspectral Images

Lymphocyte Classification in Hyperspectral Images of Ovarian Cancer Tissue Biopsy Samples

Development and Validation of Multi-Omics Thymoma Risk Classification Model Based on Transfer Learning

Tumor Tissue Classification Based on Micro-Hyperspectral Technology and Deep Learning.

Application of machine learning for the differentiation of thymomas and thymic cysts using deep transfer learning: A multi‐center comparison of diagnostic performance based on different dimensional models

A Hybrid Network Integrating Convolution and Transformer for Thymoma Segmentation

MC-ViT: Multi-path cross-scale vision transformer for thymoma histopathology whole slide image typing

Histological Classification and Invasion Prediction of Thymoma by Machine Learning-Based Computed Tomography Imaging

Tumor cell identification and classification in esophageal adenocarcinoma specimens by hyperspectral imaging

Combined clinical and specific positron emission tomography/computed tomography-based radiomic features and machine-learning model in prediction of thymoma risk groups

Adaptive Deep Learning for Head and Neck Cancer Detection Using Hyperspectral Imaging

Hyperspectral Imaging: a New Method for Diagnosing Benign and Malignant Lung Cancer