Semantic-Similarity Collaborative Knowledge Distillation Framework for Whole Slide Image Classification

Zehua Ye,Yonghong He,Tian Guan
DOI: https://doi.org/10.1109/bibm58861.2023.10385681
2023-01-01
Abstract:Pathological whole slide images (WSIs) are of great importance for clinical diagnosis, and the classification of WSIs is often regarded as a multiple instance learning (MIL) problem. However, most MIL frameworks only use bag labels to train their models, neglecting the potential information from negative bags, which is a waste of existing labeled information. In this paper, we propose a semantic-similarity collaborative knowledge distillation framework (SSC) for WSI classification, which differs from other methods by leveraging the latent information of the data to the fullest extent and considering both semantic space and similarity space, then transferring this knowledge to a lightweight network through knowledge distillation, achieving end-to-end fast inference. Specifically, our proposed method includes three branches: the teacher, student, and regular branches. The teacher branch explores the similarity space and includes a similarity-based classifier that outputs classification results based on the similarity space mapped from negative bags. The output of the similarity-based classifier is fused with that of the semantic-based classifier and serves as the soft pseudo-label for the student branch. To improve the quality of the labels, we use views under different augmentation modes as inputs for the three branches and encourage weakly augmented features to be as similar as possible to strongly augmented features through consistency regularization. Moreover, the teacher, student, and regular branches share the weights of the classifier and projection head, thus strengthening their knowledge exchange. The proposed method exhibits excellent performance on Camelyon16.
What problem does this paper attempt to address?