Abstract:Cancer region detection (CRD) and subtyping are two fundamental tasks in digital pathology image analysis. The development of data-driven models for CRD and subtyping on whole-slide images (WSIs) would mitigate the burden of pathologists and improve their accuracy in diagnosis. However, the existing models are facing two major limitations. Firstly, they typically require large-scale datasets with precise annotations, which contradicts with the original intention of reducing labor effort. Secondly, for the subtyping task, the non-cancerous regions are treated as the same as cancerous regions within a WSI, which confuses a subtyping model in its training process. To tackle the latter limitation, the previous research proposed to perform CRD first for ruling out the non-cancerous region, then train a subtyping model based on the remaining cancerous patches. However, separately training ignores the interaction of these two tasks, also leads to propagating the error of the CRD task to the subtyping task. To address these issues and concurrently improve the performance on both CRD and subtyping tasks, we propose a semi-supervised multi-task learning (MTL) framework for cancer classification. Our framework consists of a backbone feature extractor, two task-specific classifiers, and a weight control mechanism. The backbone feature extractor is shared by two task-specific classifiers, such that the interaction of CRD and subtyping tasks can be captured. The weight control mechanism preserves the sequential relationship of these two tasks and guarantees the error back-propagation from the subtyping task to the CRD task under the MTL framework. We train the overall framework in a semi-supervised setting, where datasets only involve small quantities of annotations produced by our minimal point-based (min-point) annotation strategy. Extensive experiments on four large datasets with different cancer types demonstrate the effectiveness of the proposed framework in both accuracy and generalization.

Task-driven Framework Using Large Models for Digital Pathology

Analysis of Intraoperative Microscopy Imaging Techniques and Their Future Applications

Space and Level Cooperation Framework for Pathological Cancer Grading

A whole-slide foundation model for digital pathology from real-world data

Engineering the future of 3D pathology

Deep Learning-Based Single-Shot Autofocus Method for Digital Microscopy

PathoDuet: Foundation Models for Pathological Slide Analysis of H&E and IHC Stains

Rapid 3D imaging at cellular resolution for digital cytopathology with a multi-camera array scanner (MCAS)

A semi-supervised multi-task learning framework for cancer classification with weak annotation in whole-slide images

Computational Pathology at Health System Scale -- Self-Supervised Foundation Models from Three Billion Images

A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Model

A pathology foundation model for cancer diagnosis and prognosis prediction

Multimodal Whole Slide Foundation Model for Pathology

High‐Throughput, Label‐Free and Slide‐Free Histological Imaging by Computational Microscopy and Unsupervised Learning

High-throughput profiling of tissue and tissue model microarrays: Combined transmitted light and 3-color fluorescence digital pathology

Accurate diagnosis achieved via super-resolution whole slide images by pathologists and artificial intelligence

Scalable analysis of Big pathology image data cohorts using efficient methods and high-performance computing strategies

Artificial Intelligence for Digital and Computational Pathology

Harnessing non-destructive 3D pathology

Deep learning extended depth-of-field microscope for fast and slide-free histology