Abstract:Background: The workflow of prostate cancer diagnosis and grading is cumbersome and the results suffer from substantial inter-observer variability. Recent trials have shown potential in using machine learning to develop automated systems to address this challenge. Most automated deep learning systems for prostate cancer Gleason grading focused on supervised learning requiring demanding fine-grained pixel-level annotations. Methods: A weakly-supervised deep learning model with slide-level labels is presented in this study for the diagnosis and grading of prostate cancer with whole slide image (WSI). WSIs are first cropped into small patches and then processed with a deep learning model to extract patch-level features. A graph convolution network (GCN) is used to aggregate the features for classifications. Throughout the training process, the noisy labels are progressively filtered out to reduce inter-observer variations in clinical reports. Finally, multi-center independent test cohorts with 6,174 slides are collected to evaluate the prostate cancer diagnosis and grading performance of our model. Results: The cancer diagnosis (2-level classification) results on two external test sets ( n = 4,675, n = 844) show an area under the receiver operating characteristic curve (AUC) of 0.985 and 0.986. The Gleason grading (6-level classification) results reach 0.931 quadratic weighted kappa on the internal test set ( n = 531). It generalizes well on the external test dataset ( n = 844) with 0.801 quadratic weighted kappa with the reference standard set independently. The model enables pathological meaningful interpretability by visualizing the most attended lesions which are highly consistent with expert annotations. Conclusion: The proposed model incorporates a graph network in weakly supervised learning with only slide-level reports. A robust learning strategy is also employed to correct the label noise. It is highly accurate ( >0.985 AUC for diagnosis) and also interpretable with intuitive heatmap visualization. It can be unified with a digital pathology pipeline to deliver prostate cancer metrics for a pathology report.

A multi-resolution model for histopathology image classification and localization with multiple instance learning

An attention-based multi-resolution model for prostate whole slide imageclassification and localization

Interpretable Classification of Pathology Whole-Slide Images Using Attention Based Context-Aware Graph Convolutional Neural Network

Automatic diagnosis and grading of Prostate Cancer with weakly supervised learning on whole slide images

Finding Regions of Interest in Whole Slide Images Using Multiple Instance Learning

Multi-resolution Consistency Semi-Supervised Active Learning Framework for Histopathology Image Classification

The Whole Pathological Slide Classification via Weakly Supervised Learning

A multi-center performance assessment for automated histopathological classification and grading of glioma using whole slide images

Multiresolution Self-Supervised Feature Integration via Attention Multiple Instance Learning for Histopathology Analysis

A semi-supervised learning approach with consistency regularization for tumor histopathological images analysis

Predicting cancer outcomes from whole slide images via hybrid supervision learning

Rethinking Attention-Based Multiple Instance Learning for Whole-Slide Pathological Image Classification: An Instance Attribute Viewpoint

Multi-Stage Pathological Image Classification using Semantic Segmentation

Efficient Classification of Histopathology Images

Multi-scale Multi-Instance Contrastive Learning for Whole Slide Image Classification

Dual-Attention Multiple Instance Learning Framework for Pathology Whole-Slide Image Classification

Automatic Whole Slide Pathology Image Diagnosis Framework Via Unit Stochastic Selection and Attention Fusion

Dual Attention Model with Reinforcement Learning for Classification of Histology Whole-Slide Images

Multiple Instance Learning with Mixed Supervision in Gleason Grading

Scalable deep learning artificial intelligence histopathology slide analysis and validation

Classification of Colorectal Cancer Consensus Molecular Subtypes Using Attention-Based Multi-Instance Learning Network on Whole-Slide Images