Abstract:Background: Whole Slide Image (WSI) analysis, driven by deep learning algorithms, has the potential to revolutionize tumor detection, classification, and treatment response prediction. However, challenges persist, such as limited model generalizability across various cancer types, the labor-intensive nature of patch-level annotation, and the necessity of integrating multi-magnification information to attain a comprehensive understanding of pathological patterns. Methods: In response to these challenges, we introduce MAMILNet, an innovative multi-scale attentional multi-instance learning framework for WSI analysis. The incorporation of attention mechanisms into MAMILNet contributes to its exceptional generalizability across diverse cancer types and prediction tasks. This model considers whole slides as "bags" and individual patches as "instances." By adopting this approach, MAMILNet effectively eliminates the requirement for intricate patch-level labeling, significantly reducing the manual workload for pathologists. To enhance prediction accuracy, the model employs a multi-scale "consultation" strategy, facilitating the aggregation of test outcomes from various magnifications. Results: Our assessment of MAMILNet encompasses 1171 cases encompassing a wide range of cancer types, showcasing its effectiveness in predicting complex tasks. Remarkably, MAMILNet achieved impressive results in distinct domains: for breast cancer tumor detection, the Area Under the Curve (AUC) was 0.8872, with an Accuracy of 0.8760. In the realm of lung cancer typing diagnosis, it achieved an AUC of 0.9551 and an Accuracy of 0.9095. Furthermore, in predicting drug therapy responses for ovarian cancer, MAMILNet achieved an AUC of 0.7358 and an Accuracy of 0.7341. Conclusion: The outcomes of this study underscore the potential of MAMILNet in driving the advancement of precision medicine and individualized treatment planning within the field of oncology. By effectively addressing challenges related to model generalization, annotation workload, and multi-magnification integration, MAMILNet shows promise in enhancing healthcare outcomes for cancer patients. The framework's success in accurately detecting breast tumors, diagnosing lung cancer types, and predicting ovarian cancer therapy responses highlights its significant contribution to the field and paves the way for improved patient care.

MLCN: Metric Learning Constrained Network for Whole Slide Image Classification with Bilinear Gated Attention Mechanism

Clustering-Based Multi-instance Learning Network for Whole Slide Image Classification

Interpretable Classification of Pathology Whole-Slide Images Using Attention Based Context-Aware Graph Convolutional Neural Network

Bayesian Collaborative Learning for Whole-Slide Image Classification

Neighborhood attention transformer multiple instance learning for whole slide image classification

M2LC-Net: A Multi-Modal Multi-Disease Long-Tailed Classification Network for Real Clinical Scenes

MM-DCNet: A Multi-Scale and Multi-MOdality Dynamic Convolutional Network for Lung Cancer Subtypes Classification

The Whole Pathological Slide Classification via Weakly Supervised Learning

Multi-scale representation attention based deep multiple instance learning for gigapixel whole slide image analysis

Multi-scale Multi-Instance Contrastive Learning for Whole Slide Image Classification

Multi-Cohort Framework with Cohort-Aware Attention and Adversarial Mutual-Information Minimization for Whole Slide Image Classification

Cluster-to-Conquer: A Framework for End-to-End Multi-Instance Learning for Whole Slide Image Classification

Rethinking Attention-Based Multiple Instance Learning for Whole-Slide Pathological Image Classification: An Instance Attribute Viewpoint

Dual-Attention Multiple Instance Learning Framework for Pathology Whole-Slide Image Classification

CaMIL: Causal Multiple Instance Learning for Whole Slide Image Classification

Attention Is Not What You Need: Revisiting Multi-Instance Learning for Whole Slide Image Classification

Classification of Colorectal Cancer Consensus Molecular Subtypes Using Attention-Based Multi-Instance Learning Network on Whole-Slide Images

A Regional Multiple Instance Learning Network for Whole Slide Image Segmentation

Whole Slide Images based Cancer Survival Prediction using Attention Guided Deep Multiple Instance Learning Networks

MAMILNet: advancing precision oncology with multi-scale attentional multi-instance learning for whole slide image analysis

Node-aligned Graph Convolutional Network for Whole-slide Image Representation and Classification