Abstract:Background: Whole Slide Image (WSI) analysis, driven by deep learning algorithms, has the potential to revolutionize tumor detection, classification, and treatment response prediction. However, challenges persist, such as limited model generalizability across various cancer types, the labor-intensive nature of patch-level annotation, and the necessity of integrating multi-magnification information to attain a comprehensive understanding of pathological patterns. Methods: In response to these challenges, we introduce MAMILNet, an innovative multi-scale attentional multi-instance learning framework for WSI analysis. The incorporation of attention mechanisms into MAMILNet contributes to its exceptional generalizability across diverse cancer types and prediction tasks. This model considers whole slides as "bags" and individual patches as "instances." By adopting this approach, MAMILNet effectively eliminates the requirement for intricate patch-level labeling, significantly reducing the manual workload for pathologists. To enhance prediction accuracy, the model employs a multi-scale "consultation" strategy, facilitating the aggregation of test outcomes from various magnifications. Results: Our assessment of MAMILNet encompasses 1171 cases encompassing a wide range of cancer types, showcasing its effectiveness in predicting complex tasks. Remarkably, MAMILNet achieved impressive results in distinct domains: for breast cancer tumor detection, the Area Under the Curve (AUC) was 0.8872, with an Accuracy of 0.8760. In the realm of lung cancer typing diagnosis, it achieved an AUC of 0.9551 and an Accuracy of 0.9095. Furthermore, in predicting drug therapy responses for ovarian cancer, MAMILNet achieved an AUC of 0.7358 and an Accuracy of 0.7341. Conclusion: The outcomes of this study underscore the potential of MAMILNet in driving the advancement of precision medicine and individualized treatment planning within the field of oncology. By effectively addressing challenges related to model generalization, annotation workload, and multi-magnification integration, MAMILNet shows promise in enhancing healthcare outcomes for cancer patients. The framework's success in accurately detecting breast tumors, diagnosing lung cancer types, and predicting ovarian cancer therapy responses highlights its significant contribution to the field and paves the way for improved patient care.

[A novel attention fusion network-based multiple instance learning framework to automate diagnosis of chronic gastritis with multiple indicators].

Advancing Automatic Gastritis Diagnosis: an Interpretable Multilabel Deep Learning Framework for the Simultaneous Assessment of Multiple Indicators

A Novel Endoscopic Artificial Intelligence System to Assist in the Diagnosis of Autoimmune Gastritis: a Multicenter Study

A Deep Learning Network Based on Multi-Scale and Attention for the Diagnosis of Chronic Atrophic Gastritis

A Computer-Assisted Diagnosis System for the Detection of Chronic Gastritis in Endoscopic Images Using A Novel Convolution and Relative Self-Attention Parallel Network

Automatic Classification of Gastric Lesions in Gastroscopic Images Using a Lightweight Deep Learning Model with Attention Mechanism and Cost-Sensitive Learning

Leveraging Multimodal Semantic Fusion for Gastric Cancer Screening via Hierarchical Attention Mechanism

Broad learning system stacking with multi-scale attention for the diagnosis of gastric intestinal metaplasia

High Accuracy of Convolutional Neural Network for Evaluation of Helicobacter Pylori Infection Based on Endoscopic Images: Preliminary Experience

Tu1075 DEEP CONVOLUTIONAL NEURAL NETWORKS FOR RECOGNITION OF ATROPHIC GASTRITIS AND INTESTINAL METAPLASIA BASED ON ENDOSCOPY IMAGES

Multi-scale Multi-instance Multi-feature Joint Learning Broad Network (M3JLBN) for Gastric Intestinal Metaplasia Subtype Classification

Cross-scale Attention Guided Multi-instance Learning for Crohn's Disease Diagnosis with Pathological Images

Diagnosing chronic atrophic gastritis by gastroscopy using artificial intelligence

A Multi-Feature Fusion Method for Image Recognition of Gastrointestinal Metaplasia (GIM).

Identification of Upper Gastrointestinal Diseases during Screening Gastroscopy through Deep Convolutional Neural Network Algorithm

MAMILNet: advancing precision oncology with multi-scale attentional multi-instance learning for whole slide image analysis

Distilling High Diagnostic Value Patches for Whole Slide Image Classification Using Attention Mechanism

Histopathological Diagnosis System for Gastritis Using Deep Learning Algorithm.

GCLDNet: Gastric Cancer Lesion Detection Network Combining Level Feature Aggregation and Attention Feature Fusion

A Gastric Cancer Recognition Algorithm on Gastric Pathological Sections Based on Multistage Attention‐densenet

Identifying early gastric cancer under magnifying narrow-band images with deep learning: a multicenter study