Abstract:Cutaneous melanoma represents one of the most life-threatening malignancies. Histopathological image analysis serves as a vital tool for early melanoma detection. Deep neural network (DNN) models are frequently employed to aid pathologists in enhancing the efficiency and accuracy of diagnoses. However, due to the paucity of well-annotated, high-resolution, whole-slide histopathology image (WSI) datasets, WSIs are typically fragmented into numerous patches during the model training and testing stages. This process disregards the inherent interconnectedness among patches, potentially impeding the models' performance. Additionally, the presence of excess, non-contributing patches extends processing times and introduces substantial computational burdens. To mitigate these issues, we draw inspiration from the clinical decision-making processes of dermatopathologists to propose an innovative, weakly supervised deep reinforcement learning framework, titled Fast medical decision-making in melanoma histopathology images (FastMDP-RL). This framework expedites model inference by reducing the number of irrelevant patches identified within WSIs. FastMDP-RL integrates two DNN-based agents: the search agent (SeAgent) and the decision agent (DeAgent). The SeAgent initiates actions, steered by the image features observed in the current viewing field at various magnifications. Simultaneously, the DeAgent provides labeling probabilities for each patch. We utilize multi-instance learning (MIL) to construct a teacher-guided model (MILTG), serving a dual purpose: rewarding the SeAgent and guiding the DeAgent. Our evaluations were conducted using two melanoma datasets: the publicly accessible TCIA-CM dataset and the proprietary MELSC dataset. Our experimental findings affirm FastMDP-RL's ability to expedite inference and accurately predict WSIs, even in the absence of pixel-level annotations. Moreover, our research investigates the WSI-based interactive environment, encompassing the design of agents, state and reward functions, and feature extractors suitable for melanoma tissue images. This investigation offers valuable insights and references for researchers engaged in related studies. The code is available at: https://github.com/titizheng/FastMDP-RL .

A Deep Reinforcement Learning Framework for Rapid Diagnosis of Whole Slide Pathological Images

Learning how to detect: A deep reinforcement learning method for whole-slide melanoma histopathology images

Interpretable Inference and Classification of Tissue Types in Histological Colorectal Cancer Slides Based on Ensembles Adaptive Boosting Prototype Tree.

RLogist: Fast Observation Strategy on Whole-slide Images with Deep Reinforcement Learning

A Generalized Deep Learning Framework for Whole-Slide Image Segmentation and Analysis

Interpretable Histopathology Image Diagnosis Via Whole Tissue Slide Level Supervision

DeepTree: Pathological Image Classification Through Imitating Tree-Like Strategies of Pathologists

Scalable deep learning artificial intelligence histopathology slide analysis and validation

Robust ROI Detection in Whole Slide Images Guided by Pathologists' Viewing Patterns

Diagnostic Text-guided Representation Learning in Hierarchical Classification for Pathological Whole Slide Image

Clinical-grade computational pathology using weakly supervised deep learning on whole slide images

A Precision Diagnostic Framework of Renal Cell Carcinoma on Whole-Slide Images using Deep Learning.

Spatial-temporal Hierarchical Reinforcement Learning for Interpretable Pathology Image Super-Resolution

Slideflow: Deep Learning for Digital Histopathology with Real-Time Whole-Slide Visualization

Deep Learning in Digital Pathology Analysis

Pathology-knowledge Enhanced Multi-instance Prompt Learning for Few-shot Whole Slide Image Classification

Self-Contrastive Weakly Supervised Learning Framework for Prognostic Prediction Using Whole Slide Images

Pathologist-level interpretable whole-slide cancer diagnosis with deep learning

A Deep Learning Method for Automatic Evaluation of Diagnostic Information from Multi-Stained Histopathological Images

STAR-RL: Spatial-temporal Hierarchical Reinforcement Learning for Interpretable Pathology Image Super-Resolution