Abstract:Cutaneous melanoma represents one of the most life-threatening malignancies. Histopathological image analysis serves as a vital tool for early melanoma detection. Deep neural network (DNN) models are frequently employed to aid pathologists in enhancing the efficiency and accuracy of diagnoses. However, due to the paucity of well-annotated, high-resolution, whole-slide histopathology image (WSI) datasets, WSIs are typically fragmented into numerous patches during the model training and testing stages. This process disregards the inherent interconnectedness among patches, potentially impeding the models' performance. Additionally, the presence of excess, non-contributing patches extends processing times and introduces substantial computational burdens. To mitigate these issues, we draw inspiration from the clinical decision-making processes of dermatopathologists to propose an innovative, weakly supervised deep reinforcement learning framework, titled Fast medical decision-making in melanoma histopathology images (FastMDP-RL). This framework expedites model inference by reducing the number of irrelevant patches identified within WSIs. FastMDP-RL integrates two DNN-based agents: the search agent (SeAgent) and the decision agent (DeAgent). The SeAgent initiates actions, steered by the image features observed in the current viewing field at various magnifications. Simultaneously, the DeAgent provides labeling probabilities for each patch. We utilize multi-instance learning (MIL) to construct a teacher-guided model (MILTG), serving a dual purpose: rewarding the SeAgent and guiding the DeAgent. Our evaluations were conducted using two melanoma datasets: the publicly accessible TCIA-CM dataset and the proprietary MELSC dataset. Our experimental findings affirm FastMDP-RL's ability to expedite inference and accurately predict WSIs, even in the absence of pixel-level annotations. Moreover, our research investigates the WSI-based interactive environment, encompassing the design of agents, state and reward functions, and feature extractors suitable for melanoma tissue images. This investigation offers valuable insights and references for researchers engaged in related studies. The code is available at: https://github.com/titizheng/FastMDP-RL .

Seeing the random forest through the decision trees. Supporting learning health systems from histopathology with machine learning models: Challenges and opportunities

Machine learning in computational histopathology: Challenges and opportunities

Advancing Histopathology with Deep Learning Under Data Scarcity: A Decade in Review

Deep Learning Models for Digital Pathology

The Role of Machine Learning in Cardiovascular Pathology

Leveraging random forest techniques for enhanced microbiological analysis: a machine learning approach to investigating microbial communities and their interactions

Explaining Deep Learning Models Applied in Histopathology: Current Developments and the Path to Sustainability

Deep neural network models for computational histopathology: A survey

A Gradient-Boosted Decision-Tree Algorithm for the Prediction of Short-Term Mortality in Acute Heart Failure Patients

Deep learning in histopathology: the path to the clinic

Learning how to detect: A deep reinforcement learning method for whole-slide melanoma histopathology images

"The Human Body is a Black Box": Supporting Clinical Decision-Making with Deep Learning

State of machine and deep learning in histopathological applications in digestive diseases

Deep learning in cancer genomics and histopathology

Revolutionizing Pancreatic Cancer Diagnosis and Prognosis through Machine Learning Technology

Machine Learning for Clinical Decision-Making: Challenges and Opportunities in Cardiovascular Imaging

DeepTree: Pathological Image Classification Through Imitating Tree-Like Strategies of Pathologists

Federated learning for computational pathology on gigapixel whole slide images

Machine learning in healthcare -- a system's perspective

LionForests: Local Interpretation of Random Forests

Deceptive learning in histopathology