Abstract:BACKGROUND: Deep learning (DL) is a representation learning approach ideally suited for image analysis challenges in digital pathology (DP). The variety of image analysis tasks in the context of DP includes detection and counting (e.g., mitotic events), segmentation (e.g., nuclei), and tissue classification (e.g., cancerous vs. non-cancerous). Unfortunately, issues with slide preparation, variations in staining and scanning across sites, and vendor platforms, as well as biological variance, such as the presentation of different grades of disease, make these image analysis tasks particularly challenging. Traditional approaches, wherein domain-specific cues are manually identified and developed into task-specific "handcrafted" features, can require extensive tuning to accommodate these variances. However, DL takes a more domain agnostic approach combining both feature discovery and implementation to maximally discriminate between the classes of interest. While DL approaches have performed well in a few DP related image analysis tasks, such as detection and tissue classification, the currently available open source tools and tutorials do not provide guidance on challenges such as (a) selecting appropriate magnification, (b) managing errors in annotations in the training (or learning) dataset, and (c) identifying a suitable training set containing information rich exemplars. These foundational concepts, which are needed to successfully translate the DL paradigm to DP tasks, are non-trivial for (i) DL experts with minimal digital histology experience, and (ii) DP and image processing experts with minimal DL experience, to derive on their own, thus meriting a dedicated tutorial.AIMS: This paper investigates these concepts through seven unique DP tasks as use cases to elucidate techniques needed to produce comparable, and in many cases, superior to results from the state-of-the-art hand-crafted feature-based classification approaches.RESULTS: Specifically, in this tutorial on DL for DP image analysis, we show how an open source framework (Caffe), with a singular network architecture, can be used to address: (a) nuclei segmentation (F-score of 0.83 across 12,000 nuclei), (b) epithelium segmentation (F-score of 0.84 across 1735 regions), (c) tubule segmentation (F-score of 0.83 from 795 tubules), (d) lymphocyte detection (F-score of 0.90 across 3064 lymphocytes), (e) mitosis detection (F-score of 0.53 across 550 mitotic events), (f) invasive ductal carcinoma detection (F-score of 0.7648 on 50 k testing patches), and (g) lymphoma classification (classification accuracy of 0.97 across 374 images).CONCLUSION: This paper represents the largest comprehensive study of DL approaches in DP to date, with over 1200 DP images used during evaluation. The supplemental online material that accompanies this paper consists of step-by-step instructions for the usage of the supplied source code, trained models, and input data.

Higher Education Teaching Material on Machine Learning in the Domain of Digital Pathology

Deep Learning Models for Digital Pathology

Deep learning in cancer genomics and histopathology

Machine learning in computational histopathology: Challenges and opportunities

Deep Learning in Digital Pathology Analysis

Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases

Deep Teaching: Materials for Teaching Machine and Deep Learning

Deep Learning in Digital Pathology Image Analysis: a Survey

Practical Application of Deep Learning in Diagnostic Neuropathology—Reimagining a Histological Asset in the Era of Precision Medicine

Deep learning in cancer pathology: a new generation of clinical biomarkers

State of machine and deep learning in histopathological applications in digestive diseases

Deep Learning Approaches and Applications in Toxicologic Histopathology: Current Status and Future Perspectives

Multiple Instance Learning for Digital Pathology: A Review on the State-of-the-Art, Limitations & Future Potential

A systematic analysis of deep learning in genomics and histopathology for precision oncology

Scalable deep learning artificial intelligence histopathology slide analysis and validation

A survey on active learning and human-in-the-loop deep learning for medical image analysis

Towards the Augmented Pathologist: Challenges of Explainable-AI in Digital Pathology

Machine learning and deep learning approach for medical image analysis: diagnosis to detection

Emerging Role of Deep Learning‐based Artificial Intelligence in Tumor Pathology

Introduction to machine and deep learning for medical physicists

Towards Artificial Intelligence Applications in Next Generation Cytopathology