Abstract:Molecular subtypes of breast cancer are important references to personalized clinical treatment. For cost and labor savings, only one of the patient's paraffin blocks is usually selected for subsequent immunohistochemistry (IHC) to obtain molecular subtypes. Inevitable sampling error is risky due to tumor heterogeneity and could result in a delay in treatment. Molecular subtype prediction from conventional H&E pathological whole slide images (WSI) using AI method is useful and critical to assist pathologists pre-screen proper paraffin block for IHC. It's a challenging task since only WSI level labels of molecular subtypes can be obtained from IHC. Gigapixel WSIs are divided into a huge number of patches to be computationally feasible for deep learning. While with coarse slide-level labels, patch-based methods may suffer from abundant noise patches, such as folds, overstained regions, or non-tumor tissues. A weakly supervised learning framework based on discriminative patch selecting and multi-instance learning was proposed for breast cancer molecular subtype prediction from H&E WSIs. Firstly, co-teaching strategy was adopted to learn molecular subtype representations and filter out noise patches. Then, a balanced sampling strategy was used to handle the imbalance in subtypes in the dataset. In addition, a noise patch filtering algorithm that used local outlier factor based on cluster centers was proposed to further select discriminative patches. Finally, a loss function integrating patch with slide constraint information was used to finetune MIL framework on obtained discriminative patches and further improve the performance of molecular subtyping. The experimental results confirmed the effectiveness of the proposed method and our models outperformed even senior pathologists, with potential to assist pathologists to pre-screen paraffin blocks for IHC in clinic.

Pathological Image Retrieval for Breast Cancer with pLSA Model

Retrieval of pathology image for breast cancer using PLSA model based on texture and pathological features

PLSA-based Pathological Image Retrieval for Breast Cancer with Color Deconvolution

Sparse Codebook Model of Local Structures for Retrieval of Focal Liver Lesions Using Multiphase Medical Images

Breast Histopathological Image Retrieval Based on Latent Dirichlet Allocation

LEARNING BINARY SEMANTIC EMBEDDING FOR BREAST HISTOLOGY IMAGE CLASSIFICATION AND RETRIEVAL

Label-Efficient Breast Cancer Histopathological Image Classification

Breast Cancer Histopathological Image Classification Via Deep Active Learning And Confidence Boosting

Learning Binary Semantic Embedding Forlarge-Scale Breast Histology Image Analysis.

A Computer-Aided Diagnosis System for Breast Pathology: A Deep Learning Approach with Model Interpretability from Pathological Perspective

Breast Cancer Classification in Pathological Images Based on Hybrid Features

Understanding the Mechanism of Deep Learning Framework for Lesion Detection in Pathological Images with Breast Cancer

A Lightweight Spatially-Aware Classification Model for Breast Cancer Pathology Images

Research on Breast Lesion Localization and Diagnosis Based on Knowledge-Driven and Data-Driven Approach

Exploring Pathologist Knowledge for Automatic Assessment of Breast Cancer Metastases in Whole-slide Image.

Image Retrieval Method Based on Salient Region and Plsa

Evaluating Cancer-Related Biomarkers Based on Pathological Images: A Systematic Review

Breast Cancer Diagnosis from Biopsy Images Using a Fully Automatic Method

Breast Cancer Molecular Subtypes Prediction on Pathological Images with Discriminative Patch Selecting and Multi-Instance Learning

Content-based Histopathological Image Retrieval for Whole Slide Image Database Using Binary Codes

Contrastive learning-based histopathological features infer molecular subtypes and clinical outcomes of breast cancer from unannotated whole slide images