Abstract:Mitosis assessment of breast cancer has a strong prognostic importance and is visually evaluated by pathologists. The inter, and intra-observer variability of this assessment is high. In this paper, a two-stage deep learning approach, named MITNET, has been applied to automatically detect nucleus and classify mitoses in whole slide images (WSI) of breast cancer. Moreover, this paper introduces two new datasets. The first dataset is used to detect the nucleus in the WSIs, which contains 139,124 annotated nuclei in 1749 patches extracted from 115 WSIs of breast cancer tissue, and the second dataset consists of 4908 mitotic cells and 4908 non-mitotic cells image samples extracted from 214 WSIs which is used for mitosis classification. The created datasets are used to train the MITNET network, which consists of two deep learning architectures, called MITNET-det and MITNET-rec, respectively, to isolate nuclei cells and identify the mitoses in WSIs. In MITNET-det architecture, to extract features from nucleus images and fuse them, CSPDarknet and Path Aggregation Network (PANet) are used, respectively, and then, a detection strategy using You Look Only Once (scaled-YOLOv4) is employed to detect nucleus at three different scales. In the classification part, the detected isolated nucleus images are passed through proposed MITNET-rec deep learning architecture, to identify the mitosis in the WSIs. Various deep learning classifiers and the proposed classifier are trained with a publicly available mitosis datasets (MIDOG and ATYPIA) and then, validated over our created dataset. The results verify that deep learning-based classifiers trained on MIDOG and ATYPIA have difficulties to recognize mitosis on our dataset which shows that the created mitosis dataset has unique features and characteristics. Besides this, the proposed classifier outperforms the state-of-the-art classifiers significantly and achieves a $$68.7\%$$ F1-score and $$49.0\%$$ F1-score on the MIDOG and the created mitosis datasets, respectively. Moreover, the experimental results reveal that the overall proposed MITNET framework detects the nucleus in WSIs with high detection rates and recognizes the mitotic cells in WSI with high F1-score which leads to the improvement of the accuracy of pathologists’ decision.

CNMI-YOLO: Domain Adaptive and Robust Mitosis Identification in Digital Pathology

MITNET: a novel dataset and a two-stage deep learning approach for mitosis recognition in whole slide images of breast cancer tissue

Mitosis domain generalization in histopathology images — The MIDOG challenge

OMG-Net: A Deep Learning Framework Deploying Segment Anything to Detect Pan-Cancer Mitotic Figures from Haematoxylin and Eosin-Stained Slides

Mitosis Detection, Fast and Slow: Robust and Efficient Detection of Mitotic Figures

A generalizable and robust deep learning algorithm for mitosis detection in multicenter breast histopathological images

Advancing Breast Cancer Detection: Enhancing YOLOv5 Network for Accurate Classification in Mammogram Images

YOLO and residual network for colorectal cancer cell detection and counting

Robust Multi-Domain Mitosis Detection

PI-YOLO: dynamic sparse attention and lightweight convolutional based YOLO for vessel detection in pathological images

A Yolo-Based Model for Breast Cancer Detection in Mammograms

Oral mucosal lesions triage via YOLOv7 models

Assessing domain adaptation techniques for mitosis detection in multi-scanner breast cancer histopathology images

Early Melanoma Detection Based on a Hybrid YOLOv5 and ResNet Technique

Research on Cervical Cancer p16/Ki-67 Immunohistochemical Dual-Staining Image Recognition Algorithm Based on YOLO

MITOS-RCNN: A Novel Approach to Mitotic Figure Detection in Breast Cancer Histopathology Images using Region Based Convolutional Neural Networks

CAF-YOLO: A Robust Framework for Multi-Scale Lesion Detection in Biomedical Imagery

SOCR‐YOLO: Small Objects Detection Algorithm in Medical Images

Automated Brain Tumor Segmentation and Classification in MRI Using YOLO-Based Deep Learning

Modified YOLO network model for metaphase cell detection in antinuclear antibody images

Separable-HoverNet and Instance-YOLO for Colon Nuclei Identification and Counting