Abstract:Background and objective: The classification of bone marrow (BM) cells by light microscopy is an important cornerstone of hematological diagnosis, performed thousands of times a day by highly trained specialists in laboratories worldwide. As the manual evaluation of blood or BM smears is very time-consuming and prone to inter-observer variation, new reliable automated systems are needed. Methods: We aim to improve the automatic classification performance of hematological cell types. Therefore, we evaluate four state-of-the-art Convolutional Neural Network (CNN) architectures on a dataset of 171,374 microscopic cytological single-cell images obtained from BM smears from 945 patients diagnosed with a variety of hematological diseases. We further evaluate the effect of an in-domain vs. out-of-domain pre-training, and assess whether class activation maps provide human-interpretable explanations for the models' predictions. Results: The best performing pre-trained model (Regnet_y_32gf) yields a mean precision, recall, and F1 scores of 0.787±0.060, 0.755±0.061, and 0.762±0.050, respectively. This is a 53.5% improvement in precision and 7.3% improvement in recall over previous results with CNNs (ResNeXt-50) that were trained from scratch. The out-of-domain pre-training apparently yields general feature extractors/filters that apply very well to the BM cell classification use case. The class activation maps on cell types with characteristic morphological features were found to be consistent with the explanations of a human domain expert. For example, the Auer rods in the cytoplasm were the predictive cellular feature for correctly classified images of faggot cells. Conclusions: Our study provides data that can help hematology laboratories to choose the optimal training strategy for blood cell classification deep learning models to improve computer-assisted blood and bone marrow cell identification. It also highlights the need for more specific training data, i.e. images of difficult-to-classify classes, including cells labeled with disease information.

A method to classify bone marrow cells with rejected option

A novel bone marrow cell recognition method based on multi-scale information and reject option

A classification method to classify bone marrow cells with class imbalance problem

A deep learning method and device for bone marrow imaging cell detection

Aml, All, And Cml Classification And Diagnosis Based On Bone Marrow Cell Morphology Combined With Convolutional Neural Network A Stard Compliant Diagnosis Research

RC R-CNN for Bone Marrow Cell Recognition

High-accuracy morphological identification of bone marrow cells using deep learning-based Morphogo system

A deep learning method for counting white blood cells in bone marrow images

Classification of Bone Marrow Cells Based on Dual-Channel Convolutional Block Attention Network

An Intelligent Attention-Based Transfer Learning Model for Accurate Differentiation of Bone Marrow Stains to Diagnose Hematological Disorder

CellIdNet: Automatic Cell Instance Segmentation and Classification in Bone Marrow Examination with Double Backbone Networks.

Bone Marrow Cell Recognition: Training Deep Object Detection with A New Loss Function

Artificial intelligence-assisted diagnosis of hematologic diseases based on bone marrow smears using deep neural networks

The Algorithm of Marrow Cell Identification and Classification

Bone Marrow Cells Detection: A Technique for the Microscopic Image Analysis

Research on Classifying Method for Multi-spectrum Bone Marrow Cells

Evaluation of deep learning training strategies for the classification of bone marrow cell images

White blood cell differential count of maturation stages in bone marrow smear using dual-stage convolutional neural networks

Developing and Preliminary Validating an Automatic Cell Classification System for Bone Marrow Smears: a Pilot Study

Deep Learning for Morphology-Based, Bone Marrow Cell Classification

A Segmentation Method Based on HMRF for the Aided Diagnosis of Acute Myeloid Leukemia