Abstract:Background and objective: The classification of bone marrow (BM) cells by light microscopy is an important cornerstone of hematological diagnosis, performed thousands of times a day by highly trained specialists in laboratories worldwide. As the manual evaluation of blood or BM smears is very time-consuming and prone to inter-observer variation, new reliable automated systems are needed. Methods: We aim to improve the automatic classification performance of hematological cell types. Therefore, we evaluate four state-of-the-art Convolutional Neural Network (CNN) architectures on a dataset of 171,374 microscopic cytological single-cell images obtained from BM smears from 945 patients diagnosed with a variety of hematological diseases. We further evaluate the effect of an in-domain vs. out-of-domain pre-training, and assess whether class activation maps provide human-interpretable explanations for the models' predictions. Results: The best performing pre-trained model (Regnet_y_32gf) yields a mean precision, recall, and F1 scores of 0.787±0.060, 0.755±0.061, and 0.762±0.050, respectively. This is a 53.5% improvement in precision and 7.3% improvement in recall over previous results with CNNs (ResNeXt-50) that were trained from scratch. The out-of-domain pre-training apparently yields general feature extractors/filters that apply very well to the BM cell classification use case. The class activation maps on cell types with characteristic morphological features were found to be consistent with the explanations of a human domain expert. For example, the Auer rods in the cytoplasm were the predictive cellular feature for correctly classified images of faggot cells. Conclusions: Our study provides data that can help hematology laboratories to choose the optimal training strategy for blood cell classification deep learning models to improve computer-assisted blood and bone marrow cell identification. It also highlights the need for more specific training data, i.e. images of difficult-to-classify classes, including cells labeled with disease information.

Complementary Performances of Convolutional and Capsule Neural Networks on Classifying Microfluidic Images of Dividing Yeast Cells

A computer vision and residual neural network (ResNet) combined method for automated and accurate yeast replicative aging analysis of high-throughput microfluidic single-cell images

Multiclass Yeast Segmentation in Microstructured Environments with Deep Learning

DeepLearnMOR: a Deep-Learning Framework for Fluorescence Image-Based Classification of Organelle Morphology.

Classification and counting of cells in brightfield microscopy images: an application of convolutional neural networks

Deep learning enabled label-free microfluidic droplet classification for single cell functional assays

Cell Classification Based on Artificial Intelligence Analysis of Cell Images in Microfluidic Chip

Yeast cell segmentation in microstructured environments with deep learning

Influences of Microscopic Imaging Conditions on Accuracy of Cell Morphology Discrimination Using Convolutional Neural Network of Deep Learning

Evaluation of a Deep Learning Based Approach to Computational Label Free Cell Viability Quantification

BloodCaps: A Capsule Network Based Model for the Multiclassification of Human Peripheral Blood Cells.

Evaluation of deep learning training strategies for the classification of bone marrow cell images

Automatic Detection of Three Cell Types in a Microscope Image Based on Deep Learning

Insights into Cellular Evolution: Temporal Deep Learning Models and Analysis for Cell Image Classification

A Modular Deep Learning Pipeline for Cell Culture Analysis: Investigating the Proliferation of Cardiomyocytes

Cytopathic Effect Detection and Clonal Selection using Deep Learning

Using Deep Convolutional Neural Networks to Circumvent Morphological Feature Specification when Classifying Subvisible Protein Aggregates from Micro-Flow Images

Efficient Cell Classification of Mitochondrial Images by Using Deep Learning

Deep Cytometry: Deep learning with Real-time Inference in Cell Sorting and Flow Cytometry

Mixing characterization of binary-coalesced droplets in microchannels using deep neural network

Combining Convolutional Neural Networks for Fungi Classification